2023-07-26 13:53:36,651 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-07-26 13:53:36,955 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-07-26 13:53:37,072 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-07-26 13:53:37,130 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-07-26 13:53:37,138 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-07-26 13:53:37,155 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=354, ProcessCount=171, AvailableMemoryMB=8843
2023-07-26 13:53:37,156 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-07-26 13:53:37,157 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-07-26 13:53:37,295 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1031907734:84 , srv1032048348:84 , srv1086930197:84 , srv1092935476:84 , srv1118342697:84 , srv11841248:84 , srv1229599984:84 , srv1238594785:84 , srv1250038713:84 , srv127036973:84 , srv1284022244:84 , srv1293469839:84 , srv1372875680:84 , srv1426799471:84 , srv1445592076:84 , srv146994906:84 , srv1480465330:84 , srv148787741:84 , srv1507976678:84 , srv1510225822:84 , srv1516030225:84 , srv1520351095:84 , srv1527581409:84 , srv1571925531:84 , srv1620173112:84 , srv166466387:84 , srv1681817901:84 , srv1684200202:84 , srv1731229664:84 , srv1747867572:84 , srv1754625283:84 , srv1757458757:84 , srv1786684658:84 , srv1845041993:84 , srv1873779792:84 , srv1886304773:84 , srv189541345:84 , srv1897308083:84 , srv1904799689:84 , srv1920501053:84 , srv19268951:84 , srv1947180035:84 , srv1952524721:84 , srv1957275936:84 , srv1984666596:84 , srv1986056155:84 , srv2003872605:84 , srv2005309376:84 , srv2017807951:84 , srv2021463666:84 , srv203330888:84 , srv2051716443:84 , srv2067266235:84 , srv2075120815:84 , srv2088398189:84 , srv2097982121:84 , srv2133769150:84 , srv2134098687:84 , srv224863032:84 , srv282397890:84 , srv289436130:84 , srv300301019:84 , srv302816475:84 , srv312932318:84 , srv318491747:84 , srv347236050:84 , srv381003126:84 , srv397646440:84 , srv42116262:84 , srv423245140:84 , srv44549632:84 , srv45327616:84 , srv456693869:84 , srv461362030:84 , srv481880331:84 , srv516570825:84 , srv53697899:84 , srv55292773:84 , srv565112944:84 , srv60201832:84 , srv621864002:84 , srv645570245:84 , srv670166713:84 , srv689562217:84 , srv697987250:84 , srv701558900:84 , srv706716192:84 , srv74758775:84 , srv754521669:84 , srv77299063:84 , srv784882918:84 , srv809957047:84 , srv837547228:84 , srv874063954:84 , srv887178315:84 , srv895015689:84 , srv923179139:84 , srv941695119:84 , srv982098047:84 , srv1835424521:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-07-26 13:53:37,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-26 13:53:37,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1947180035=42, srv621864002=81, srv1897308083=38, srv1786684658=32, srv1092935476=3, srv941695119=98, srv74758775=88, srv689562217=84, srv923179139=97, srv1516030225=20, srv189541345=37, srv2005309376=48, srv1731229664=28, srv1747867572=29, srv701558900=86, srv2067266235=53, srv837547228=93, srv1445592076=14, srv706716192=87, srv44549632=71, srv1031907734=0, srv1520351095=21, srv2021463666=50, srv784882918=91, srv2051716443=52, srv1507976678=18, srv1426799471=13, srv2003872605=47, srv1754625283=30, srv874063954=94, srv645570245=82, srv1571925531=23, srv224863032=59, srv381003126=67, srv1873779792=35, srv1957275936=44, srv1118342697=4, srv347236050=66, srv2017807951=49, srv19268951=41, srv423245140=70, srv60201832=80, srv1284022244=10, srv2134098687=58, srv481880331=75, srv887178315=95, srv1086930197=2, srv1510225822=19, srv1986056155=46, srv516570825=76, srv2133769150=57, srv42116262=69, srv203330888=51, srv754521669=89, srv809957047=92, srv1757458757=31, srv461362030=74, srv302816475=63, srv45327616=72, srv1229599984=6, srv1293469839=11, srv1886304773=36, srv670166713=83, srv166466387=25, srv2075120815=54, srv289436130=61, srv1835424521=33, srv982098047=99, srv318491747=65, srv1032048348=1, srv53697899=77, srv1527581409=22, srv300301019=62, srv1845041993=34, srv1920501053=40, srv11841248=5, srv77299063=90, srv1238594785=7, srv1372875680=12, srv1952524721=43, srv895015689=96, srv127036973=9, srv1984666596=45, srv456693869=73, srv1480465330=16, srv1904799689=39, srv146994906=15, srv312932318=64, srv397646440=68, srv148787741=17, srv2088398189=55, srv1684200202=27, srv2097982121=56, srv282397890=60, srv697987250=85, srv55292773=78, srv1620173112=24, srv1250038713=8, srv1681817901=26, srv565112944=79} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-26 13:53:37,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-26 13:53:37,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-26 13:53:37,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-26 13:53:37,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-26 13:53:37,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-26 13:53:37,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-26 13:53:37,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-26 13:53:37,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-26 13:53:37,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-26 13:53:37,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-26 13:53:37,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-26 13:53:37,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-26 13:53:37,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-26 13:53:37,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-26 13:53:37,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-26 13:53:37,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-26 13:53:37,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-26 13:53:37,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-26 13:53:37,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-26 13:53:37,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-26 13:53:37,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-26 13:53:37,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-26 13:53:37,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-26 13:53:37,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-26 13:53:37,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-26 13:53:37,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-26 13:53:37,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-26 13:53:37,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-26 13:53:37,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-26 13:53:37,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-26 13:53:37,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-26 13:53:37,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-26 13:53:37,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-26 13:53:37,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-26 13:53:37,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-26 13:53:37,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-26 13:53:37,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-26 13:53:37,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-26 13:53:37,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-26 13:53:37,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-26 13:53:37,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-26 13:53:37,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-26 13:53:37,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-26 13:53:37,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-26 13:53:37,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-26 13:53:37,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-26 13:53:37,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-26 13:53:37,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-26 13:53:37,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-26 13:53:37,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-26 13:53:37,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-26 13:53:37,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-26 13:53:37,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-26 13:53:37,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-26 13:53:37,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-26 13:53:37,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-26 13:53:37,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-26 13:53:37,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-26 13:53:37,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-26 13:53:37,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-26 13:53:37,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-26 13:53:37,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-26 13:53:37,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-26 13:53:37,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-26 13:53:37,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-26 13:53:37,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-26 13:53:37,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-26 13:53:37,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-26 13:53:37,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-26 13:53:37,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-26 13:53:37,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-26 13:53:37,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-26 13:53:37,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-26 13:53:37,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-26 13:53:37,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-26 13:53:37,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-26 13:53:37,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-26 13:53:37,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-26 13:53:37,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-26 13:53:37,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-26 13:53:37,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-26 13:53:37,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-26 13:53:37,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-26 13:53:37,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-26 13:53:37,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-26 13:53:37,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-26 13:53:37,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-26 13:53:37,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-26 13:53:37,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-26 13:53:37,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-26 13:53:37,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-26 13:53:37,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-26 13:53:37,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-26 13:53:37,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-26 13:53:37,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-26 13:53:37,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-26 13:53:37,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-26 13:53:37,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-26 13:53:37,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-26 13:53:37,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-26 13:53:37,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-26 13:53:37,834 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-26 13:53:37,835 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-26 13:53:37,835 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-26 13:53:38,523 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 1109 ms to try 5000 different iterations.  Found a solution that moves 4703 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.1756053313183431. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04216488516337384, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.058994568792608476, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5225555555555556, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04216488516337384, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17033333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24166666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-26 13:53:38,535 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1086930197:83 , srv1092935476:83 , srv1731229664:83 , srv2021463666:83 , srv289436130:83 , srv516570825:83 , srv887178315:83 , srv895015689:83 , srv1031907734:84 , srv1372875680:84 , srv1684200202:84 , srv1873779792:84 , srv189541345:84 , srv1957275936:84 , srv2005309376:84 , srv302816475:84 , srv461362030:84 , srv53697899:84 , srv837547228:84 , srv1032048348:85 , srv1118342697:85 , srv1250038713:85 , srv1284022244:85 , srv1293469839:85 , srv146994906:85 , srv1754625283:85 , srv1786684658:85 , srv1845041993:85 , srv1886304773:85 , srv19268951:85 , srv1952524721:85 , srv1984666596:85 , srv1986056155:85 , srv2003872605:85 , srv2017807951:85 , srv2051716443:85 , srv423245140:85 , srv44549632:85 , srv45327616:85 , srv456693869:85 , srv55292773:85 , srv565112944:85 , srv697987250:85 , srv77299063:85 , srv941695119:85 , srv1445592076:86 , srv1507976678:86 , srv1527581409:86 , srv1620173112:86 , srv1897308083:86 , srv1947180035:86 , srv203330888:86 , srv2075120815:86 , srv2133769150:86 , srv224863032:86 , srv282397890:86 , srv381003126:86 , srv397646440:86 , srv481880331:86 , srv645570245:86 , srv701558900:86 , srv754521669:86 , srv784882918:86 , srv809957047:86 , srv923179139:86 , srv982098047:86 , srv1480465330:87 , srv148787741:87 , srv1571925531:87 , srv2088398189:87 , srv2097982121:87 , srv300301019:87 , srv347236050:87 , srv689562217:87 , srv706716192:87 , srv166466387:88 , srv1747867572:88 , srv1757458757:88 , srv1904799689:88 , srv2067266235:88 , srv318491747:88 , srv42116262:88 , srv874063954:88 , srv1510225822:89 , srv1516030225:89 , srv1681817901:89 , srv1920501053:89 , srv2134098687:89 , srv312932318:89 , srv621864002:89 , srv670166713:89 , srv1229599984:90 , srv1238594785:90 , srv74758775:90 , srv127036973:91 , srv1426799471:91 , srv60201832:91 , srv11841248:93 , srv1520351095:96 , srv1835424521:465 }
2023-07-26 13:53:38,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-26 13:53:38,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1947180035=42, srv621864002=81, srv1897308083=38, srv1786684658=32, srv1092935476=3, srv941695119=98, srv74758775=88, srv689562217=84, srv923179139=97, srv1516030225=20, srv189541345=37, srv2005309376=48, srv1731229664=28, srv1747867572=29, srv701558900=86, srv2067266235=53, srv837547228=93, srv1445592076=14, srv706716192=87, srv44549632=71, srv1031907734=0, srv1520351095=21, srv2021463666=50, srv784882918=91, srv2051716443=52, srv1507976678=18, srv1426799471=13, srv2003872605=47, srv1754625283=30, srv874063954=94, srv645570245=82, srv1571925531=23, srv224863032=59, srv381003126=67, srv1873779792=35, srv1957275936=44, srv1118342697=4, srv347236050=66, srv2017807951=49, srv19268951=41, srv423245140=70, srv60201832=80, srv1284022244=10, srv2134098687=58, srv481880331=75, srv887178315=95, srv1086930197=2, srv1510225822=19, srv1986056155=46, srv516570825=76, srv2133769150=57, srv42116262=69, srv203330888=51, srv754521669=89, srv809957047=92, srv1757458757=31, srv461362030=74, srv302816475=63, srv45327616=72, srv1229599984=6, srv1293469839=11, srv1886304773=36, srv670166713=83, srv166466387=25, srv2075120815=54, srv289436130=61, srv1835424521=33, srv982098047=99, srv318491747=65, srv1032048348=1, srv53697899=77, srv1527581409=22, srv300301019=62, srv1845041993=34, srv1920501053=40, srv11841248=5, srv77299063=90, srv1238594785=7, srv1372875680=12, srv1952524721=43, srv895015689=96, srv127036973=9, srv1984666596=45, srv456693869=73, srv1480465330=16, srv1904799689=39, srv146994906=15, srv312932318=64, srv397646440=68, srv148787741=17, srv2088398189=55, srv1684200202=27, srv2097982121=56, srv282397890=60, srv697987250=85, srv55292773=78, srv1620173112=24, srv1250038713=8, srv1681817901=26, srv565112944=79} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-26 13:53:38,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-26 13:53:38,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-26 13:53:38,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-26 13:53:38,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-26 13:53:38,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-26 13:53:38,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-26 13:53:38,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-26 13:53:38,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-26 13:53:38,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-26 13:53:38,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-26 13:53:38,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-26 13:53:38,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-26 13:53:38,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-26 13:53:38,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-26 13:53:38,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-26 13:53:38,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-26 13:53:38,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-26 13:53:38,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-26 13:53:38,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-26 13:53:38,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-26 13:53:38,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-26 13:53:38,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-26 13:53:38,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-26 13:53:38,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-26 13:53:38,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-26 13:53:38,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-26 13:53:38,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-26 13:53:38,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-26 13:53:38,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-26 13:53:38,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-26 13:53:38,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-26 13:53:38,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-26 13:53:38,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-26 13:53:38,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-26 13:53:38,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-26 13:53:38,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-26 13:53:38,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-26 13:53:38,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-26 13:53:38,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-26 13:53:38,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-26 13:53:38,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-26 13:53:38,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-26 13:53:38,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-26 13:53:38,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-26 13:53:38,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-26 13:53:38,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-26 13:53:38,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-26 13:53:38,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-26 13:53:38,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-26 13:53:38,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-26 13:53:38,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-26 13:53:38,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-26 13:53:38,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-26 13:53:38,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-26 13:53:38,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-26 13:53:38,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-26 13:53:38,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-26 13:53:38,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-26 13:53:38,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-26 13:53:38,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-26 13:53:38,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-26 13:53:38,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-26 13:53:38,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-26 13:53:38,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-26 13:53:38,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-26 13:53:38,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-26 13:53:38,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-26 13:53:38,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-26 13:53:38,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-26 13:53:38,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-26 13:53:38,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-26 13:53:38,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-26 13:53:38,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-26 13:53:38,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-26 13:53:38,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-26 13:53:38,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-26 13:53:38,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-26 13:53:38,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-26 13:53:38,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-26 13:53:38,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-26 13:53:38,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-26 13:53:38,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-26 13:53:38,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-26 13:53:38,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-26 13:53:38,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-26 13:53:38,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-26 13:53:38,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-26 13:53:38,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-26 13:53:38,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-26 13:53:38,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-26 13:53:38,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-26 13:53:38,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-26 13:53:38,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-26 13:53:38,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-26 13:53:38,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-26 13:53:38,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-26 13:53:38,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-26 13:53:38,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-26 13:53:38,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-26 13:53:38,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-26 13:53:38,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-26 13:53:38,749 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04216488516337384, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.058994568792608476, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04216488516337384, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17033333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24166666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-26 13:53:38,749 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-26 13:53:38,749 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.1755724002084924, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04216488516337384, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.058994568792608476, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04216488516337384, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17033333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24166666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-26 13:53:39,072 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 458 ms to try 5000 different iterations.  Found a solution that moves 2576 regions; Going from a computed imbalance of 0.1755724002084924 to a new imbalance of 0.015153496095008075. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.024844697821700356); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03748550037675997, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2862222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.024844697821700356); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04575, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-26 13:53:39,085 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1520351095:76 , srv60201832:78 , srv1229599984:81 , srv1510225822:81 , srv312932318:81 , srv11841248:82 , srv1238594785:82 , srv127036973:82 , srv1426799471:82 , srv74758775:82 , srv874063954:82 , srv1516030225:83 , srv1571925531:83 , srv1681817901:83 , srv1897308083:83 , srv2067266235:83 , srv2088398189:83 , srv318491747:83 , srv621864002:83 , srv148787741:84 , srv1747867572:84 , srv1904799689:84 , srv1920501053:84 , srv2075120815:84 , srv2133769150:84 , srv224863032:84 , srv300301019:84 , srv809957047:84 , srv1480465330:85 , srv1527581409:85 , srv1757458757:85 , srv19268951:85 , srv1947180035:85 , srv1952524721:85 , srv2097982121:85 , srv347236050:85 , srv381003126:85 , srv397646440:85 , srv42116262:85 , srv461362030:85 , srv689562217:85 , srv706716192:85 , srv941695119:85 , srv1118342697:86 , srv1250038713:86 , srv1284022244:86 , srv1293469839:86 , srv1620173112:86 , srv166466387:86 , srv1845041993:86 , srv2051716443:86 , srv2134098687:86 , srv670166713:86 , srv754521669:86 , srv784882918:86 , srv923179139:86 , srv982098047:86 , srv1031907734:87 , srv1372875680:87 , srv1445592076:87 , srv146994906:87 , srv1507976678:87 , srv1786684658:87 , srv1886304773:87 , srv1984666596:87 , srv1986056155:87 , srv2005309376:87 , srv2017807951:87 , srv203330888:87 , srv282397890:87 , srv289436130:87 , srv45327616:87 , srv456693869:87 , srv565112944:87 , srv697987250:87 , srv77299063:87 , srv895015689:87 , srv1032048348:88 , srv1086930197:88 , srv1092935476:88 , srv1684200202:88 , srv1873779792:88 , srv1957275936:88 , srv2003872605:88 , srv302816475:88 , srv423245140:88 , srv44549632:88 , srv481880331:88 , srv516570825:88 , srv55292773:88 , srv645570245:88 , srv701558900:88 , srv837547228:88 , srv887178315:88 , srv1754625283:89 , srv189541345:89 , srv2021463666:89 , srv53697899:89 , srv1731229664:90 , srv1835424521:530 }
2023-07-26 13:53:39,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-26 13:53:39,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1947180035=42, srv621864002=81, srv1897308083=38, srv1786684658=32, srv1092935476=3, srv941695119=98, srv74758775=88, srv689562217=84, srv923179139=97, srv1516030225=20, srv189541345=37, srv2005309376=48, srv1731229664=28, srv1747867572=29, srv701558900=86, srv2067266235=53, srv837547228=93, srv1445592076=14, srv706716192=87, srv44549632=71, srv1031907734=0, srv1520351095=21, srv2021463666=50, srv784882918=91, srv2051716443=52, srv1507976678=18, srv1426799471=13, srv2003872605=47, srv1754625283=30, srv874063954=94, srv645570245=82, srv1571925531=23, srv224863032=59, srv381003126=67, srv1873779792=35, srv1957275936=44, srv1118342697=4, srv347236050=66, srv2017807951=49, srv19268951=41, srv423245140=70, srv60201832=80, srv1284022244=10, srv2134098687=58, srv481880331=75, srv887178315=95, srv1086930197=2, srv1510225822=19, srv1986056155=46, srv516570825=76, srv2133769150=57, srv42116262=69, srv203330888=51, srv754521669=89, srv809957047=92, srv1757458757=31, srv461362030=74, srv302816475=63, srv45327616=72, srv1229599984=6, srv1293469839=11, srv1886304773=36, srv670166713=83, srv166466387=25, srv2075120815=54, srv289436130=61, srv1835424521=33, srv982098047=99, srv318491747=65, srv1032048348=1, srv53697899=77, srv1527581409=22, srv300301019=62, srv1845041993=34, srv1920501053=40, srv11841248=5, srv77299063=90, srv1238594785=7, srv1372875680=12, srv1952524721=43, srv895015689=96, srv127036973=9, srv1984666596=45, srv456693869=73, srv1480465330=16, srv1904799689=39, srv146994906=15, srv312932318=64, srv397646440=68, srv148787741=17, srv2088398189=55, srv1684200202=27, srv2097982121=56, srv282397890=60, srv697987250=85, srv55292773=78, srv1620173112=24, srv1250038713=8, srv1681817901=26, srv565112944=79} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-26 13:53:39,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-26 13:53:39,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-26 13:53:39,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-26 13:53:39,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-26 13:53:39,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-26 13:53:39,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-26 13:53:39,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-26 13:53:39,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-26 13:53:39,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-26 13:53:39,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-26 13:53:39,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-26 13:53:39,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-26 13:53:39,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-26 13:53:39,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-26 13:53:39,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-26 13:53:39,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-26 13:53:39,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-26 13:53:39,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-26 13:53:39,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-26 13:53:39,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-26 13:53:39,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-26 13:53:39,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-26 13:53:39,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-26 13:53:39,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-26 13:53:39,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-26 13:53:39,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-26 13:53:39,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-26 13:53:39,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-26 13:53:39,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-26 13:53:39,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-26 13:53:39,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-26 13:53:39,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-26 13:53:39,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-26 13:53:39,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-26 13:53:39,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-26 13:53:39,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-26 13:53:39,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-26 13:53:39,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-26 13:53:39,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-26 13:53:39,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-26 13:53:39,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-26 13:53:39,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-26 13:53:39,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-26 13:53:39,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-26 13:53:39,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-26 13:53:39,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-26 13:53:39,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-26 13:53:39,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-26 13:53:39,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-26 13:53:39,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-26 13:53:39,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-26 13:53:39,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-26 13:53:39,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-26 13:53:39,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-26 13:53:39,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-26 13:53:39,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-26 13:53:39,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-26 13:53:39,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-26 13:53:39,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-26 13:53:39,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-26 13:53:39,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-26 13:53:39,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-26 13:53:39,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-26 13:53:39,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-26 13:53:39,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-26 13:53:39,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-26 13:53:39,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-26 13:53:39,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-26 13:53:39,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-26 13:53:39,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-26 13:53:39,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-26 13:53:39,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-26 13:53:39,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-26 13:53:39,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-26 13:53:39,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-26 13:53:39,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-26 13:53:39,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-26 13:53:39,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-26 13:53:39,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-26 13:53:39,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-26 13:53:39,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-26 13:53:39,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-26 13:53:39,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-26 13:53:39,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-26 13:53:39,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-26 13:53:39,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-26 13:53:39,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-26 13:53:39,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-26 13:53:39,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-26 13:53:39,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-26 13:53:39,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-26 13:53:39,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-26 13:53:39,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-26 13:53:39,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-26 13:53:39,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-26 13:53:39,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-26 13:53:39,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-26 13:53:39,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-26 13:53:39,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-26 13:53:39,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-26 13:53:39,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-26 13:53:39,255 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.024844697821700356); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03748550037675997, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.024844697821700356); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04575, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-26 13:53:39,256 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-26 13:53:39,256 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.015135458557484055, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.024844697821700356); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03748550037675997, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.024844697821700356); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04575, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-26 13:53:39,477 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 330 ms to try 5000 different iterations.  Found a solution that moves 1034 regions; Going from a computed imbalance of 0.015135458557484055 to a new imbalance of 0.0010968212512647048. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006547761159855293); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008382012701302927); MoveCostFunction : (multiplier=7.0, imbalance=0.11488888888888889, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006547761159855293); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.833333333333334E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0055); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-26 13:53:39,479 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv11841248:82 , srv1754625283:83 , srv2134098687:83 , srv481880331:83 , srv670166713:83 , srv1032048348:84 , srv127036973:84 , srv1426799471:84 , srv1445592076:84 , srv1507976678:84 , srv166466387:84 , srv1757458757:84 , srv189541345:84 , srv2017807951:84 , srv42116262:84 , srv645570245:84 , srv701558900:84 , srv1238594785:85 , srv146994906:85 , srv1516030225:85 , srv1520351095:85 , srv1620173112:85 , srv1747867572:85 , srv1920501053:85 , srv1957275936:85 , srv2003872605:85 , srv203330888:85 , srv2067266235:85 , srv2097982121:85 , srv282397890:85 , srv302816475:85 , srv423245140:85 , srv45327616:85 , srv456693869:85 , srv55292773:85 , srv621864002:85 , srv689562217:85 , srv697987250:85 , srv706716192:85 , srv74758775:85 , srv754521669:85 , srv837547228:85 , srv923179139:85 , srv1031907734:86 , srv1086930197:86 , srv1284022244:86 , srv1293469839:86 , srv1372875680:86 , srv1480465330:86 , srv148787741:86 , srv1527581409:86 , srv1681817901:86 , srv1684200202:86 , srv1731229664:86 , srv1786684658:86 , srv1845041993:86 , srv1873779792:86 , srv1886304773:86 , srv1904799689:86 , srv1984666596:86 , srv1986056155:86 , srv2005309376:86 , srv2021463666:86 , srv2051716443:86 , srv300301019:86 , srv318491747:86 , srv347236050:86 , srv44549632:86 , srv516570825:86 , srv53697899:86 , srv565112944:86 , srv77299063:86 , srv784882918:86 , srv887178315:86 , srv982098047:86 , srv1118342697:87 , srv1250038713:87 , srv1510225822:87 , srv1571925531:87 , srv19268951:87 , srv1947180035:87 , srv2075120815:87 , srv2088398189:87 , srv2133769150:87 , srv224863032:87 , srv289436130:87 , srv312932318:87 , srv381003126:87 , srv397646440:87 , srv60201832:87 , srv809957047:87 , srv895015689:87 , srv941695119:87 , srv1092935476:88 , srv1229599984:88 , srv1952524721:88 , srv461362030:88 , srv874063954:88 , srv1897308083:89 , srv1835424521:521 }
2023-07-26 13:53:39,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-26 13:53:39,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1947180035=42, srv621864002=81, srv1897308083=38, srv1786684658=32, srv1092935476=3, srv941695119=98, srv74758775=88, srv689562217=84, srv923179139=97, srv1516030225=20, srv189541345=37, srv2005309376=48, srv1731229664=28, srv1747867572=29, srv701558900=86, srv2067266235=53, srv837547228=93, srv1445592076=14, srv706716192=87, srv44549632=71, srv1031907734=0, srv1520351095=21, srv2021463666=50, srv784882918=91, srv2051716443=52, srv1507976678=18, srv1426799471=13, srv2003872605=47, srv1754625283=30, srv874063954=94, srv645570245=82, srv1571925531=23, srv224863032=59, srv381003126=67, srv1873779792=35, srv1957275936=44, srv1118342697=4, srv347236050=66, srv2017807951=49, srv19268951=41, srv423245140=70, srv60201832=80, srv1284022244=10, srv2134098687=58, srv481880331=75, srv887178315=95, srv1086930197=2, srv1510225822=19, srv1986056155=46, srv516570825=76, srv2133769150=57, srv42116262=69, srv203330888=51, srv754521669=89, srv809957047=92, srv1757458757=31, srv461362030=74, srv302816475=63, srv45327616=72, srv1229599984=6, srv1293469839=11, srv1886304773=36, srv670166713=83, srv166466387=25, srv2075120815=54, srv289436130=61, srv1835424521=33, srv982098047=99, srv318491747=65, srv1032048348=1, srv53697899=77, srv1527581409=22, srv300301019=62, srv1845041993=34, srv1920501053=40, srv11841248=5, srv77299063=90, srv1238594785=7, srv1372875680=12, srv1952524721=43, srv895015689=96, srv127036973=9, srv1984666596=45, srv456693869=73, srv1480465330=16, srv1904799689=39, srv146994906=15, srv312932318=64, srv397646440=68, srv148787741=17, srv2088398189=55, srv1684200202=27, srv2097982121=56, srv282397890=60, srv697987250=85, srv55292773=78, srv1620173112=24, srv1250038713=8, srv1681817901=26, srv565112944=79} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-26 13:53:39,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-26 13:53:39,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-26 13:53:39,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-26 13:53:39,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-26 13:53:39,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-26 13:53:39,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-26 13:53:39,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-26 13:53:39,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-26 13:53:39,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-26 13:53:39,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-26 13:53:39,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-26 13:53:39,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-26 13:53:39,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-26 13:53:39,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-26 13:53:39,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-26 13:53:39,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-26 13:53:39,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-26 13:53:39,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-26 13:53:39,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-26 13:53:39,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-26 13:53:39,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-26 13:53:39,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-26 13:53:39,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-26 13:53:39,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-26 13:53:39,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-26 13:53:39,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-26 13:53:39,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-26 13:53:39,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-26 13:53:39,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-26 13:53:39,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-26 13:53:39,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-26 13:53:39,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-26 13:53:39,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-26 13:53:39,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-26 13:53:39,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-26 13:53:39,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-26 13:53:39,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-26 13:53:39,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-26 13:53:39,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-26 13:53:39,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-26 13:53:39,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-26 13:53:39,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-26 13:53:39,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-26 13:53:39,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-26 13:53:39,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-26 13:53:39,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-26 13:53:39,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-26 13:53:39,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-26 13:53:39,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-26 13:53:39,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-26 13:53:39,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-26 13:53:39,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-26 13:53:39,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-26 13:53:39,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-26 13:53:39,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-26 13:53:39,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-26 13:53:39,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-26 13:53:39,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-26 13:53:39,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-26 13:53:39,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-26 13:53:39,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-26 13:53:39,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-26 13:53:39,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-26 13:53:39,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-26 13:53:39,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-26 13:53:39,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-26 13:53:39,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-26 13:53:39,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-26 13:53:39,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-26 13:53:39,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-26 13:53:39,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-26 13:53:39,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-26 13:53:39,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-26 13:53:39,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-26 13:53:39,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-26 13:53:39,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-26 13:53:39,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-26 13:53:39,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-26 13:53:39,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-26 13:53:39,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-26 13:53:39,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-26 13:53:39,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-26 13:53:39,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-26 13:53:39,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-26 13:53:39,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-26 13:53:39,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-26 13:53:39,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-26 13:53:39,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-26 13:53:39,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-26 13:53:39,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-26 13:53:39,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-26 13:53:39,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-26 13:53:39,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-26 13:53:39,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-26 13:53:39,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-26 13:53:39,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-26 13:53:39,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-26 13:53:39,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-26 13:53:39,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-26 13:53:39,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-26 13:53:39,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-26 13:53:39,600 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006547761159855293); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008382012701302927); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006547761159855293); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.833333333333334E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0055); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-26 13:53:39,600 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-26 13:53:39,601 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.0010895810285163209, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006547761159855293); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008382012701302927); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006547761159855293); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.833333333333334E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0055); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-26 13:53:39,919 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 411 ms to try 5000 different iterations.  Found a solution that moves 286 regions; Going from a computed imbalance of 0.0010895810285163209 to a new imbalance of 4.4420283203062236E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0022222222222222222); MoveCostFunction : (multiplier=7.0, imbalance=0.03177777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-26 13:53:39,920 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1092935476:83 , srv166466387:83 , srv381003126:83 , srv44549632:83 , srv53697899:83 , srv1118342697:84 , srv1229599984:84 , srv1250038713:84 , srv148787741:84 , srv1681817901:84 , srv1684200202:84 , srv1731229664:84 , srv1873779792:84 , srv189541345:84 , srv1897308083:84 , srv1904799689:84 , srv1920501053:84 , srv1947180035:84 , srv1952524721:84 , srv1984666596:84 , srv1986056155:84 , srv2003872605:84 , srv2021463666:84 , srv203330888:84 , srv2133769150:84 , srv2134098687:84 , srv282397890:84 , srv289436130:84 , srv318491747:84 , srv347236050:84 , srv397646440:84 , srv456693869:84 , srv55292773:84 , srv565112944:84 , srv645570245:84 , srv670166713:84 , srv697987250:84 , srv701558900:84 , srv77299063:84 , srv784882918:84 , srv874063954:84 , srv982098047:84 , srv1031907734:85 , srv1032048348:85 , srv1086930197:85 , srv11841248:85 , srv1238594785:85 , srv127036973:85 , srv1284022244:85 , srv1293469839:85 , srv1372875680:85 , srv1426799471:85 , srv1445592076:85 , srv1480465330:85 , srv1507976678:85 , srv1510225822:85 , srv1516030225:85 , srv1520351095:85 , srv1571925531:85 , srv1620173112:85 , srv1747867572:85 , srv1754625283:85 , srv1757458757:85 , srv1786684658:85 , srv1845041993:85 , srv1886304773:85 , srv19268951:85 , srv1957275936:85 , srv2005309376:85 , srv2017807951:85 , srv2075120815:85 , srv2088398189:85 , srv2097982121:85 , srv224863032:85 , srv300301019:85 , srv302816475:85 , srv312932318:85 , srv42116262:85 , srv423245140:85 , srv45327616:85 , srv461362030:85 , srv481880331:85 , srv516570825:85 , srv621864002:85 , srv706716192:85 , srv74758775:85 , srv754521669:85 , srv809957047:85 , srv837547228:85 , srv887178315:85 , srv895015689:85 , srv923179139:85 , srv941695119:85 , srv146994906:86 , srv1527581409:86 , srv2051716443:86 , srv2067266235:86 , srv60201832:86 , srv689562217:86 , srv1835424521:626 }
2023-07-26 13:53:39,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-26 13:53:39,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1947180035=42, srv621864002=81, srv1897308083=38, srv1786684658=32, srv1092935476=3, srv941695119=98, srv74758775=88, srv689562217=84, srv923179139=97, srv1516030225=20, srv189541345=37, srv2005309376=48, srv1731229664=28, srv1747867572=29, srv701558900=86, srv2067266235=53, srv837547228=93, srv1445592076=14, srv706716192=87, srv44549632=71, srv1031907734=0, srv1520351095=21, srv2021463666=50, srv784882918=91, srv2051716443=52, srv1507976678=18, srv1426799471=13, srv2003872605=47, srv1754625283=30, srv874063954=94, srv645570245=82, srv1571925531=23, srv224863032=59, srv381003126=67, srv1873779792=35, srv1957275936=44, srv1118342697=4, srv347236050=66, srv2017807951=49, srv19268951=41, srv423245140=70, srv60201832=80, srv1284022244=10, srv2134098687=58, srv481880331=75, srv887178315=95, srv1086930197=2, srv1510225822=19, srv1986056155=46, srv516570825=76, srv2133769150=57, srv42116262=69, srv203330888=51, srv754521669=89, srv809957047=92, srv1757458757=31, srv461362030=74, srv302816475=63, srv45327616=72, srv1229599984=6, srv1293469839=11, srv1886304773=36, srv670166713=83, srv166466387=25, srv2075120815=54, srv289436130=61, srv1835424521=33, srv982098047=99, srv318491747=65, srv1032048348=1, srv53697899=77, srv1527581409=22, srv300301019=62, srv1845041993=34, srv1920501053=40, srv11841248=5, srv77299063=90, srv1238594785=7, srv1372875680=12, srv1952524721=43, srv895015689=96, srv127036973=9, srv1984666596=45, srv456693869=73, srv1480465330=16, srv1904799689=39, srv146994906=15, srv312932318=64, srv397646440=68, srv148787741=17, srv2088398189=55, srv1684200202=27, srv2097982121=56, srv282397890=60, srv697987250=85, srv55292773=78, srv1620173112=24, srv1250038713=8, srv1681817901=26, srv565112944=79} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-26 13:53:39,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-26 13:53:39,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-26 13:53:39,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-26 13:53:39,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-26 13:53:39,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-26 13:53:39,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-26 13:53:39,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-26 13:53:39,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-26 13:53:39,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-26 13:53:39,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-26 13:53:39,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-26 13:53:39,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-26 13:53:39,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-26 13:53:39,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-26 13:53:39,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-26 13:53:39,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-26 13:53:39,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-26 13:53:39,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-26 13:53:39,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-26 13:53:39,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-26 13:53:39,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-26 13:53:39,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-26 13:53:39,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-26 13:53:39,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-26 13:53:39,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-26 13:53:39,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-26 13:53:39,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-26 13:53:39,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-26 13:53:39,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-26 13:53:39,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-26 13:53:39,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-26 13:53:39,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-26 13:53:39,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-26 13:53:39,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-26 13:53:39,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-26 13:53:39,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-26 13:53:39,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-26 13:53:39,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-26 13:53:39,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-26 13:53:39,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-26 13:53:39,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-26 13:53:39,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-26 13:53:39,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-26 13:53:39,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-26 13:53:39,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-26 13:53:39,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-26 13:53:39,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-26 13:53:39,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-26 13:53:39,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-26 13:53:39,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-26 13:53:39,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-26 13:53:39,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-26 13:53:39,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-26 13:53:39,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-26 13:53:39,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-26 13:53:39,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-26 13:53:39,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-26 13:53:39,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-26 13:53:39,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-26 13:53:39,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-26 13:53:39,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-26 13:53:39,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-26 13:53:39,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-26 13:53:39,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-26 13:53:39,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-26 13:53:39,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-26 13:53:39,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-26 13:53:39,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-26 13:53:39,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-26 13:53:39,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-26 13:53:39,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-26 13:53:39,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-26 13:53:39,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-26 13:53:39,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-26 13:53:39,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-26 13:53:39,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-26 13:53:39,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-26 13:53:39,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-26 13:53:39,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-26 13:53:39,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-26 13:53:39,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-26 13:53:39,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-26 13:53:39,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-26 13:53:39,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-26 13:53:39,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-26 13:53:39,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-26 13:53:39,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-26 13:53:39,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-26 13:53:39,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-26 13:53:39,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-26 13:53:39,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-26 13:53:39,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-26 13:53:39,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-26 13:53:39,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-26 13:53:39,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-26 13:53:39,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-26 13:53:39,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-26 13:53:39,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-26 13:53:39,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-26 13:53:39,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-26 13:53:39,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-26 13:53:40,069 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0022222222222222222); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-26 13:53:40,070 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-26 13:53:40,070 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=4.241766840031779E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0022222222222222222); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-26 13:53:40,313 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 352 ms to try 5000 different iterations.  Found a solution that moves 30 regions; Going from a computed imbalance of 4.241766840031779E-5 to a new imbalance of 8.740712052824634E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.0033333333333333335); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-26 13:53:40,313 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1229599984:83 , srv146994906:83 , srv1480465330:83 , srv1527581409:83 , srv1731229664:83 , srv1786684658:83 , srv1886304773:83 , srv2051716443:83 , srv423245140:83 , srv689562217:83 , srv1031907734:84 , srv1032048348:84 , srv1086930197:84 , srv1092935476:84 , srv1118342697:84 , srv11841248:84 , srv1238594785:84 , srv1250038713:84 , srv127036973:84 , srv1284022244:84 , srv1293469839:84 , srv1372875680:84 , srv1426799471:84 , srv1445592076:84 , srv1507976678:84 , srv1510225822:84 , srv1516030225:84 , srv1520351095:84 , srv1571925531:84 , srv1620173112:84 , srv1681817901:84 , srv1684200202:84 , srv1747867572:84 , srv1754625283:84 , srv1757458757:84 , srv1845041993:84 , srv1873779792:84 , srv1897308083:84 , srv1904799689:84 , srv1920501053:84 , srv19268951:84 , srv1947180035:84 , srv1952524721:84 , srv1957275936:84 , srv1984666596:84 , srv1986056155:84 , srv2003872605:84 , srv2005309376:84 , srv2021463666:84 , srv203330888:84 , srv2067266235:84 , srv2075120815:84 , srv2088398189:84 , srv2097982121:84 , srv2134098687:84 , srv224863032:84 , srv282397890:84 , srv300301019:84 , srv302816475:84 , srv312932318:84 , srv347236050:84 , srv397646440:84 , srv42116262:84 , srv44549632:84 , srv45327616:84 , srv461362030:84 , srv481880331:84 , srv516570825:84 , srv53697899:84 , srv55292773:84 , srv565112944:84 , srv60201832:84 , srv621864002:84 , srv645570245:84 , srv670166713:84 , srv701558900:84 , srv706716192:84 , srv74758775:84 , srv754521669:84 , srv77299063:84 , srv784882918:84 , srv809957047:84 , srv837547228:84 , srv874063954:84 , srv887178315:84 , srv895015689:84 , srv923179139:84 , srv941695119:84 , srv982098047:84 , srv148787741:85 , srv166466387:85 , srv189541345:85 , srv2017807951:85 , srv2133769150:85 , srv289436130:85 , srv318491747:85 , srv381003126:85 , srv456693869:85 , srv697987250:85 , srv1835424521:684 }
2023-07-26 13:53:40,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-26 13:53:40,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1947180035=42, srv621864002=81, srv1897308083=38, srv1786684658=32, srv1092935476=3, srv941695119=98, srv74758775=88, srv689562217=84, srv923179139=97, srv1516030225=20, srv189541345=37, srv2005309376=48, srv1731229664=28, srv1747867572=29, srv701558900=86, srv2067266235=53, srv837547228=93, srv1445592076=14, srv706716192=87, srv44549632=71, srv1031907734=0, srv1520351095=21, srv2021463666=50, srv784882918=91, srv2051716443=52, srv1507976678=18, srv1426799471=13, srv2003872605=47, srv1754625283=30, srv874063954=94, srv645570245=82, srv1571925531=23, srv224863032=59, srv381003126=67, srv1873779792=35, srv1957275936=44, srv1118342697=4, srv347236050=66, srv2017807951=49, srv19268951=41, srv423245140=70, srv60201832=80, srv1284022244=10, srv2134098687=58, srv481880331=75, srv887178315=95, srv1086930197=2, srv1510225822=19, srv1986056155=46, srv516570825=76, srv2133769150=57, srv42116262=69, srv203330888=51, srv754521669=89, srv809957047=92, srv1757458757=31, srv461362030=74, srv302816475=63, srv45327616=72, srv1229599984=6, srv1293469839=11, srv1886304773=36, srv670166713=83, srv166466387=25, srv2075120815=54, srv289436130=61, srv1835424521=33, srv982098047=99, srv318491747=65, srv1032048348=1, srv53697899=77, srv1527581409=22, srv300301019=62, srv1845041993=34, srv1920501053=40, srv11841248=5, srv77299063=90, srv1238594785=7, srv1372875680=12, srv1952524721=43, srv895015689=96, srv127036973=9, srv1984666596=45, srv456693869=73, srv1480465330=16, srv1904799689=39, srv146994906=15, srv312932318=64, srv397646440=68, srv148787741=17, srv2088398189=55, srv1684200202=27, srv2097982121=56, srv282397890=60, srv697987250=85, srv55292773=78, srv1620173112=24, srv1250038713=8, srv1681817901=26, srv565112944=79} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-26 13:53:40,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-26 13:53:40,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-26 13:53:40,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-26 13:53:40,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-26 13:53:40,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-26 13:53:40,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-26 13:53:40,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-26 13:53:40,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-26 13:53:40,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-26 13:53:40,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-26 13:53:40,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-26 13:53:40,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-26 13:53:40,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-26 13:53:40,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-26 13:53:40,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-26 13:53:40,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-26 13:53:40,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-26 13:53:40,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-26 13:53:40,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-26 13:53:40,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-26 13:53:40,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-26 13:53:40,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-26 13:53:40,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-26 13:53:40,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-26 13:53:40,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-26 13:53:40,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-26 13:53:40,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-26 13:53:40,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-26 13:53:40,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-26 13:53:40,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-26 13:53:40,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-26 13:53:40,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-26 13:53:40,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-26 13:53:40,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-26 13:53:40,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-26 13:53:40,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-26 13:53:40,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-26 13:53:40,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-26 13:53:40,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-26 13:53:40,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-26 13:53:40,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-26 13:53:40,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-26 13:53:40,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-26 13:53:40,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-26 13:53:40,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-26 13:53:40,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-26 13:53:40,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-26 13:53:40,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-26 13:53:40,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-26 13:53:40,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-26 13:53:40,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-26 13:53:40,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-26 13:53:40,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-26 13:53:40,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-26 13:53:40,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-26 13:53:40,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-26 13:53:40,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-26 13:53:40,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-26 13:53:40,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-26 13:53:40,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-26 13:53:40,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-26 13:53:40,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-26 13:53:40,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-26 13:53:40,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-26 13:53:40,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-26 13:53:40,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-26 13:53:40,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-26 13:53:40,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-26 13:53:40,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-26 13:53:40,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-26 13:53:40,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-26 13:53:40,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-26 13:53:40,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-26 13:53:40,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-26 13:53:40,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-26 13:53:40,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-26 13:53:40,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-26 13:53:40,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-26 13:53:40,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-26 13:53:40,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-26 13:53:40,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-26 13:53:40,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-26 13:53:40,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-26 13:53:40,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-26 13:53:40,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-26 13:53:40,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-26 13:53:40,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-26 13:53:40,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-26 13:53:40,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-26 13:53:40,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-26 13:53:40,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-26 13:53:40,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-26 13:53:40,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-26 13:53:40,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-26 13:53:40,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-26 13:53:40,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-26 13:53:40,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-26 13:53:40,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-26 13:53:40,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-26 13:53:40,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-26 13:53:40,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-26 13:53:40,445 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=8.530647563026267E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-26 13:53:40,446 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1229599984:83 , srv146994906:83 , srv1480465330:83 , srv1527581409:83 , srv1731229664:83 , srv1786684658:83 , srv1886304773:83 , srv2051716443:83 , srv423245140:83 , srv689562217:83 , srv1031907734:84 , srv1032048348:84 , srv1086930197:84 , srv1092935476:84 , srv1118342697:84 , srv11841248:84 , srv1238594785:84 , srv1250038713:84 , srv127036973:84 , srv1284022244:84 , srv1293469839:84 , srv1372875680:84 , srv1426799471:84 , srv1445592076:84 , srv1507976678:84 , srv1510225822:84 , srv1516030225:84 , srv1520351095:84 , srv1571925531:84 , srv1620173112:84 , srv1681817901:84 , srv1684200202:84 , srv1747867572:84 , srv1754625283:84 , srv1757458757:84 , srv1845041993:84 , srv1873779792:84 , srv1897308083:84 , srv1904799689:84 , srv1920501053:84 , srv19268951:84 , srv1947180035:84 , srv1952524721:84 , srv1957275936:84 , srv1984666596:84 , srv1986056155:84 , srv2003872605:84 , srv2005309376:84 , srv2021463666:84 , srv203330888:84 , srv2067266235:84 , srv2075120815:84 , srv2088398189:84 , srv2097982121:84 , srv2134098687:84 , srv224863032:84 , srv282397890:84 , srv300301019:84 , srv302816475:84 , srv312932318:84 , srv347236050:84 , srv397646440:84 , srv42116262:84 , srv44549632:84 , srv45327616:84 , srv461362030:84 , srv481880331:84 , srv516570825:84 , srv53697899:84 , srv55292773:84 , srv565112944:84 , srv60201832:84 , srv621864002:84 , srv645570245:84 , srv670166713:84 , srv701558900:84 , srv706716192:84 , srv74758775:84 , srv754521669:84 , srv77299063:84 , srv784882918:84 , srv809957047:84 , srv837547228:84 , srv874063954:84 , srv887178315:84 , srv895015689:84 , srv923179139:84 , srv941695119:84 , srv982098047:84 , srv148787741:85 , srv166466387:85 , srv189541345:85 , srv2017807951:85 , srv2133769150:85 , srv289436130:85 , srv318491747:85 , srv381003126:85 , srv456693869:85 , srv697987250:85 , srv1835424521:684 }
2023-07-26 13:53:40,471 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=365 (was 354) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 171), AvailableMemoryMB=8043 (was 8843)
2023-07-26 13:53:40,482 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=365, ProcessCount=171, AvailableMemoryMB=8042
2023-07-26 13:53:40,482 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-07-26 13:53:40,483 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-07-26 13:53:40,495 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1012409327:84 , srv1066311279:84 , srv1091146286:84 , srv110514850:84 , srv1160866714:84 , srv1229941567:84 , srv12583602:84 , srv1362224515:84 , srv1444731103:84 , srv156905071:84 , srv1663069344:84 , srv1675804495:84 , srv1709269387:84 , srv1768336672:84 , srv1803295816:84 , srv1840064362:84 , srv1912512370:84 , srv1963596739:84 , srv262510270:84 , srv292524554:84 , srv342615304:84 , srv5230467:84 , srv618217450:84 , srv66405912:84 , srv700445660:84 , srv734156643:84 , srv753223171:84 , srv810943625:84 , srv82295189:84 , srv244633550:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-07-26 13:53:40,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-26 13:53:40,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1663069344=10, srv1444731103=8, srv1012409327=0, srv262510270=19, srv1709269387=12, srv1091146286=2, srv5230467=22, srv12583602=6, srv1362224515=7, srv156905071=9, srv1912512370=16, srv1840064362=15, srv734156643=26, srv1066311279=1, srv82295189=29, srv1229941567=5, srv1963596739=17, srv1160866714=4, srv1768336672=13, srv110514850=3, srv753223171=27, srv292524554=20, srv342615304=21, srv700445660=25, srv810943625=28, srv1675804495=11, srv1803295816=14, srv66405912=24, srv618217450=23, srv244633550=18} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-26 13:53:40,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-26 13:53:40,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-26 13:53:40,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-26 13:53:40,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-26 13:53:40,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-26 13:53:40,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-26 13:53:40,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-26 13:53:40,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-26 13:53:40,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-26 13:53:40,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-26 13:53:40,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-26 13:53:40,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-26 13:53:40,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-26 13:53:40,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-26 13:53:40,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-26 13:53:40,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-26 13:53:40,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-26 13:53:40,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-26 13:53:40,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-26 13:53:40,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-26 13:53:40,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-26 13:53:40,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-26 13:53:40,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-26 13:53:40,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-26 13:53:40,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-26 13:53:40,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-26 13:53:40,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-26 13:53:40,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-26 13:53:40,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-26 13:53:40,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-26 13:53:40,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-07-26 13:53:40,545 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0590176886914435, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-26 13:53:40,546 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912379006074242, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0590176886914435, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-07-26 13:55:40,524 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6873500 different iterations.  Found a solution that moves 1840 regions; Going from a computed imbalance of 0.9912379006074242 to a new imbalance of 4.2946517914333035E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6814814814814815, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-26 13:55:40,532 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1012409327:90 , srv1066311279:90 , srv1091146286:90 , srv110514850:90 , srv1160866714:90 , srv1229941567:90 , srv12583602:90 , srv1362224515:90 , srv1444731103:90 , srv156905071:90 , srv1663069344:90 , srv1675804495:90 , srv1709269387:90 , srv1768336672:90 , srv1803295816:90 , srv1840064362:90 , srv1912512370:90 , srv1963596739:90 , srv244633550:90 , srv262510270:90 , srv292524554:90 , srv342615304:90 , srv5230467:90 , srv618217450:90 , srv66405912:90 , srv700445660:90 , srv734156643:90 , srv753223171:90 , srv810943625:90 , srv82295189:90 }
2023-07-26 13:55:40,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-26 13:55:40,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1663069344=10, srv1444731103=8, srv1012409327=0, srv262510270=19, srv1709269387=12, srv1091146286=2, srv5230467=22, srv12583602=6, srv1362224515=7, srv156905071=9, srv1912512370=16, srv1840064362=15, srv734156643=26, srv1066311279=1, srv82295189=29, srv1229941567=5, srv1963596739=17, srv1160866714=4, srv1768336672=13, srv110514850=3, srv753223171=27, srv292524554=20, srv342615304=21, srv700445660=25, srv810943625=28, srv1675804495=11, srv1803295816=14, srv66405912=24, srv618217450=23, srv244633550=18} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-26 13:55:40,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-26 13:55:40,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-26 13:55:40,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-26 13:55:40,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-26 13:55:40,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-26 13:55:40,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-26 13:55:40,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-26 13:55:40,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-26 13:55:40,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-26 13:55:40,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-26 13:55:40,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-26 13:55:40,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-26 13:55:40,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-26 13:55:40,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-26 13:55:40,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-26 13:55:40,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-26 13:55:40,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-26 13:55:40,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-26 13:55:40,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-26 13:55:40,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-26 13:55:40,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-26 13:55:40,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-26 13:55:40,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-26 13:55:40,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-26 13:55:40,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-26 13:55:40,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-26 13:55:40,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-26 13:55:40,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-26 13:55:40,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-26 13:55:40,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-26 13:55:40,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-07-26 13:55:40,552 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-26 13:55:40,552 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1012409327:90 , srv1066311279:90 , srv1091146286:90 , srv110514850:90 , srv1160866714:90 , srv1229941567:90 , srv12583602:90 , srv1362224515:90 , srv1444731103:90 , srv156905071:90 , srv1663069344:90 , srv1675804495:90 , srv1709269387:90 , srv1768336672:90 , srv1803295816:90 , srv1840064362:90 , srv1912512370:90 , srv1963596739:90 , srv244633550:90 , srv262510270:90 , srv292524554:90 , srv342615304:90 , srv5230467:90 , srv618217450:90 , srv66405912:90 , srv700445660:90 , srv734156643:90 , srv753223171:90 , srv810943625:90 , srv82295189:90 }
2023-07-26 13:55:40,564 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=176 (was 365), ProcessCount=173 (was 171) - ProcessCount LEAK? -, AvailableMemoryMB=7919 (was 8042)