2023-07-23 14:53:12,240 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-07-23 14:53:12,555 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-07-23 14:53:12,673 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-07-23 14:53:12,735 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-07-23 14:53:12,745 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-07-23 14:53:12,762 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=282, ProcessCount=173, AvailableMemoryMB=10838
2023-07-23 14:53:12,764 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-07-23 14:53:12,765 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-07-23 14:53:12,922 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1042567978:84 , srv1071630122:84 , srv1076442604:84 , srv1082759896:84 , srv1108153955:84 , srv1135741029:84 , srv1138736855:84 , srv1155402105:84 , srv1173194486:84 , srv1185967095:84 , srv1209759173:84 , srv1230056049:84 , srv1241753817:84 , srv1256540745:84 , srv1294969672:84 , srv1314158137:84 , srv1318289148:84 , srv1325011671:84 , srv133996595:84 , srv1352229413:84 , srv1375504452:84 , srv1407682473:84 , srv1459169534:84 , srv1482323014:84 , srv1497463222:84 , srv1507041677:84 , srv1521284970:84 , srv1527595691:84 , srv1542769960:84 , srv1556510200:84 , srv1563499178:84 , srv1578371568:84 , srv1584225747:84 , srv1608330611:84 , srv1613950618:84 , srv1636343730:84 , srv165108349:84 , srv1663366251:84 , srv1679737602:84 , srv1710774942:84 , srv1713029032:84 , srv1715521467:84 , srv1751953526:84 , srv1814855180:84 , srv1824406586:84 , srv183840748:84 , srv1895023386:84 , srv1941917098:84 , srv196317077:84 , srv2013619355:84 , srv2018822643:84 , srv2021058146:84 , srv2025960968:84 , srv2037949325:84 , srv2071256193:84 , srv208916905:84 , srv2099416156:84 , srv2112778246:84 , srv2124486130:84 , srv2130502186:84 , srv2138823681:84 , srv226092889:84 , srv253111013:84 , srv259936005:84 , srv279161124:84 , srv303748749:84 , srv315987043:84 , srv360574848:84 , srv391168249:84 , srv40345972:84 , srv436327965:84 , srv492201607:84 , srv517039903:84 , srv521853588:84 , srv554615762:84 , srv558304212:84 , srv613324156:84 , srv627670463:84 , srv632111300:84 , srv634487831:84 , srv635490786:84 , srv639676643:84 , srv655040633:84 , srv661975555:84 , srv695119213:84 , srv739712143:84 , srv746367799:84 , srv796074085:84 , srv821949623:84 , srv85659128:84 , srv869780554:84 , srv878251620:84 , srv887710432:84 , srv904942934:84 , srv905215789:84 , srv932414994:84 , srv945862166:84 , srv956193623:84 , srv969562999:84 , srv155205408:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-07-23 14:53:12,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-23 14:53:12,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv627670463=78, srv303748749=66, srv1608330611=34, srv558304212=76, srv661975555=84, srv1751953526=43, srv635490786=81, srv226092889=62, srv1352229413=19, srv2025960968=53, srv632111300=79, srv739712143=86, srv1318289148=16, srv869780554=91, srv1185967095=9, srv1071630122=1, srv1895023386=47, srv492201607=72, srv155205408=29, srv40345972=70, srv521853588=74, srv1824406586=45, srv634487831=80, srv1138736855=6, srv1256540745=13, srv1241753817=12, srv1527595691=27, srv2037949325=54, srv196317077=49, srv2099416156=57, srv2112778246=58, srv904942934=94, srv1209759173=10, srv1076442604=2, srv360574848=68, srv1556510200=30, srv1941917098=48, srv253111013=63, srv517039903=73, srv821949623=89, srv133996595=18, srv1713029032=41, srv2124486130=59, srv1636343730=36, srv554615762=75, srv695119213=85, srv1082759896=3, srv2018822643=51, srv1173194486=8, srv1482323014=23, srv1294969672=14, srv932414994=96, srv1814855180=44, srv969562999=99, srv796074085=88, srv1521284970=26, srv746367799=87, srv878251620=92, srv1375504452=20, srv1563499178=31, srv183840748=46, srv279161124=65, srv1542769960=28, srv2130502186=60, srv315987043=67, srv1108153955=4, srv1578371568=32, srv655040633=83, srv613324156=77, srv1710774942=40, srv2021058146=52, srv1155402105=7, srv208916905=56, srv1663366251=38, srv85659128=90, srv1042567978=0, srv2138823681=61, srv1459169534=22, srv1507041677=25, srv956193623=98, srv887710432=93, srv639676643=82, srv1407682473=21, srv1613950618=35, srv391168249=69, srv1135741029=5, srv945862166=97, srv1497463222=24, srv165108349=37, srv1314158137=15, srv2071256193=55, srv1584225747=33, srv1715521467=42, srv259936005=64, srv436327965=71, srv1325011671=17, srv2013619355=50, srv905215789=95, srv1230056049=11, srv1679737602=39} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-23 14:53:13,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-23 14:53:13,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-23 14:53:13,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-23 14:53:13,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-23 14:53:13,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-23 14:53:13,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-23 14:53:13,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-23 14:53:13,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-23 14:53:13,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-23 14:53:13,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-23 14:53:13,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-23 14:53:13,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-23 14:53:13,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-23 14:53:13,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-23 14:53:13,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-23 14:53:13,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-23 14:53:13,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-23 14:53:13,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-23 14:53:13,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-23 14:53:13,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-23 14:53:13,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-23 14:53:13,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-23 14:53:13,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-23 14:53:13,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-23 14:53:13,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-23 14:53:13,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-23 14:53:13,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-23 14:53:13,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-23 14:53:13,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-23 14:53:13,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-23 14:53:13,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-23 14:53:13,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-23 14:53:13,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-23 14:53:13,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-23 14:53:13,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-23 14:53:13,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-23 14:53:13,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-23 14:53:13,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-23 14:53:13,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-23 14:53:13,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-23 14:53:13,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-23 14:53:13,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-23 14:53:13,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-23 14:53:13,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-23 14:53:13,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-23 14:53:13,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-23 14:53:13,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-23 14:53:13,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-23 14:53:13,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-23 14:53:13,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-23 14:53:13,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-23 14:53:13,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-23 14:53:13,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-23 14:53:13,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-23 14:53:13,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-23 14:53:13,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-23 14:53:13,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-23 14:53:13,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-23 14:53:13,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-23 14:53:13,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-23 14:53:13,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-23 14:53:13,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-23 14:53:13,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-23 14:53:13,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-23 14:53:13,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-23 14:53:13,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-23 14:53:13,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-23 14:53:13,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-23 14:53:13,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-23 14:53:13,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-23 14:53:13,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-23 14:53:13,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-23 14:53:13,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-23 14:53:13,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-23 14:53:13,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-23 14:53:13,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-23 14:53:13,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-23 14:53:13,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-23 14:53:13,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-23 14:53:13,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-23 14:53:13,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-23 14:53:13,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-23 14:53:13,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-23 14:53:13,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-23 14:53:13,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-23 14:53:13,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-23 14:53:13,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-23 14:53:13,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-23 14:53:13,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-23 14:53:13,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-23 14:53:13,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-23 14:53:13,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-23 14:53:13,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-23 14:53:13,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-23 14:53:13,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-23 14:53:13,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-23 14:53:13,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-23 14:53:13,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-23 14:53:13,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-23 14:53:13,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-23 14:53:13,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-23 14:53:13,275 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-23 14:53:13,276 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-23 14:53:13,276 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-23 14:53:14,165 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 1107 ms to try 5000 different iterations.  Found a solution that moves 4667 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.1810673295222792. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03859775584737308, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.056272146157944784, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5185555555555555, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03859775584737308, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.176, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.246, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-23 14:53:14,181 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1108153955:81 , srv226092889:82 , srv259936005:82 , srv1527595691:83 , srv1613950618:83 , srv2130502186:83 , srv40345972:83 , srv634487831:83 , srv635490786:83 , srv739712143:83 , srv878251620:83 , srv969562999:83 , srv1185967095:84 , srv1230056049:84 , srv1314158137:84 , srv1459169534:84 , srv1556510200:84 , srv1713029032:84 , srv1715521467:84 , srv2025960968:84 , srv253111013:84 , srv360574848:84 , srv521853588:84 , srv1082759896:85 , srv1636343730:85 , srv1941917098:85 , srv2013619355:85 , srv2018822643:85 , srv661975555:85 , srv796074085:85 , srv887710432:85 , srv905215789:85 , srv956193623:85 , srv1071630122:86 , srv1173194486:86 , srv1318289148:86 , srv1482323014:86 , srv1521284970:86 , srv1608330611:86 , srv1663366251:86 , srv1710774942:86 , srv183840748:86 , srv2021058146:86 , srv208916905:86 , srv2124486130:86 , srv303748749:86 , srv517039903:86 , srv632111300:86 , srv639676643:86 , srv655040633:86 , srv695119213:86 , srv85659128:86 , srv932414994:86 , srv1497463222:87 , srv1542769960:87 , srv1751953526:87 , srv2071256193:87 , srv554615762:87 , srv746367799:87 , srv904942934:87 , srv1138736855:88 , srv1209759173:88 , srv1241753817:88 , srv1256540745:88 , srv133996595:88 , srv1407682473:88 , srv1507041677:88 , srv1578371568:88 , srv1584225747:88 , srv165108349:88 , srv1679737602:88 , srv1814855180:88 , srv1895023386:88 , srv196317077:88 , srv2112778246:88 , srv558304212:88 , srv627670463:88 , srv821949623:88 , srv869780554:88 , srv945862166:88 , srv1042567978:89 , srv1135741029:89 , srv1155402105:89 , srv1375504452:89 , srv1563499178:89 , srv2099416156:89 , srv2138823681:89 , srv315987043:89 , srv436327965:89 , srv492201607:89 , srv613324156:89 , srv1325011671:90 , srv1352229413:90 , srv2037949325:90 , srv391168249:90 , srv1076442604:92 , srv1294969672:93 , srv279161124:93 , srv1824406586:95 , srv155205408:433 }
2023-07-23 14:53:14,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-23 14:53:14,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv627670463=78, srv303748749=66, srv1608330611=34, srv558304212=76, srv661975555=84, srv1751953526=43, srv635490786=81, srv226092889=62, srv1352229413=19, srv2025960968=53, srv632111300=79, srv739712143=86, srv1318289148=16, srv869780554=91, srv1185967095=9, srv1071630122=1, srv1895023386=47, srv492201607=72, srv155205408=29, srv40345972=70, srv521853588=74, srv1824406586=45, srv634487831=80, srv1138736855=6, srv1256540745=13, srv1241753817=12, srv1527595691=27, srv2037949325=54, srv196317077=49, srv2099416156=57, srv2112778246=58, srv904942934=94, srv1209759173=10, srv1076442604=2, srv360574848=68, srv1556510200=30, srv1941917098=48, srv253111013=63, srv517039903=73, srv821949623=89, srv133996595=18, srv1713029032=41, srv2124486130=59, srv1636343730=36, srv554615762=75, srv695119213=85, srv1082759896=3, srv2018822643=51, srv1173194486=8, srv1482323014=23, srv1294969672=14, srv932414994=96, srv1814855180=44, srv969562999=99, srv796074085=88, srv1521284970=26, srv746367799=87, srv878251620=92, srv1375504452=20, srv1563499178=31, srv183840748=46, srv279161124=65, srv1542769960=28, srv2130502186=60, srv315987043=67, srv1108153955=4, srv1578371568=32, srv655040633=83, srv613324156=77, srv1710774942=40, srv2021058146=52, srv1155402105=7, srv208916905=56, srv1663366251=38, srv85659128=90, srv1042567978=0, srv2138823681=61, srv1459169534=22, srv1507041677=25, srv956193623=98, srv887710432=93, srv639676643=82, srv1407682473=21, srv1613950618=35, srv391168249=69, srv1135741029=5, srv945862166=97, srv1497463222=24, srv165108349=37, srv1314158137=15, srv2071256193=55, srv1584225747=33, srv1715521467=42, srv259936005=64, srv436327965=71, srv1325011671=17, srv2013619355=50, srv905215789=95, srv1230056049=11, srv1679737602=39} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-23 14:53:14,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-23 14:53:14,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-23 14:53:14,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-23 14:53:14,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-23 14:53:14,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-23 14:53:14,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-23 14:53:14,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-23 14:53:14,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-23 14:53:14,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-23 14:53:14,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-23 14:53:14,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-23 14:53:14,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-23 14:53:14,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-23 14:53:14,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-23 14:53:14,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-23 14:53:14,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-23 14:53:14,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-23 14:53:14,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-23 14:53:14,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-23 14:53:14,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-23 14:53:14,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-23 14:53:14,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-23 14:53:14,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-23 14:53:14,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-23 14:53:14,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-23 14:53:14,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-23 14:53:14,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-23 14:53:14,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-23 14:53:14,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-23 14:53:14,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-23 14:53:14,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-23 14:53:14,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-23 14:53:14,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-23 14:53:14,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-23 14:53:14,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-23 14:53:14,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-23 14:53:14,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-23 14:53:14,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-23 14:53:14,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-23 14:53:14,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-23 14:53:14,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-23 14:53:14,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-23 14:53:14,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-23 14:53:14,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-23 14:53:14,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-23 14:53:14,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-23 14:53:14,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-23 14:53:14,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-23 14:53:14,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-23 14:53:14,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-23 14:53:14,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-23 14:53:14,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-23 14:53:14,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-23 14:53:14,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-23 14:53:14,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-23 14:53:14,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-23 14:53:14,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-23 14:53:14,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-23 14:53:14,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-23 14:53:14,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-23 14:53:14,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-23 14:53:14,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-23 14:53:14,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-23 14:53:14,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-23 14:53:14,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-23 14:53:14,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-23 14:53:14,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-23 14:53:14,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-23 14:53:14,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-23 14:53:14,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-23 14:53:14,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-23 14:53:14,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-23 14:53:14,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-23 14:53:14,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-23 14:53:14,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-23 14:53:14,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-23 14:53:14,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-23 14:53:14,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-23 14:53:14,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-23 14:53:14,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-23 14:53:14,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-23 14:53:14,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-23 14:53:14,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-23 14:53:14,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-23 14:53:14,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-23 14:53:14,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-23 14:53:14,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-23 14:53:14,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-23 14:53:14,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-23 14:53:14,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-23 14:53:14,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-23 14:53:14,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-23 14:53:14,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-23 14:53:14,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-23 14:53:14,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-23 14:53:14,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-23 14:53:14,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-23 14:53:14,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-23 14:53:14,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-23 14:53:14,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-23 14:53:14,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-23 14:53:14,407 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03859775584737308, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.056272146157944784, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03859775584737308, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.176, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.246, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-23 14:53:14,408 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-23 14:53:14,408 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.1810346504898162, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03859775584737308, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.056272146157944784, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03859775584737308, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.176, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.246, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-23 14:53:14,763 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 502 ms to try 5000 different iterations.  Found a solution that moves 2639 regions; Going from a computed imbalance of 0.1810346504898162 to a new imbalance of 0.015683291265592172. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021599582469072384); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.035222556796677525, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2932222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021599582469072384); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01275); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043583333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-23 14:53:14,777 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1824406586:76 , srv1294969672:80 , srv279161124:80 , srv1076442604:81 , srv1563499178:81 , srv1135741029:82 , srv1209759173:82 , srv1325011671:82 , srv133996595:82 , srv1352229413:82 , srv1375504452:82 , srv2112778246:82 , srv315987043:82 , srv613324156:82 , srv1042567978:83 , srv1138736855:83 , srv1407682473:83 , srv1578371568:83 , srv1584225747:83 , srv1895023386:83 , srv2071256193:83 , srv2138823681:83 , srv391168249:83 , srv821949623:83 , srv869780554:83 , srv945862166:83 , srv1155402105:84 , srv1497463222:84 , srv1507041677:84 , srv196317077:84 , srv2037949325:84 , srv2099416156:84 , srv492201607:84 , srv558304212:84 , srv1173194486:85 , srv1482323014:85 , srv1636343730:85 , srv165108349:85 , srv1710774942:85 , srv1814855180:85 , srv183840748:85 , srv2124486130:85 , srv436327965:85 , srv554615762:85 , srv627670463:85 , srv632111300:85 , srv655040633:85 , srv746367799:85 , srv1071630122:86 , srv1241753817:86 , srv1256540745:86 , srv1318289148:86 , srv1542769960:86 , srv1663366251:86 , srv1751953526:86 , srv1941917098:86 , srv2018822643:86 , srv303748749:86 , srv517039903:86 , srv639676643:86 , srv661975555:86 , srv695119213:86 , srv887710432:86 , srv904942934:86 , srv1185967095:87 , srv1521284970:87 , srv1527595691:87 , srv1613950618:87 , srv1679737602:87 , srv1713029032:87 , srv2013619355:87 , srv2025960968:87 , srv208916905:87 , srv521853588:87 , srv796074085:87 , srv85659128:87 , srv932414994:87 , srv956193623:87 , srv1314158137:88 , srv1608330611:88 , srv253111013:88 , srv259936005:88 , srv635490786:88 , srv905215789:88 , srv1230056049:89 , srv1715521467:89 , srv40345972:89 , srv634487831:89 , srv878251620:89 , srv969562999:89 , srv1082759896:90 , srv1459169534:90 , srv1556510200:90 , srv2021058146:90 , srv360574848:90 , srv1108153955:91 , srv2130502186:91 , srv739712143:91 , srv226092889:94 , srv155205408:533 }
2023-07-23 14:53:14,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-23 14:53:14,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv627670463=78, srv303748749=66, srv1608330611=34, srv558304212=76, srv661975555=84, srv1751953526=43, srv635490786=81, srv226092889=62, srv1352229413=19, srv2025960968=53, srv632111300=79, srv739712143=86, srv1318289148=16, srv869780554=91, srv1185967095=9, srv1071630122=1, srv1895023386=47, srv492201607=72, srv155205408=29, srv40345972=70, srv521853588=74, srv1824406586=45, srv634487831=80, srv1138736855=6, srv1256540745=13, srv1241753817=12, srv1527595691=27, srv2037949325=54, srv196317077=49, srv2099416156=57, srv2112778246=58, srv904942934=94, srv1209759173=10, srv1076442604=2, srv360574848=68, srv1556510200=30, srv1941917098=48, srv253111013=63, srv517039903=73, srv821949623=89, srv133996595=18, srv1713029032=41, srv2124486130=59, srv1636343730=36, srv554615762=75, srv695119213=85, srv1082759896=3, srv2018822643=51, srv1173194486=8, srv1482323014=23, srv1294969672=14, srv932414994=96, srv1814855180=44, srv969562999=99, srv796074085=88, srv1521284970=26, srv746367799=87, srv878251620=92, srv1375504452=20, srv1563499178=31, srv183840748=46, srv279161124=65, srv1542769960=28, srv2130502186=60, srv315987043=67, srv1108153955=4, srv1578371568=32, srv655040633=83, srv613324156=77, srv1710774942=40, srv2021058146=52, srv1155402105=7, srv208916905=56, srv1663366251=38, srv85659128=90, srv1042567978=0, srv2138823681=61, srv1459169534=22, srv1507041677=25, srv956193623=98, srv887710432=93, srv639676643=82, srv1407682473=21, srv1613950618=35, srv391168249=69, srv1135741029=5, srv945862166=97, srv1497463222=24, srv165108349=37, srv1314158137=15, srv2071256193=55, srv1584225747=33, srv1715521467=42, srv259936005=64, srv436327965=71, srv1325011671=17, srv2013619355=50, srv905215789=95, srv1230056049=11, srv1679737602=39} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-23 14:53:14,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-23 14:53:14,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-23 14:53:14,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-23 14:53:14,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-23 14:53:14,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-23 14:53:14,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-23 14:53:14,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-23 14:53:14,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-23 14:53:14,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-23 14:53:14,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-23 14:53:14,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-23 14:53:14,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-23 14:53:14,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-23 14:53:14,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-23 14:53:14,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-23 14:53:14,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-23 14:53:14,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-23 14:53:14,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-23 14:53:14,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-23 14:53:14,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-23 14:53:14,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-23 14:53:14,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-23 14:53:14,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-23 14:53:14,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-23 14:53:14,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-23 14:53:14,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-23 14:53:14,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-23 14:53:14,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-23 14:53:14,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-23 14:53:14,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-23 14:53:14,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-23 14:53:14,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-23 14:53:14,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-23 14:53:14,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-23 14:53:14,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-23 14:53:14,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-23 14:53:14,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-23 14:53:14,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-23 14:53:14,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-23 14:53:14,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-23 14:53:14,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-23 14:53:14,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-23 14:53:14,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-23 14:53:14,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-23 14:53:14,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-23 14:53:14,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-23 14:53:14,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-23 14:53:14,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-23 14:53:14,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-23 14:53:14,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-23 14:53:14,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-23 14:53:14,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-23 14:53:14,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-23 14:53:14,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-23 14:53:14,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-23 14:53:14,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-23 14:53:14,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-23 14:53:14,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-23 14:53:14,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-23 14:53:14,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-23 14:53:14,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-23 14:53:14,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-23 14:53:14,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-23 14:53:14,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-23 14:53:14,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-23 14:53:14,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-23 14:53:14,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-23 14:53:14,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-23 14:53:14,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-23 14:53:14,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-23 14:53:14,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-23 14:53:14,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-23 14:53:14,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-23 14:53:14,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-23 14:53:14,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-23 14:53:14,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-23 14:53:14,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-23 14:53:14,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-23 14:53:14,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-23 14:53:14,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-23 14:53:14,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-23 14:53:14,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-23 14:53:14,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-23 14:53:14,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-23 14:53:14,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-23 14:53:14,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-23 14:53:14,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-23 14:53:14,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-23 14:53:14,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-23 14:53:14,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-23 14:53:14,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-23 14:53:14,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-23 14:53:14,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-23 14:53:14,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-23 14:53:14,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-23 14:53:14,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-23 14:53:14,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-23 14:53:14,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-23 14:53:14,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-23 14:53:14,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-23 14:53:14,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-23 14:53:14,936 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021599582469072384); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.035222556796677525, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021599582469072384); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01275); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043583333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-23 14:53:14,936 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-23 14:53:14,936 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.015664812592639573, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021599582469072384); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.035222556796677525, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021599582469072384); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01275); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043583333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-23 14:53:15,237 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 402 ms to try 5000 different iterations.  Found a solution that moves 967 regions; Going from a computed imbalance of 0.015664812592639573 to a new imbalance of 5.361641964812822E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006661052630583241); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008812805701489793); MoveCostFunction : (multiplier=7.0, imbalance=0.10744444444444444, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006661052630583241); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003416666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-23 14:53:15,240 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1679737602:82 , srv2021058146:82 , srv226092889:82 , srv1082759896:83 , srv1241753817:83 , srv1256540745:83 , srv1459169534:83 , srv165108349:83 , srv1814855180:83 , srv2130502186:83 , srv739712143:83 , srv1155402105:84 , srv1230056049:84 , srv1294969672:84 , srv1318289148:84 , srv1521284970:84 , srv1556510200:84 , srv1608330611:84 , srv1751953526:84 , srv196317077:84 , srv2037949325:84 , srv279161124:84 , srv360574848:84 , srv391168249:84 , srv436327965:84 , srv627670463:84 , srv85659128:84 , srv1071630122:85 , srv1108153955:85 , srv1325011671:85 , srv1507041677:85 , srv1542769960:85 , srv1663366251:85 , srv1715521467:85 , srv2013619355:85 , srv208916905:85 , srv2099416156:85 , srv2138823681:85 , srv303748749:85 , srv40345972:85 , srv492201607:85 , srv517039903:85 , srv639676643:85 , srv695119213:85 , srv878251620:85 , srv904942934:85 , srv905215789:85 , srv932414994:85 , srv969562999:85 , srv1042567978:86 , srv1076442604:86 , srv1135741029:86 , srv1138736855:86 , srv1185967095:86 , srv1314158137:86 , srv133996595:86 , srv1352229413:86 , srv1375504452:86 , srv1407682473:86 , srv1482323014:86 , srv1497463222:86 , srv1584225747:86 , srv1710774942:86 , srv1824406586:86 , srv1895023386:86 , srv2018822643:86 , srv2025960968:86 , srv2124486130:86 , srv253111013:86 , srv315987043:86 , srv521853588:86 , srv554615762:86 , srv558304212:86 , srv634487831:86 , srv635490786:86 , srv661975555:86 , srv821949623:86 , srv887710432:86 , srv956193623:86 , srv1173194486:87 , srv1563499178:87 , srv1578371568:87 , srv1613950618:87 , srv1636343730:87 , srv1713029032:87 , srv183840748:87 , srv1941917098:87 , srv259936005:87 , srv613324156:87 , srv632111300:87 , srv655040633:87 , srv746367799:87 , srv796074085:87 , srv945862166:87 , srv1209759173:88 , srv1527595691:88 , srv2071256193:88 , srv2112778246:88 , srv869780554:88 , srv155205408:551 }
2023-07-23 14:53:15,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-23 14:53:15,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv627670463=78, srv303748749=66, srv1608330611=34, srv558304212=76, srv661975555=84, srv1751953526=43, srv635490786=81, srv226092889=62, srv1352229413=19, srv2025960968=53, srv632111300=79, srv739712143=86, srv1318289148=16, srv869780554=91, srv1185967095=9, srv1071630122=1, srv1895023386=47, srv492201607=72, srv155205408=29, srv40345972=70, srv521853588=74, srv1824406586=45, srv634487831=80, srv1138736855=6, srv1256540745=13, srv1241753817=12, srv1527595691=27, srv2037949325=54, srv196317077=49, srv2099416156=57, srv2112778246=58, srv904942934=94, srv1209759173=10, srv1076442604=2, srv360574848=68, srv1556510200=30, srv1941917098=48, srv253111013=63, srv517039903=73, srv821949623=89, srv133996595=18, srv1713029032=41, srv2124486130=59, srv1636343730=36, srv554615762=75, srv695119213=85, srv1082759896=3, srv2018822643=51, srv1173194486=8, srv1482323014=23, srv1294969672=14, srv932414994=96, srv1814855180=44, srv969562999=99, srv796074085=88, srv1521284970=26, srv746367799=87, srv878251620=92, srv1375504452=20, srv1563499178=31, srv183840748=46, srv279161124=65, srv1542769960=28, srv2130502186=60, srv315987043=67, srv1108153955=4, srv1578371568=32, srv655040633=83, srv613324156=77, srv1710774942=40, srv2021058146=52, srv1155402105=7, srv208916905=56, srv1663366251=38, srv85659128=90, srv1042567978=0, srv2138823681=61, srv1459169534=22, srv1507041677=25, srv956193623=98, srv887710432=93, srv639676643=82, srv1407682473=21, srv1613950618=35, srv391168249=69, srv1135741029=5, srv945862166=97, srv1497463222=24, srv165108349=37, srv1314158137=15, srv2071256193=55, srv1584225747=33, srv1715521467=42, srv259936005=64, srv436327965=71, srv1325011671=17, srv2013619355=50, srv905215789=95, srv1230056049=11, srv1679737602=39} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-23 14:53:15,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-23 14:53:15,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-23 14:53:15,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-23 14:53:15,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-23 14:53:15,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-23 14:53:15,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-23 14:53:15,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-23 14:53:15,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-23 14:53:15,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-23 14:53:15,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-23 14:53:15,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-23 14:53:15,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-23 14:53:15,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-23 14:53:15,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-23 14:53:15,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-23 14:53:15,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-23 14:53:15,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-23 14:53:15,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-23 14:53:15,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-23 14:53:15,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-23 14:53:15,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-23 14:53:15,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-23 14:53:15,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-23 14:53:15,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-23 14:53:15,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-23 14:53:15,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-23 14:53:15,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-23 14:53:15,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-23 14:53:15,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-23 14:53:15,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-23 14:53:15,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-23 14:53:15,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-23 14:53:15,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-23 14:53:15,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-23 14:53:15,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-23 14:53:15,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-23 14:53:15,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-23 14:53:15,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-23 14:53:15,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-23 14:53:15,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-23 14:53:15,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-23 14:53:15,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-23 14:53:15,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-23 14:53:15,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-23 14:53:15,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-23 14:53:15,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-23 14:53:15,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-23 14:53:15,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-23 14:53:15,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-23 14:53:15,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-23 14:53:15,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-23 14:53:15,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-23 14:53:15,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-23 14:53:15,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-23 14:53:15,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-23 14:53:15,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-23 14:53:15,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-23 14:53:15,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-23 14:53:15,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-23 14:53:15,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-23 14:53:15,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-23 14:53:15,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-23 14:53:15,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-23 14:53:15,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-23 14:53:15,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-23 14:53:15,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-23 14:53:15,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-23 14:53:15,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-23 14:53:15,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-23 14:53:15,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-23 14:53:15,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-23 14:53:15,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-23 14:53:15,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-23 14:53:15,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-23 14:53:15,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-23 14:53:15,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-23 14:53:15,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-23 14:53:15,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-23 14:53:15,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-23 14:53:15,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-23 14:53:15,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-23 14:53:15,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-23 14:53:15,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-23 14:53:15,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-23 14:53:15,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-23 14:53:15,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-23 14:53:15,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-23 14:53:15,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-23 14:53:15,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-23 14:53:15,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-23 14:53:15,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-23 14:53:15,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-23 14:53:15,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-23 14:53:15,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-23 14:53:15,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-23 14:53:15,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-23 14:53:15,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-23 14:53:15,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-23 14:53:15,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-23 14:53:15,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-23 14:53:15,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-23 14:53:15,422 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006661052630583241); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008812805701489793); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006661052630583241); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003416666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-23 14:53:15,422 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-23 14:53:15,422 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=5.293931177601148E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006661052630583241); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008812805701489793); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006661052630583241); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003416666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-23 14:53:15,847 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 561 ms to try 5000 different iterations.  Found a solution that moves 255 regions; Going from a computed imbalance of 5.293931177601148E-4 to a new imbalance of 3.510505357067564E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.028333333333333332, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-23 14:53:15,848 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1076442604:83 , srv1527595691:83 , srv634487831:83 , srv746367799:83 , srv796074085:83 , srv1042567978:84 , srv1082759896:84 , srv1173194486:84 , srv1209759173:84 , srv1314158137:84 , srv1352229413:84 , srv1497463222:84 , srv1542769960:84 , srv1556510200:84 , srv1578371568:84 , srv1584225747:84 , srv1608330611:84 , srv1713029032:84 , srv1715521467:84 , srv183840748:84 , srv1941917098:84 , srv2021058146:84 , srv2037949325:84 , srv2071256193:84 , srv2099416156:84 , srv2112778246:84 , srv226092889:84 , srv253111013:84 , srv315987043:84 , srv360574848:84 , srv492201607:84 , srv554615762:84 , srv558304212:84 , srv613324156:84 , srv632111300:84 , srv655040633:84 , srv695119213:84 , srv821949623:84 , srv869780554:84 , srv932414994:84 , srv945862166:84 , srv956193623:84 , srv1071630122:85 , srv1108153955:85 , srv1135741029:85 , srv1138736855:85 , srv1155402105:85 , srv1185967095:85 , srv1230056049:85 , srv1241753817:85 , srv1256540745:85 , srv1294969672:85 , srv1325011671:85 , srv133996595:85 , srv1375504452:85 , srv1407682473:85 , srv1459169534:85 , srv1507041677:85 , srv1521284970:85 , srv1563499178:85 , srv1613950618:85 , srv165108349:85 , srv1663366251:85 , srv1679737602:85 , srv1710774942:85 , srv1751953526:85 , srv1824406586:85 , srv1895023386:85 , srv2013619355:85 , srv2018822643:85 , srv2025960968:85 , srv208916905:85 , srv2124486130:85 , srv2130502186:85 , srv2138823681:85 , srv259936005:85 , srv279161124:85 , srv303748749:85 , srv391168249:85 , srv40345972:85 , srv436327965:85 , srv517039903:85 , srv521853588:85 , srv627670463:85 , srv635490786:85 , srv639676643:85 , srv661975555:85 , srv739712143:85 , srv85659128:85 , srv887710432:85 , srv904942934:85 , srv905215789:85 , srv1318289148:86 , srv1482323014:86 , srv1636343730:86 , srv1814855180:86 , srv196317077:86 , srv878251620:86 , srv969562999:86 , srv155205408:625 }
2023-07-23 14:53:15,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-23 14:53:15,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv627670463=78, srv303748749=66, srv1608330611=34, srv558304212=76, srv661975555=84, srv1751953526=43, srv635490786=81, srv226092889=62, srv1352229413=19, srv2025960968=53, srv632111300=79, srv739712143=86, srv1318289148=16, srv869780554=91, srv1185967095=9, srv1071630122=1, srv1895023386=47, srv492201607=72, srv155205408=29, srv40345972=70, srv521853588=74, srv1824406586=45, srv634487831=80, srv1138736855=6, srv1256540745=13, srv1241753817=12, srv1527595691=27, srv2037949325=54, srv196317077=49, srv2099416156=57, srv2112778246=58, srv904942934=94, srv1209759173=10, srv1076442604=2, srv360574848=68, srv1556510200=30, srv1941917098=48, srv253111013=63, srv517039903=73, srv821949623=89, srv133996595=18, srv1713029032=41, srv2124486130=59, srv1636343730=36, srv554615762=75, srv695119213=85, srv1082759896=3, srv2018822643=51, srv1173194486=8, srv1482323014=23, srv1294969672=14, srv932414994=96, srv1814855180=44, srv969562999=99, srv796074085=88, srv1521284970=26, srv746367799=87, srv878251620=92, srv1375504452=20, srv1563499178=31, srv183840748=46, srv279161124=65, srv1542769960=28, srv2130502186=60, srv315987043=67, srv1108153955=4, srv1578371568=32, srv655040633=83, srv613324156=77, srv1710774942=40, srv2021058146=52, srv1155402105=7, srv208916905=56, srv1663366251=38, srv85659128=90, srv1042567978=0, srv2138823681=61, srv1459169534=22, srv1507041677=25, srv956193623=98, srv887710432=93, srv639676643=82, srv1407682473=21, srv1613950618=35, srv391168249=69, srv1135741029=5, srv945862166=97, srv1497463222=24, srv165108349=37, srv1314158137=15, srv2071256193=55, srv1584225747=33, srv1715521467=42, srv259936005=64, srv436327965=71, srv1325011671=17, srv2013619355=50, srv905215789=95, srv1230056049=11, srv1679737602=39} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-23 14:53:15,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-23 14:53:15,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-23 14:53:15,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-23 14:53:15,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-23 14:53:15,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-23 14:53:15,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-23 14:53:15,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-23 14:53:15,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-23 14:53:15,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-23 14:53:15,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-23 14:53:15,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-23 14:53:15,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-23 14:53:15,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-23 14:53:15,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-23 14:53:15,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-23 14:53:15,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-23 14:53:15,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-23 14:53:15,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-23 14:53:15,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-23 14:53:15,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-23 14:53:15,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-23 14:53:15,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-23 14:53:15,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-23 14:53:15,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-23 14:53:15,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-23 14:53:15,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-23 14:53:15,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-23 14:53:15,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-23 14:53:15,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-23 14:53:15,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-23 14:53:15,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-23 14:53:15,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-23 14:53:15,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-23 14:53:15,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-23 14:53:15,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-23 14:53:15,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-23 14:53:15,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-23 14:53:15,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-23 14:53:15,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-23 14:53:15,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-23 14:53:15,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-23 14:53:15,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-23 14:53:15,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-23 14:53:15,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-23 14:53:15,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-23 14:53:15,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-23 14:53:15,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-23 14:53:15,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-23 14:53:15,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-23 14:53:15,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-23 14:53:15,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-23 14:53:15,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-23 14:53:15,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-23 14:53:15,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-23 14:53:15,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-23 14:53:15,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-23 14:53:15,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-23 14:53:15,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-23 14:53:15,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-23 14:53:15,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-23 14:53:15,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-23 14:53:15,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-23 14:53:15,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-23 14:53:15,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-23 14:53:15,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-23 14:53:15,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-23 14:53:15,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-23 14:53:15,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-23 14:53:15,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-23 14:53:15,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-23 14:53:15,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-23 14:53:15,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-23 14:53:15,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-23 14:53:15,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-23 14:53:15,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-23 14:53:15,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-23 14:53:15,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-23 14:53:15,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-23 14:53:15,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-23 14:53:15,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-23 14:53:15,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-23 14:53:15,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-23 14:53:15,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-23 14:53:15,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-23 14:53:15,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-23 14:53:15,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-23 14:53:15,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-23 14:53:15,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-23 14:53:15,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-23 14:53:15,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-23 14:53:15,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-23 14:53:15,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-23 14:53:15,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-23 14:53:15,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-23 14:53:15,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-23 14:53:15,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-23 14:53:15,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-23 14:53:15,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-23 14:53:15,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-23 14:53:15,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-23 14:53:15,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-23 14:53:15,990 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-23 14:53:15,991 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-23 14:53:15,991 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=3.3319505407389514E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-23 14:53:16,266 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 382 ms to try 5000 different iterations.  Found a solution that moves 32 regions; Going from a computed imbalance of 3.3319505407389514E-5 to a new imbalance of 6.6220544613879576E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014213381090374027); MoveCostFunction : (multiplier=7.0, imbalance=0.0035555555555555557); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-23 14:53:16,267 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1482323014:83 , srv1636343730:83 , srv208916905:83 , srv436327965:83 , srv869780554:83 , srv878251620:83 , srv904942934:83 , srv905215789:83 , srv969562999:83 , srv1042567978:84 , srv1071630122:84 , srv1076442604:84 , srv1082759896:84 , srv1108153955:84 , srv1135741029:84 , srv1138736855:84 , srv1155402105:84 , srv1173194486:84 , srv1185967095:84 , srv1209759173:84 , srv1230056049:84 , srv1241753817:84 , srv1256540745:84 , srv1294969672:84 , srv1314158137:84 , srv1318289148:84 , srv1325011671:84 , srv1352229413:84 , srv1375504452:84 , srv1407682473:84 , srv1459169534:84 , srv1507041677:84 , srv1521284970:84 , srv1542769960:84 , srv1556510200:84 , srv1563499178:84 , srv1578371568:84 , srv1608330611:84 , srv1613950618:84 , srv1663366251:84 , srv1679737602:84 , srv1710774942:84 , srv1713029032:84 , srv1715521467:84 , srv1751953526:84 , srv1814855180:84 , srv1824406586:84 , srv183840748:84 , srv1895023386:84 , srv1941917098:84 , srv196317077:84 , srv2013619355:84 , srv2018822643:84 , srv2021058146:84 , srv2025960968:84 , srv2037949325:84 , srv2071256193:84 , srv2099416156:84 , srv2112778246:84 , srv2124486130:84 , srv2130502186:84 , srv2138823681:84 , srv226092889:84 , srv253111013:84 , srv259936005:84 , srv279161124:84 , srv303748749:84 , srv360574848:84 , srv391168249:84 , srv40345972:84 , srv492201607:84 , srv517039903:84 , srv521853588:84 , srv554615762:84 , srv558304212:84 , srv613324156:84 , srv627670463:84 , srv632111300:84 , srv635490786:84 , srv639676643:84 , srv655040633:84 , srv661975555:84 , srv739712143:84 , srv746367799:84 , srv796074085:84 , srv85659128:84 , srv887710432:84 , srv932414994:84 , srv945862166:84 , srv956193623:84 , srv133996595:85 , srv1497463222:85 , srv1527595691:85 , srv1584225747:85 , srv165108349:85 , srv315987043:85 , srv634487831:85 , srv695119213:85 , srv821949623:85 , srv155205408:684 }
2023-07-23 14:53:16,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-23 14:53:16,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv627670463=78, srv303748749=66, srv1608330611=34, srv558304212=76, srv661975555=84, srv1751953526=43, srv635490786=81, srv226092889=62, srv1352229413=19, srv2025960968=53, srv632111300=79, srv739712143=86, srv1318289148=16, srv869780554=91, srv1185967095=9, srv1071630122=1, srv1895023386=47, srv492201607=72, srv155205408=29, srv40345972=70, srv521853588=74, srv1824406586=45, srv634487831=80, srv1138736855=6, srv1256540745=13, srv1241753817=12, srv1527595691=27, srv2037949325=54, srv196317077=49, srv2099416156=57, srv2112778246=58, srv904942934=94, srv1209759173=10, srv1076442604=2, srv360574848=68, srv1556510200=30, srv1941917098=48, srv253111013=63, srv517039903=73, srv821949623=89, srv133996595=18, srv1713029032=41, srv2124486130=59, srv1636343730=36, srv554615762=75, srv695119213=85, srv1082759896=3, srv2018822643=51, srv1173194486=8, srv1482323014=23, srv1294969672=14, srv932414994=96, srv1814855180=44, srv969562999=99, srv796074085=88, srv1521284970=26, srv746367799=87, srv878251620=92, srv1375504452=20, srv1563499178=31, srv183840748=46, srv279161124=65, srv1542769960=28, srv2130502186=60, srv315987043=67, srv1108153955=4, srv1578371568=32, srv655040633=83, srv613324156=77, srv1710774942=40, srv2021058146=52, srv1155402105=7, srv208916905=56, srv1663366251=38, srv85659128=90, srv1042567978=0, srv2138823681=61, srv1459169534=22, srv1507041677=25, srv956193623=98, srv887710432=93, srv639676643=82, srv1407682473=21, srv1613950618=35, srv391168249=69, srv1135741029=5, srv945862166=97, srv1497463222=24, srv165108349=37, srv1314158137=15, srv2071256193=55, srv1584225747=33, srv1715521467=42, srv259936005=64, srv436327965=71, srv1325011671=17, srv2013619355=50, srv905215789=95, srv1230056049=11, srv1679737602=39} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-23 14:53:16,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-23 14:53:16,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-23 14:53:16,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-23 14:53:16,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-23 14:53:16,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-23 14:53:16,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-23 14:53:16,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-23 14:53:16,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-23 14:53:16,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-23 14:53:16,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-23 14:53:16,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-23 14:53:16,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-23 14:53:16,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-23 14:53:16,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-23 14:53:16,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-23 14:53:16,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-23 14:53:16,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-23 14:53:16,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-23 14:53:16,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-23 14:53:16,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-23 14:53:16,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-23 14:53:16,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-23 14:53:16,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-23 14:53:16,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-23 14:53:16,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-23 14:53:16,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-23 14:53:16,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-23 14:53:16,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-23 14:53:16,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-23 14:53:16,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-23 14:53:16,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-23 14:53:16,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-23 14:53:16,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-23 14:53:16,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-23 14:53:16,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-23 14:53:16,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-23 14:53:16,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-23 14:53:16,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-23 14:53:16,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-23 14:53:16,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-23 14:53:16,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-23 14:53:16,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-23 14:53:16,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-23 14:53:16,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-23 14:53:16,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-23 14:53:16,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-23 14:53:16,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-23 14:53:16,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-23 14:53:16,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-23 14:53:16,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-23 14:53:16,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-23 14:53:16,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-23 14:53:16,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-23 14:53:16,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-23 14:53:16,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-23 14:53:16,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-23 14:53:16,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-23 14:53:16,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-23 14:53:16,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-23 14:53:16,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-23 14:53:16,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-23 14:53:16,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-23 14:53:16,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-23 14:53:16,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-23 14:53:16,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-23 14:53:16,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-23 14:53:16,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-23 14:53:16,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-23 14:53:16,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-23 14:53:16,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-23 14:53:16,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-23 14:53:16,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-23 14:53:16,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-23 14:53:16,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-23 14:53:16,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-23 14:53:16,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-23 14:53:16,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-23 14:53:16,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-23 14:53:16,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-23 14:53:16,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-23 14:53:16,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-23 14:53:16,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-23 14:53:16,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-23 14:53:16,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-23 14:53:16,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-23 14:53:16,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-23 14:53:16,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-23 14:53:16,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-23 14:53:16,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-23 14:53:16,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-23 14:53:16,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-23 14:53:16,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-23 14:53:16,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-23 14:53:16,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-23 14:53:16,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-23 14:53:16,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-23 14:53:16,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-23 14:53:16,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-23 14:53:16,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-23 14:53:16,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-23 14:53:16,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-23 14:53:16,425 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=6.397985672269699E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014213381090374027); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-23 14:53:16,425 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1482323014:83 , srv1636343730:83 , srv208916905:83 , srv436327965:83 , srv869780554:83 , srv878251620:83 , srv904942934:83 , srv905215789:83 , srv969562999:83 , srv1042567978:84 , srv1071630122:84 , srv1076442604:84 , srv1082759896:84 , srv1108153955:84 , srv1135741029:84 , srv1138736855:84 , srv1155402105:84 , srv1173194486:84 , srv1185967095:84 , srv1209759173:84 , srv1230056049:84 , srv1241753817:84 , srv1256540745:84 , srv1294969672:84 , srv1314158137:84 , srv1318289148:84 , srv1325011671:84 , srv1352229413:84 , srv1375504452:84 , srv1407682473:84 , srv1459169534:84 , srv1507041677:84 , srv1521284970:84 , srv1542769960:84 , srv1556510200:84 , srv1563499178:84 , srv1578371568:84 , srv1608330611:84 , srv1613950618:84 , srv1663366251:84 , srv1679737602:84 , srv1710774942:84 , srv1713029032:84 , srv1715521467:84 , srv1751953526:84 , srv1814855180:84 , srv1824406586:84 , srv183840748:84 , srv1895023386:84 , srv1941917098:84 , srv196317077:84 , srv2013619355:84 , srv2018822643:84 , srv2021058146:84 , srv2025960968:84 , srv2037949325:84 , srv2071256193:84 , srv2099416156:84 , srv2112778246:84 , srv2124486130:84 , srv2130502186:84 , srv2138823681:84 , srv226092889:84 , srv253111013:84 , srv259936005:84 , srv279161124:84 , srv303748749:84 , srv360574848:84 , srv391168249:84 , srv40345972:84 , srv492201607:84 , srv517039903:84 , srv521853588:84 , srv554615762:84 , srv558304212:84 , srv613324156:84 , srv627670463:84 , srv632111300:84 , srv635490786:84 , srv639676643:84 , srv655040633:84 , srv661975555:84 , srv739712143:84 , srv746367799:84 , srv796074085:84 , srv85659128:84 , srv887710432:84 , srv932414994:84 , srv945862166:84 , srv956193623:84 , srv133996595:85 , srv1497463222:85 , srv1527595691:85 , srv1584225747:85 , srv165108349:85 , srv315987043:85 , srv634487831:85 , srv695119213:85 , srv821949623:85 , srv155205408:684 }
2023-07-23 14:53:16,459 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=283 (was 282) - SystemLoadAverage LEAK? -, ProcessCount=173 (was 173), AvailableMemoryMB=10044 (was 10838)
2023-07-23 14:53:16,470 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=283, ProcessCount=173, AvailableMemoryMB=10040
2023-07-23 14:53:16,471 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-07-23 14:53:16,472 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-07-23 14:53:16,482 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1003747626:84 , srv1019353228:84 , srv1056728328:84 , srv1093555156:84 , srv1110265610:84 , srv1132800732:84 , srv1134119119:84 , srv1183956235:84 , srv1346098736:84 , srv1384887526:84 , srv1431085197:84 , srv1545040039:84 , srv1612555792:84 , srv1646834628:84 , srv1674375140:84 , srv1726112272:84 , srv1834523398:84 , srv188596990:84 , srv2022466623:84 , srv2117753960:84 , srv286327874:84 , srv364590444:84 , srv539196649:84 , srv698022752:84 , srv745224814:84 , srv81506081:84 , srv918819217:84 , srv973349146:84 , srv999406645:84 , srv2093416156:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-07-23 14:53:16,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-23 14:53:16,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1346098736=8, srv973349146=28, srv81506081=26, srv1646834628=13, srv1110265610=4, srv1834523398=16, srv1726112272=15, srv1134119119=6, srv364590444=22, srv698022752=24, srv745224814=25, srv918819217=27, srv539196649=23, srv1545040039=11, srv2117753960=20, srv1674375140=14, srv1384887526=9, srv1431085197=10, srv999406645=29, srv286327874=21, srv1019353228=1, srv1132800732=5, srv1003747626=0, srv1093555156=3, srv2022466623=18, srv1056728328=2, srv188596990=17, srv1183956235=7, srv1612555792=12, srv2093416156=19} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-23 14:53:16,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-23 14:53:16,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-23 14:53:16,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-23 14:53:16,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-23 14:53:16,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-23 14:53:16,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-23 14:53:16,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-23 14:53:16,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-23 14:53:16,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-23 14:53:16,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-23 14:53:16,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-23 14:53:16,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-23 14:53:16,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-23 14:53:16,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-23 14:53:16,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-23 14:53:16,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-23 14:53:16,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-23 14:53:16,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-23 14:53:16,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-23 14:53:16,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-23 14:53:16,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-23 14:53:16,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-23 14:53:16,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-23 14:53:16,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-23 14:53:16,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-23 14:53:16,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-23 14:53:16,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-23 14:53:16,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-23 14:53:16,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-23 14:53:16,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-23 14:53:16,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-07-23 14:53:16,519 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1035480508570976, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-23 14:53:16,519 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912519319791375, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1035480508570976, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-07-23 14:55:16,504 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6331456 different iterations.  Found a solution that moves 1857 regions; Going from a computed imbalance of 0.9912519319791375 to a new imbalance of 4.334330639506329E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6877777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-23 14:55:16,511 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1003747626:90 , srv1019353228:90 , srv1056728328:90 , srv1093555156:90 , srv1110265610:90 , srv1132800732:90 , srv1134119119:90 , srv1183956235:90 , srv1346098736:90 , srv1384887526:90 , srv1431085197:90 , srv1545040039:90 , srv1612555792:90 , srv1646834628:90 , srv1674375140:90 , srv1726112272:90 , srv1834523398:90 , srv188596990:90 , srv2022466623:90 , srv2093416156:90 , srv2117753960:90 , srv286327874:90 , srv364590444:90 , srv539196649:90 , srv698022752:90 , srv745224814:90 , srv81506081:90 , srv918819217:90 , srv973349146:90 , srv999406645:90 }
2023-07-23 14:55:16,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-23 14:55:16,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1346098736=8, srv973349146=28, srv81506081=26, srv1646834628=13, srv1110265610=4, srv1834523398=16, srv1726112272=15, srv1134119119=6, srv364590444=22, srv698022752=24, srv745224814=25, srv918819217=27, srv539196649=23, srv1545040039=11, srv2117753960=20, srv1674375140=14, srv1384887526=9, srv1431085197=10, srv999406645=29, srv286327874=21, srv1019353228=1, srv1132800732=5, srv1003747626=0, srv1093555156=3, srv2022466623=18, srv1056728328=2, srv188596990=17, srv1183956235=7, srv1612555792=12, srv2093416156=19} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-23 14:55:16,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-23 14:55:16,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-23 14:55:16,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-23 14:55:16,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-23 14:55:16,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-23 14:55:16,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-23 14:55:16,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-23 14:55:16,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-23 14:55:16,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-23 14:55:16,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-23 14:55:16,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-23 14:55:16,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-23 14:55:16,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-23 14:55:16,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-23 14:55:16,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-23 14:55:16,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-23 14:55:16,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-23 14:55:16,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-23 14:55:16,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-23 14:55:16,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-23 14:55:16,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-23 14:55:16,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-23 14:55:16,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-23 14:55:16,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-23 14:55:16,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-23 14:55:16,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-23 14:55:16,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-23 14:55:16,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-23 14:55:16,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-23 14:55:16,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-23 14:55:16,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-07-23 14:55:16,531 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-23 14:55:16,531 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1003747626:90 , srv1019353228:90 , srv1056728328:90 , srv1093555156:90 , srv1110265610:90 , srv1132800732:90 , srv1134119119:90 , srv1183956235:90 , srv1346098736:90 , srv1384887526:90 , srv1431085197:90 , srv1545040039:90 , srv1612555792:90 , srv1646834628:90 , srv1674375140:90 , srv1726112272:90 , srv1834523398:90 , srv188596990:90 , srv2022466623:90 , srv2093416156:90 , srv2117753960:90 , srv286327874:90 , srv364590444:90 , srv539196649:90 , srv698022752:90 , srv745224814:90 , srv81506081:90 , srv918819217:90 , srv973349146:90 , srv999406645:90 }
2023-07-23 14:55:16,544 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=296 (was 283) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 173), AvailableMemoryMB=9909 (was 10040)