2023-04-05 14:56:35,456 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-04-05 14:56:35,791 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-04-05 14:56:35,913 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-04-05 14:56:35,970 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-05 14:56:35,977 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-04-05 14:56:35,990 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=501, ProcessCount=170, AvailableMemoryMB=2093
2023-04-05 14:56:35,992 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-05 14:56:35,992 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-04-05 14:56:36,111 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1017137678:84 , srv101954737:84 , srv1061612511:84 , srv1075821014:84 , srv1116276564:84 , srv113144588:84 , srv1137631773:84 , srv1158914934:84 , srv1161546461:84 , srv1162060233:84 , srv1163556996:84 , srv1184145198:84 , srv1207209750:84 , srv1223217460:84 , srv1233940726:84 , srv1257122995:84 , srv1278794854:84 , srv1280754023:84 , srv1292142787:84 , srv1301375083:84 , srv1311180986:84 , srv1317500347:84 , srv1327408754:84 , srv1363016455:84 , srv1368301302:84 , srv1372536939:84 , srv1376703323:84 , srv1397483251:84 , srv1407182332:84 , srv1447498472:84 , srv1452257228:84 , srv1459593146:84 , srv1471006436:84 , srv1480213558:84 , srv1526859245:84 , srv1559737577:84 , srv1582609445:84 , srv158318715:84 , srv1609702441:84 , srv162553273:84 , srv1627895315:84 , srv1671057020:84 , srv1710814311:84 , srv1714060278:84 , srv1717588404:84 , srv1727037628:84 , srv1730092446:84 , srv1746070047:84 , srv1754492278:84 , srv1782979938:84 , srv1795741334:84 , srv1803896708:84 , srv1817425930:84 , srv1818234276:84 , srv1823168406:84 , srv1861918974:84 , srv1902601727:84 , srv1905363185:84 , srv1915109962:84 , srv1921158298:84 , srv1923316563:84 , srv1927105716:84 , srv1931313575:84 , srv1938919:84 , srv1943270916:84 , srv1978858092:84 , srv2013517097:84 , srv203877165:84 , srv2076371991:84 , srv2086705621:84 , srv2094383611:84 , srv2118362314:84 , srv2140360277:84 , srv253522757:84 , srv289139733:84 , srv306275007:84 , srv332999346:84 , srv479217872:84 , srv511120415:84 , srv564528936:84 , srv581854775:84 , srv609236174:84 , srv630409948:84 , srv680766839:84 , srv708946131:84 , srv721881269:84 , srv736487473:84 , srv75026560:84 , srv763913680:84 , srv817308724:84 , srv835541239:84 , srv843011328:84 , srv882694611:84 , srv895872656:84 , srv898710000:84 , srv907579147:84 , srv908992836:84 , srv939041409:84 , srv958940127:84 , srv576034037:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-04-05 14:56:36,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-05 14:56:36,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv332999346=76, srv1162060233=9, srv2118362314=71, srv835541239=91, srv1817425930=52, srv843011328=92, srv1746070047=47, srv882694611=93, srv2086705621=69, srv306275007=75, srv1207209750=12, srv1452257228=30, srv1795741334=50, srv1938919=63, srv2076371991=68, srv708946131=85, srv1292142787=18, srv1397483251=27, srv1223217460=13, srv1671057020=41, srv1317500347=21, srv1915109962=58, srv1931313575=62, srv1372536939=25, srv1902601727=56, srv721881269=86, srv1471006436=32, srv1921158298=59, srv898710000=95, srv1017137678=0, srv1163556996=10, srv576034037=80, srv511120415=78, srv763913680=89, srv2094383611=70, srv1714060278=43, srv895872656=94, srv680766839=84, srv1301375083=19, srv1710814311=42, srv1559737577=35, srv158318715=37, srv253522757=73, srv1803896708=51, srv1233940726=14, srv1376703323=26, srv1061612511=2, srv1161546461=8, srv162553273=39, srv1717588404=44, srv1823168406=54, srv1480213558=33, srv113144588=5, srv1861918974=55, srv1075821014=3, srv1730092446=46, srv1363016455=23, srv1137631773=6, srv479217872=77, srv1184145198=11, srv289139733=74, srv1116276564=4, srv1754492278=48, srv1923316563=60, srv908992836=97, srv564528936=79, srv609236174=82, srv2013517097=66, srv630409948=83, srv1368301302=24, srv1727037628=45, srv1927105716=61, srv101954737=1, srv1627895315=40, srv1782979938=49, srv1327408754=22, srv958940127=99, srv1905363185=57, srv736487473=87, srv1526859245=34, srv1609702441=38, srv939041409=98, srv1582609445=36, srv203877165=67, srv75026560=88, srv907579147=96, srv1278794854=16, srv1311180986=20, srv2140360277=72, srv1257122995=15, srv1459593146=31, srv817308724=90, srv1943270916=64, srv1158914934=7, srv1978858092=65, srv1280754023=17, srv1407182332=28, srv581854775=81, srv1818234276=53, srv1447498472=29} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-05 14:56:36,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-05 14:56:36,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-05 14:56:36,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-05 14:56:36,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-05 14:56:36,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-05 14:56:36,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-05 14:56:36,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-05 14:56:36,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-05 14:56:36,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-05 14:56:36,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-05 14:56:36,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-05 14:56:36,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-05 14:56:36,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-05 14:56:36,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-05 14:56:36,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-05 14:56:36,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-05 14:56:36,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-05 14:56:36,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-05 14:56:36,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-05 14:56:36,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-05 14:56:36,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-05 14:56:36,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-05 14:56:36,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-05 14:56:36,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-05 14:56:36,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-05 14:56:36,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-05 14:56:36,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-05 14:56:36,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-05 14:56:36,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-05 14:56:36,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-05 14:56:36,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-05 14:56:36,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-05 14:56:36,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-05 14:56:36,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-05 14:56:36,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-05 14:56:36,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-05 14:56:36,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-05 14:56:36,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-05 14:56:36,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-05 14:56:36,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-05 14:56:36,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-05 14:56:36,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-05 14:56:36,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-05 14:56:36,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-05 14:56:36,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-05 14:56:36,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-05 14:56:36,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-05 14:56:36,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-05 14:56:36,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-05 14:56:36,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-05 14:56:36,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-05 14:56:36,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-05 14:56:36,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-05 14:56:36,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-05 14:56:36,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-05 14:56:36,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-05 14:56:36,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-05 14:56:36,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-05 14:56:36,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-05 14:56:36,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-05 14:56:36,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-05 14:56:36,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-05 14:56:36,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-05 14:56:36,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-05 14:56:36,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-05 14:56:36,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-05 14:56:36,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-05 14:56:36,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-05 14:56:36,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-05 14:56:36,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-05 14:56:36,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-05 14:56:36,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-05 14:56:36,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-05 14:56:36,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-05 14:56:36,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-05 14:56:36,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-05 14:56:36,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-05 14:56:36,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-05 14:56:36,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-05 14:56:36,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-05 14:56:36,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-05 14:56:36,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-05 14:56:36,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-05 14:56:36,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-05 14:56:36,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-05 14:56:36,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-05 14:56:36,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-05 14:56:36,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-05 14:56:36,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-05 14:56:36,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-05 14:56:36,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-05 14:56:36,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-05 14:56:36,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-05 14:56:36,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-05 14:56:36,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-05 14:56:36,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-05 14:56:36,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-05 14:56:36,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-05 14:56:36,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-05 14:56:36,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-05 14:56:36,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-05 14:56:36,438 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-05 14:56:36,438 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-05 14:56:36,438 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-05 14:56:36,823 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 569 ms to try 5000 different iterations.  Found a solution that moves 4658 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18437996477522545. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04269158456817647, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06115425474303653, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5175555555555555, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04269158456817647, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17941666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24816666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-05 14:56:36,852 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv113144588:82 , srv1327408754:82 , srv101954737:83 , srv1158914934:83 , srv1163556996:83 , srv1233940726:83 , srv1292142787:83 , srv1459593146:83 , srv1559737577:83 , srv162553273:83 , srv1746070047:83 , srv1782979938:83 , srv1803896708:83 , srv1823168406:83 , srv1902601727:83 , srv1927105716:83 , srv680766839:83 , srv736487473:83 , srv895872656:83 , srv1017137678:84 , srv1137631773:84 , srv1376703323:84 , srv1471006436:84 , srv1582609445:84 , srv1818234276:84 , srv1921158298:84 , srv1978858092:84 , srv2094383611:84 , srv2118362314:84 , srv253522757:84 , srv289139733:84 , srv511120415:84 , srv721881269:84 , srv763913680:84 , srv958940127:84 , srv1061612511:85 , srv1184145198:85 , srv1671057020:85 , srv1710814311:85 , srv1727037628:85 , srv203877165:85 , srv630409948:85 , srv835541239:85 , srv898710000:85 , srv1075821014:86 , srv1223217460:86 , srv1257122995:86 , srv1280754023:86 , srv1452257228:86 , srv1609702441:86 , srv1627895315:86 , srv1717588404:86 , srv1915109962:86 , srv1938919:86 , srv2013517097:86 , srv2076371991:86 , srv332999346:86 , srv479217872:86 , srv581854775:86 , srv817308724:86 , srv882694611:86 , srv1363016455:87 , srv1397483251:87 , srv1407182332:87 , srv1447498472:87 , srv1480213558:87 , srv1730092446:87 , srv1861918974:87 , srv2086705621:87 , srv306275007:87 , srv75026560:87 , srv843011328:87 , srv907579147:87 , srv1162060233:88 , srv1278794854:88 , srv1311180986:88 , srv1368301302:88 , srv1372536939:88 , srv1754492278:88 , srv1923316563:88 , srv1943270916:88 , srv2140360277:88 , srv708946131:88 , srv939041409:88 , srv1161546461:89 , srv1207209750:89 , srv1317500347:89 , srv1714060278:89 , srv1817425930:89 , srv1905363185:89 , srv1931313575:89 , srv908992836:89 , srv1116276564:90 , srv1795741334:91 , srv564528936:91 , srv1301375083:93 , srv1526859245:95 , srv609236174:95 , srv158318715:106 , srv576034037:469 }
2023-04-05 14:56:36,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-05 14:56:36,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv332999346=76, srv1162060233=9, srv2118362314=71, srv835541239=91, srv1817425930=52, srv843011328=92, srv1746070047=47, srv882694611=93, srv2086705621=69, srv306275007=75, srv1207209750=12, srv1452257228=30, srv1795741334=50, srv1938919=63, srv2076371991=68, srv708946131=85, srv1292142787=18, srv1397483251=27, srv1223217460=13, srv1671057020=41, srv1317500347=21, srv1915109962=58, srv1931313575=62, srv1372536939=25, srv1902601727=56, srv721881269=86, srv1471006436=32, srv1921158298=59, srv898710000=95, srv1017137678=0, srv1163556996=10, srv576034037=80, srv511120415=78, srv763913680=89, srv2094383611=70, srv1714060278=43, srv895872656=94, srv680766839=84, srv1301375083=19, srv1710814311=42, srv1559737577=35, srv158318715=37, srv253522757=73, srv1803896708=51, srv1233940726=14, srv1376703323=26, srv1061612511=2, srv1161546461=8, srv162553273=39, srv1717588404=44, srv1823168406=54, srv1480213558=33, srv113144588=5, srv1861918974=55, srv1075821014=3, srv1730092446=46, srv1363016455=23, srv1137631773=6, srv479217872=77, srv1184145198=11, srv289139733=74, srv1116276564=4, srv1754492278=48, srv1923316563=60, srv908992836=97, srv564528936=79, srv609236174=82, srv2013517097=66, srv630409948=83, srv1368301302=24, srv1727037628=45, srv1927105716=61, srv101954737=1, srv1627895315=40, srv1782979938=49, srv1327408754=22, srv958940127=99, srv1905363185=57, srv736487473=87, srv1526859245=34, srv1609702441=38, srv939041409=98, srv1582609445=36, srv203877165=67, srv75026560=88, srv907579147=96, srv1278794854=16, srv1311180986=20, srv2140360277=72, srv1257122995=15, srv1459593146=31, srv817308724=90, srv1943270916=64, srv1158914934=7, srv1978858092=65, srv1280754023=17, srv1407182332=28, srv581854775=81, srv1818234276=53, srv1447498472=29} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-05 14:56:36,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-05 14:56:36,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-05 14:56:36,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-05 14:56:36,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-05 14:56:36,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-05 14:56:36,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-05 14:56:36,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-05 14:56:36,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-05 14:56:36,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-05 14:56:36,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-05 14:56:36,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-05 14:56:36,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-05 14:56:36,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-05 14:56:36,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-05 14:56:36,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-05 14:56:36,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-05 14:56:36,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-05 14:56:36,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-05 14:56:36,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-05 14:56:36,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-05 14:56:36,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-05 14:56:36,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-05 14:56:36,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-05 14:56:36,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-05 14:56:36,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-05 14:56:36,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-05 14:56:36,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-05 14:56:36,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-05 14:56:36,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-05 14:56:36,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-05 14:56:36,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-05 14:56:36,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-05 14:56:36,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-05 14:56:36,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-05 14:56:36,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-05 14:56:36,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-05 14:56:36,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-05 14:56:36,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-05 14:56:36,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-05 14:56:36,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-05 14:56:36,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-05 14:56:36,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-05 14:56:36,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-05 14:56:36,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-05 14:56:36,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-05 14:56:36,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-05 14:56:36,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-05 14:56:36,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-05 14:56:36,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-05 14:56:36,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-05 14:56:36,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-05 14:56:36,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-05 14:56:36,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-05 14:56:36,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-05 14:56:36,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-05 14:56:36,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-05 14:56:36,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-05 14:56:36,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-05 14:56:36,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-05 14:56:36,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-05 14:56:36,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-05 14:56:36,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-05 14:56:36,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-05 14:56:36,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-05 14:56:36,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-05 14:56:36,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-05 14:56:36,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-05 14:56:36,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-05 14:56:36,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-05 14:56:36,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-05 14:56:36,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-05 14:56:36,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-05 14:56:36,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-05 14:56:36,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-05 14:56:36,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-05 14:56:36,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-05 14:56:36,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-05 14:56:36,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-05 14:56:36,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-05 14:56:36,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-05 14:56:36,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-05 14:56:36,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-05 14:56:36,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-05 14:56:36,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-05 14:56:36,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-05 14:56:36,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-05 14:56:36,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-05 14:56:36,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-05 14:56:36,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-05 14:56:36,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-05 14:56:36,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-05 14:56:36,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-05 14:56:36,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-05 14:56:36,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-05 14:56:36,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-05 14:56:36,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-05 14:56:36,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-05 14:56:36,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-05 14:56:36,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-05 14:56:36,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-05 14:56:36,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-05 14:56:37,066 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04269158456817647, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06115425474303653, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04269158456817647, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17941666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24816666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-05 14:56:37,066 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-05 14:56:37,067 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.1843473487621094, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04269158456817647, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06115425474303653, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04269158456817647, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17941666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24816666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-05 14:56:37,385 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 467 ms to try 5000 different iterations.  Found a solution that moves 2689 regions; Going from a computed imbalance of 0.1843473487621094 to a new imbalance of 0.016623663438334563. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022375453744908947); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03322203641716901, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29877777777777775, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022375453744908947); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01325); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04908333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-05 14:56:37,394 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv158318715:66 , srv609236174:78 , srv1301375083:79 , srv1526859245:80 , srv1714060278:81 , srv564528936:81 , srv908992836:81 , srv1116276564:82 , srv1931313575:82 , srv1278794854:83 , srv1480213558:83 , srv1795741334:83 , srv1817425930:83 , srv1161546461:84 , srv1162060233:84 , srv1280754023:84 , srv1311180986:84 , srv1317500347:84 , srv1397483251:84 , srv1905363185:84 , srv1943270916:84 , srv306275007:84 , srv332999346:84 , srv882694611:84 , srv939041409:84 , srv1207209750:85 , srv1363016455:85 , srv1368301302:85 , srv1372536939:85 , srv1407182332:85 , srv1447498472:85 , srv1717588404:85 , srv1727037628:85 , srv1861918974:85 , srv1923316563:85 , srv1938919:85 , srv2013517097:85 , srv203877165:85 , srv2086705621:85 , srv2140360277:85 , srv581854775:85 , srv75026560:85 , srv843011328:85 , srv907579147:85 , srv1017137678:86 , srv1061612511:86 , srv1075821014:86 , srv1223217460:86 , srv1376703323:86 , srv1452257228:86 , srv1609702441:86 , srv1730092446:86 , srv1754492278:86 , srv1915109962:86 , srv2076371991:86 , srv708946131:86 , srv817308724:86 , srv1137631773:87 , srv1184145198:87 , srv1233940726:87 , srv1257122995:87 , srv1582609445:87 , srv1627895315:87 , srv1710814311:87 , srv1782979938:87 , srv1823168406:87 , srv1921158298:87 , srv1978858092:87 , srv253522757:87 , srv680766839:87 , srv835541239:87 , srv898710000:87 , srv101954737:88 , srv1158914934:88 , srv1671057020:88 , srv1818234276:88 , srv2118362314:88 , srv479217872:88 , srv630409948:88 , srv958940127:88 , srv1471006436:89 , srv1559737577:89 , srv162553273:89 , srv1746070047:89 , srv1803896708:89 , srv1902601727:89 , srv1927105716:89 , srv289139733:89 , srv511120415:89 , srv736487473:89 , srv763913680:89 , srv895872656:89 , srv1163556996:90 , srv1292142787:90 , srv721881269:90 , srv113144588:91 , srv2094383611:91 , srv1327408754:92 , srv1459593146:92 , srv576034037:504 }
2023-04-05 14:56:37,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-05 14:56:37,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv332999346=76, srv1162060233=9, srv2118362314=71, srv835541239=91, srv1817425930=52, srv843011328=92, srv1746070047=47, srv882694611=93, srv2086705621=69, srv306275007=75, srv1207209750=12, srv1452257228=30, srv1795741334=50, srv1938919=63, srv2076371991=68, srv708946131=85, srv1292142787=18, srv1397483251=27, srv1223217460=13, srv1671057020=41, srv1317500347=21, srv1915109962=58, srv1931313575=62, srv1372536939=25, srv1902601727=56, srv721881269=86, srv1471006436=32, srv1921158298=59, srv898710000=95, srv1017137678=0, srv1163556996=10, srv576034037=80, srv511120415=78, srv763913680=89, srv2094383611=70, srv1714060278=43, srv895872656=94, srv680766839=84, srv1301375083=19, srv1710814311=42, srv1559737577=35, srv158318715=37, srv253522757=73, srv1803896708=51, srv1233940726=14, srv1376703323=26, srv1061612511=2, srv1161546461=8, srv162553273=39, srv1717588404=44, srv1823168406=54, srv1480213558=33, srv113144588=5, srv1861918974=55, srv1075821014=3, srv1730092446=46, srv1363016455=23, srv1137631773=6, srv479217872=77, srv1184145198=11, srv289139733=74, srv1116276564=4, srv1754492278=48, srv1923316563=60, srv908992836=97, srv564528936=79, srv609236174=82, srv2013517097=66, srv630409948=83, srv1368301302=24, srv1727037628=45, srv1927105716=61, srv101954737=1, srv1627895315=40, srv1782979938=49, srv1327408754=22, srv958940127=99, srv1905363185=57, srv736487473=87, srv1526859245=34, srv1609702441=38, srv939041409=98, srv1582609445=36, srv203877165=67, srv75026560=88, srv907579147=96, srv1278794854=16, srv1311180986=20, srv2140360277=72, srv1257122995=15, srv1459593146=31, srv817308724=90, srv1943270916=64, srv1158914934=7, srv1978858092=65, srv1280754023=17, srv1407182332=28, srv581854775=81, srv1818234276=53, srv1447498472=29} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-05 14:56:37,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-05 14:56:37,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-05 14:56:37,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-05 14:56:37,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-05 14:56:37,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-05 14:56:37,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-05 14:56:37,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-05 14:56:37,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-05 14:56:37,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-05 14:56:37,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-05 14:56:37,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-05 14:56:37,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-05 14:56:37,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-05 14:56:37,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-05 14:56:37,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-05 14:56:37,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-05 14:56:37,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-05 14:56:37,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-05 14:56:37,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-05 14:56:37,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-05 14:56:37,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-05 14:56:37,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-05 14:56:37,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-05 14:56:37,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-05 14:56:37,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-05 14:56:37,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-05 14:56:37,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-05 14:56:37,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-05 14:56:37,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-05 14:56:37,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-05 14:56:37,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-05 14:56:37,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-05 14:56:37,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-05 14:56:37,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-05 14:56:37,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-05 14:56:37,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-05 14:56:37,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-05 14:56:37,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-05 14:56:37,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-05 14:56:37,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-05 14:56:37,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-05 14:56:37,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-05 14:56:37,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-05 14:56:37,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-05 14:56:37,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-05 14:56:37,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-05 14:56:37,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-05 14:56:37,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-05 14:56:37,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-05 14:56:37,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-05 14:56:37,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-05 14:56:37,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-05 14:56:37,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-05 14:56:37,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-05 14:56:37,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-05 14:56:37,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-05 14:56:37,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-05 14:56:37,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-05 14:56:37,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-05 14:56:37,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-05 14:56:37,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-05 14:56:37,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-05 14:56:37,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-05 14:56:37,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-05 14:56:37,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-05 14:56:37,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-05 14:56:37,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-05 14:56:37,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-05 14:56:37,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-05 14:56:37,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-05 14:56:37,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-05 14:56:37,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-05 14:56:37,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-05 14:56:37,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-05 14:56:37,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-05 14:56:37,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-05 14:56:37,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-05 14:56:37,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-05 14:56:37,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-05 14:56:37,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-05 14:56:37,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-05 14:56:37,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-05 14:56:37,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-05 14:56:37,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-05 14:56:37,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-05 14:56:37,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-05 14:56:37,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-05 14:56:37,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-05 14:56:37,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-05 14:56:37,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-05 14:56:37,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-05 14:56:37,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-05 14:56:37,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-05 14:56:37,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-05 14:56:37,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-05 14:56:37,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-05 14:56:37,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-05 14:56:37,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-05 14:56:37,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-05 14:56:37,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-05 14:56:37,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-05 14:56:37,536 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022375453744908947); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03322203641716901, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022375453744908947); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01325); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04908333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-05 14:56:37,537 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-05 14:56:37,537 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.01660483465789897, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022375453744908947); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03322203641716901, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022375453744908947); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01325); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04908333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-05 14:56:37,776 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 337 ms to try 5000 different iterations.  Found a solution that moves 1075 regions; Going from a computed imbalance of 0.01660483465789897 to a new imbalance of 6.614317694685242E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0066722759791160435); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006461489127967465); MoveCostFunction : (multiplier=7.0, imbalance=0.11944444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0066722759791160435); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004083333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-05 14:56:37,778 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1327408754:82 , srv1459593146:82 , srv2094383611:82 , srv1207209750:83 , srv1526859245:83 , srv479217872:83 , srv721881269:83 , srv113144588:84 , srv1162060233:84 , srv1317500347:84 , srv1368301302:84 , srv1407182332:84 , srv1447498472:84 , srv1627895315:84 , srv1671057020:84 , srv1730092446:84 , srv1754492278:84 , srv1795741334:84 , srv1818234276:84 , srv1905363185:84 , srv1923316563:84 , srv609236174:84 , srv708946131:84 , srv763913680:84 , srv1075821014:85 , srv1116276564:85 , srv1158914934:85 , srv1161546461:85 , srv1163556996:85 , srv1184145198:85 , srv1223217460:85 , srv1257122995:85 , srv1292142787:85 , srv1301375083:85 , srv1372536939:85 , srv162553273:85 , srv1817425930:85 , srv1861918974:85 , srv1902601727:85 , srv1927105716:85 , srv1943270916:85 , srv1978858092:85 , srv2013517097:85 , srv2076371991:85 , srv2086705621:85 , srv2118362314:85 , srv289139733:85 , srv511120415:85 , srv630409948:85 , srv75026560:85 , srv843011328:85 , srv898710000:85 , srv907579147:85 , srv939041409:85 , srv101954737:86 , srv1061612511:86 , srv1137631773:86 , srv1278794854:86 , srv1280754023:86 , srv1311180986:86 , srv1363016455:86 , srv1452257228:86 , srv1471006436:86 , srv1559737577:86 , srv1582609445:86 , srv158318715:86 , srv1609702441:86 , srv1710814311:86 , srv1717588404:86 , srv1746070047:86 , srv1803896708:86 , srv1915109962:86 , srv2140360277:86 , srv564528936:86 , srv581854775:86 , srv736487473:86 , srv835541239:86 , srv895872656:86 , srv958940127:86 , srv1376703323:87 , srv1727037628:87 , srv1782979938:87 , srv1921158298:87 , srv1931313575:87 , srv1938919:87 , srv306275007:87 , srv332999346:87 , srv817308724:87 , srv882694611:87 , srv908992836:87 , srv1017137678:88 , srv1233940726:88 , srv1397483251:88 , srv1480213558:88 , srv1714060278:88 , srv1823168406:88 , srv203877165:88 , srv253522757:88 , srv680766839:89 , srv576034037:544 }
2023-04-05 14:56:37,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-05 14:56:37,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv332999346=76, srv1162060233=9, srv2118362314=71, srv835541239=91, srv1817425930=52, srv843011328=92, srv1746070047=47, srv882694611=93, srv2086705621=69, srv306275007=75, srv1207209750=12, srv1452257228=30, srv1795741334=50, srv1938919=63, srv2076371991=68, srv708946131=85, srv1292142787=18, srv1397483251=27, srv1223217460=13, srv1671057020=41, srv1317500347=21, srv1915109962=58, srv1931313575=62, srv1372536939=25, srv1902601727=56, srv721881269=86, srv1471006436=32, srv1921158298=59, srv898710000=95, srv1017137678=0, srv1163556996=10, srv576034037=80, srv511120415=78, srv763913680=89, srv2094383611=70, srv1714060278=43, srv895872656=94, srv680766839=84, srv1301375083=19, srv1710814311=42, srv1559737577=35, srv158318715=37, srv253522757=73, srv1803896708=51, srv1233940726=14, srv1376703323=26, srv1061612511=2, srv1161546461=8, srv162553273=39, srv1717588404=44, srv1823168406=54, srv1480213558=33, srv113144588=5, srv1861918974=55, srv1075821014=3, srv1730092446=46, srv1363016455=23, srv1137631773=6, srv479217872=77, srv1184145198=11, srv289139733=74, srv1116276564=4, srv1754492278=48, srv1923316563=60, srv908992836=97, srv564528936=79, srv609236174=82, srv2013517097=66, srv630409948=83, srv1368301302=24, srv1727037628=45, srv1927105716=61, srv101954737=1, srv1627895315=40, srv1782979938=49, srv1327408754=22, srv958940127=99, srv1905363185=57, srv736487473=87, srv1526859245=34, srv1609702441=38, srv939041409=98, srv1582609445=36, srv203877165=67, srv75026560=88, srv907579147=96, srv1278794854=16, srv1311180986=20, srv2140360277=72, srv1257122995=15, srv1459593146=31, srv817308724=90, srv1943270916=64, srv1158914934=7, srv1978858092=65, srv1280754023=17, srv1407182332=28, srv581854775=81, srv1818234276=53, srv1447498472=29} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-05 14:56:37,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-05 14:56:37,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-05 14:56:37,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-05 14:56:37,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-05 14:56:37,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-05 14:56:37,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-05 14:56:37,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-05 14:56:37,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-05 14:56:37,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-05 14:56:37,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-05 14:56:37,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-05 14:56:37,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-05 14:56:37,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-05 14:56:37,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-05 14:56:37,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-05 14:56:37,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-05 14:56:37,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-05 14:56:37,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-05 14:56:37,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-05 14:56:37,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-05 14:56:37,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-05 14:56:37,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-05 14:56:37,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-05 14:56:37,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-05 14:56:37,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-05 14:56:37,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-05 14:56:37,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-05 14:56:37,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-05 14:56:37,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-05 14:56:37,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-05 14:56:37,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-05 14:56:37,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-05 14:56:37,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-05 14:56:37,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-05 14:56:37,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-05 14:56:37,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-05 14:56:37,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-05 14:56:37,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-05 14:56:37,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-05 14:56:37,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-05 14:56:37,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-05 14:56:37,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-05 14:56:37,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-05 14:56:37,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-05 14:56:37,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-05 14:56:37,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-05 14:56:37,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-05 14:56:37,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-05 14:56:37,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-05 14:56:37,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-05 14:56:37,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-05 14:56:37,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-05 14:56:37,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-05 14:56:37,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-05 14:56:37,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-05 14:56:37,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-05 14:56:37,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-05 14:56:37,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-05 14:56:37,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-05 14:56:37,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-05 14:56:37,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-05 14:56:37,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-05 14:56:37,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-05 14:56:37,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-05 14:56:37,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-05 14:56:37,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-05 14:56:37,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-05 14:56:37,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-05 14:56:37,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-05 14:56:37,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-05 14:56:37,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-05 14:56:37,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-05 14:56:37,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-05 14:56:37,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-05 14:56:37,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-05 14:56:37,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-05 14:56:37,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-05 14:56:37,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-05 14:56:37,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-05 14:56:37,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-05 14:56:37,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-05 14:56:37,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-05 14:56:37,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-05 14:56:37,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-05 14:56:37,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-05 14:56:37,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-05 14:56:37,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-05 14:56:37,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-05 14:56:37,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-05 14:56:37,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-05 14:56:37,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-05 14:56:37,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-05 14:56:37,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-05 14:56:37,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-05 14:56:37,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-05 14:56:37,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-05 14:56:37,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-05 14:56:37,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-05 14:56:37,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-05 14:56:37,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-05 14:56:37,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-05 14:56:37,918 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0066722759791160435); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006461489127967465); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0066722759791160435); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004083333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-05 14:56:37,918 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-05 14:56:37,919 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=6.539044585840826E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0066722759791160435); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006461489127967465); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0066722759791160435); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004083333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-05 14:56:38,251 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 432 ms to try 5000 different iterations.  Found a solution that moves 247 regions; Going from a computed imbalance of 6.539044585840826E-4 to a new imbalance of 2.0037513580101113E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0019534423844256277); MoveCostFunction : (multiplier=7.0, imbalance=0.027444444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-05 14:56:38,252 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv2140360277:82 , srv680766839:82 , srv1397483251:83 , srv1471006436:83 , srv253522757:83 , srv817308724:83 , srv1017137678:84 , srv1161546461:84 , srv1163556996:84 , srv1233940726:84 , srv1257122995:84 , srv1292142787:84 , srv1311180986:84 , srv1363016455:84 , srv1368301302:84 , srv1372536939:84 , srv1452257228:84 , srv1480213558:84 , srv1526859245:84 , srv1559737577:84 , srv158318715:84 , srv1609702441:84 , srv1710814311:84 , srv1714060278:84 , srv1746070047:84 , srv1795741334:84 , srv1803896708:84 , srv1823168406:84 , srv1921158298:84 , srv1923316563:84 , srv1931313575:84 , srv1938919:84 , srv203877165:84 , srv289139733:84 , srv306275007:84 , srv564528936:84 , srv630409948:84 , srv708946131:84 , srv736487473:84 , srv835541239:84 , srv882694611:84 , srv895872656:84 , srv907579147:84 , srv958940127:84 , srv101954737:85 , srv1061612511:85 , srv1075821014:85 , srv1116276564:85 , srv113144588:85 , srv1137631773:85 , srv1184145198:85 , srv1207209750:85 , srv1223217460:85 , srv1278794854:85 , srv1301375083:85 , srv1317500347:85 , srv1376703323:85 , srv1459593146:85 , srv1582609445:85 , srv162553273:85 , srv1627895315:85 , srv1671057020:85 , srv1717588404:85 , srv1727037628:85 , srv1730092446:85 , srv1754492278:85 , srv1782979938:85 , srv1817425930:85 , srv1861918974:85 , srv1902601727:85 , srv1905363185:85 , srv1915109962:85 , srv1927105716:85 , srv1943270916:85 , srv1978858092:85 , srv2076371991:85 , srv2086705621:85 , srv2094383611:85 , srv2118362314:85 , srv332999346:85 , srv479217872:85 , srv511120415:85 , srv581854775:85 , srv75026560:85 , srv763913680:85 , srv843011328:85 , srv898710000:85 , srv908992836:85 , srv939041409:85 , srv1158914934:86 , srv1162060233:86 , srv1280754023:86 , srv1407182332:86 , srv1447498472:86 , srv2013517097:86 , srv609236174:86 , srv721881269:86 , srv1327408754:87 , srv1818234276:87 , srv576034037:625 }
2023-04-05 14:56:38,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-05 14:56:38,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv332999346=76, srv1162060233=9, srv2118362314=71, srv835541239=91, srv1817425930=52, srv843011328=92, srv1746070047=47, srv882694611=93, srv2086705621=69, srv306275007=75, srv1207209750=12, srv1452257228=30, srv1795741334=50, srv1938919=63, srv2076371991=68, srv708946131=85, srv1292142787=18, srv1397483251=27, srv1223217460=13, srv1671057020=41, srv1317500347=21, srv1915109962=58, srv1931313575=62, srv1372536939=25, srv1902601727=56, srv721881269=86, srv1471006436=32, srv1921158298=59, srv898710000=95, srv1017137678=0, srv1163556996=10, srv576034037=80, srv511120415=78, srv763913680=89, srv2094383611=70, srv1714060278=43, srv895872656=94, srv680766839=84, srv1301375083=19, srv1710814311=42, srv1559737577=35, srv158318715=37, srv253522757=73, srv1803896708=51, srv1233940726=14, srv1376703323=26, srv1061612511=2, srv1161546461=8, srv162553273=39, srv1717588404=44, srv1823168406=54, srv1480213558=33, srv113144588=5, srv1861918974=55, srv1075821014=3, srv1730092446=46, srv1363016455=23, srv1137631773=6, srv479217872=77, srv1184145198=11, srv289139733=74, srv1116276564=4, srv1754492278=48, srv1923316563=60, srv908992836=97, srv564528936=79, srv609236174=82, srv2013517097=66, srv630409948=83, srv1368301302=24, srv1727037628=45, srv1927105716=61, srv101954737=1, srv1627895315=40, srv1782979938=49, srv1327408754=22, srv958940127=99, srv1905363185=57, srv736487473=87, srv1526859245=34, srv1609702441=38, srv939041409=98, srv1582609445=36, srv203877165=67, srv75026560=88, srv907579147=96, srv1278794854=16, srv1311180986=20, srv2140360277=72, srv1257122995=15, srv1459593146=31, srv817308724=90, srv1943270916=64, srv1158914934=7, srv1978858092=65, srv1280754023=17, srv1407182332=28, srv581854775=81, srv1818234276=53, srv1447498472=29} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-05 14:56:38,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-05 14:56:38,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-05 14:56:38,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-05 14:56:38,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-05 14:56:38,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-05 14:56:38,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-05 14:56:38,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-05 14:56:38,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-05 14:56:38,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-05 14:56:38,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-05 14:56:38,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-05 14:56:38,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-05 14:56:38,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-05 14:56:38,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-05 14:56:38,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-05 14:56:38,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-05 14:56:38,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-05 14:56:38,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-05 14:56:38,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-05 14:56:38,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-05 14:56:38,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-05 14:56:38,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-05 14:56:38,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-05 14:56:38,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-05 14:56:38,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-05 14:56:38,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-05 14:56:38,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-05 14:56:38,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-05 14:56:38,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-05 14:56:38,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-05 14:56:38,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-05 14:56:38,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-05 14:56:38,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-05 14:56:38,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-05 14:56:38,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-05 14:56:38,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-05 14:56:38,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-05 14:56:38,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-05 14:56:38,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-05 14:56:38,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-05 14:56:38,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-05 14:56:38,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-05 14:56:38,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-05 14:56:38,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-05 14:56:38,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-05 14:56:38,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-05 14:56:38,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-05 14:56:38,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-05 14:56:38,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-05 14:56:38,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-05 14:56:38,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-05 14:56:38,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-05 14:56:38,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-05 14:56:38,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-05 14:56:38,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-05 14:56:38,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-05 14:56:38,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-05 14:56:38,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-05 14:56:38,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-05 14:56:38,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-05 14:56:38,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-05 14:56:38,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-05 14:56:38,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-05 14:56:38,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-05 14:56:38,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-05 14:56:38,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-05 14:56:38,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-05 14:56:38,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-05 14:56:38,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-05 14:56:38,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-05 14:56:38,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-05 14:56:38,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-05 14:56:38,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-05 14:56:38,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-05 14:56:38,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-05 14:56:38,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-05 14:56:38,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-05 14:56:38,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-05 14:56:38,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-05 14:56:38,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-05 14:56:38,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-05 14:56:38,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-05 14:56:38,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-05 14:56:38,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-05 14:56:38,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-05 14:56:38,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-05 14:56:38,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-05 14:56:38,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-05 14:56:38,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-05 14:56:38,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-05 14:56:38,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-05 14:56:38,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-05 14:56:38,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-05 14:56:38,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-05 14:56:38,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-05 14:56:38,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-05 14:56:38,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-05 14:56:38,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-05 14:56:38,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-05 14:56:38,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-05 14:56:38,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-05 14:56:38,399 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=1.8307982614094552E-5 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0019534423844256277); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-05 14:56:38,399 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv2140360277:82 , srv680766839:82 , srv1397483251:83 , srv1471006436:83 , srv253522757:83 , srv817308724:83 , srv1017137678:84 , srv1161546461:84 , srv1163556996:84 , srv1233940726:84 , srv1257122995:84 , srv1292142787:84 , srv1311180986:84 , srv1363016455:84 , srv1368301302:84 , srv1372536939:84 , srv1452257228:84 , srv1480213558:84 , srv1526859245:84 , srv1559737577:84 , srv158318715:84 , srv1609702441:84 , srv1710814311:84 , srv1714060278:84 , srv1746070047:84 , srv1795741334:84 , srv1803896708:84 , srv1823168406:84 , srv1921158298:84 , srv1923316563:84 , srv1931313575:84 , srv1938919:84 , srv203877165:84 , srv289139733:84 , srv306275007:84 , srv564528936:84 , srv630409948:84 , srv708946131:84 , srv736487473:84 , srv835541239:84 , srv882694611:84 , srv895872656:84 , srv907579147:84 , srv958940127:84 , srv101954737:85 , srv1061612511:85 , srv1075821014:85 , srv1116276564:85 , srv113144588:85 , srv1137631773:85 , srv1184145198:85 , srv1207209750:85 , srv1223217460:85 , srv1278794854:85 , srv1301375083:85 , srv1317500347:85 , srv1376703323:85 , srv1459593146:85 , srv1582609445:85 , srv162553273:85 , srv1627895315:85 , srv1671057020:85 , srv1717588404:85 , srv1727037628:85 , srv1730092446:85 , srv1754492278:85 , srv1782979938:85 , srv1817425930:85 , srv1861918974:85 , srv1902601727:85 , srv1905363185:85 , srv1915109962:85 , srv1927105716:85 , srv1943270916:85 , srv1978858092:85 , srv2076371991:85 , srv2086705621:85 , srv2094383611:85 , srv2118362314:85 , srv332999346:85 , srv479217872:85 , srv511120415:85 , srv581854775:85 , srv75026560:85 , srv763913680:85 , srv843011328:85 , srv898710000:85 , srv908992836:85 , srv939041409:85 , srv1158914934:86 , srv1162060233:86 , srv1280754023:86 , srv1407182332:86 , srv1447498472:86 , srv2013517097:86 , srv609236174:86 , srv721881269:86 , srv1327408754:87 , srv1818234276:87 , srv576034037:625 }
2023-04-05 14:56:38,425 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=486 (was 501), ProcessCount=170 (was 170), AvailableMemoryMB=1615 (was 2093)
2023-04-05 14:56:38,432 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=486, ProcessCount=170, AvailableMemoryMB=1618
2023-04-05 14:56:38,433 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-05 14:56:38,433 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-04-05 14:56:38,444 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1107249776:84 , srv1159430257:84 , srv1293657473:84 , srv1311409436:84 , srv1334604466:84 , srv1385760777:84 , srv1408908278:84 , srv1459287786:84 , srv1497807028:84 , srv1535470844:84 , srv1558659805:84 , srv1638808511:84 , srv1769684219:84 , srv1858767587:84 , srv1959547588:84 , srv1969143738:84 , srv2069676635:84 , srv250694053:84 , srv377365299:84 , srv480012529:84 , srv488414605:84 , srv498019306:84 , srv514522257:84 , srv571716971:84 , srv588087848:84 , srv636472733:84 , srv860513161:84 , srv925216309:84 , srv951408979:84 , srv321476341:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-04-05 14:56:38,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-05 14:56:38,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv498019306=22, srv1311409436=3, srv1969143738=15, srv2069676635=16, srv377365299=19, srv860513161=27, srv514522257=23, srv321476341=18, srv1159430257=1, srv1293657473=2, srv250694053=17, srv925216309=28, srv1459287786=7, srv1107249776=0, srv636472733=26, srv1334604466=4, srv1558659805=10, srv480012529=20, srv488414605=21, srv588087848=25, srv1858767587=13, srv571716971=24, srv1638808511=11, srv1497807028=8, srv1769684219=12, srv1535470844=9, srv1385760777=5, srv1959547588=14, srv1408908278=6, srv951408979=29} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-05 14:56:38,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-05 14:56:38,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-05 14:56:38,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-05 14:56:38,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-05 14:56:38,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-05 14:56:38,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-05 14:56:38,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-05 14:56:38,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-05 14:56:38,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-05 14:56:38,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-05 14:56:38,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-05 14:56:38,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-05 14:56:38,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-05 14:56:38,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-05 14:56:38,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-05 14:56:38,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-05 14:56:38,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-05 14:56:38,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-05 14:56:38,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-05 14:56:38,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-05 14:56:38,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-05 14:56:38,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-05 14:56:38,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-05 14:56:38,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-05 14:56:38,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-05 14:56:38,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-05 14:56:38,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-05 14:56:38,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-05 14:56:38,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-05 14:56:38,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-05 14:56:38,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-04-05 14:56:38,475 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1164787254683295, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-05 14:56:38,476 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.991256006392485, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1164787254683295, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-04-05 14:58:38,466 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5908778 different iterations.  Found a solution that moves 1870 regions; Going from a computed imbalance of 0.991256006392485 to a new imbalance of 4.3646732880327594E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6925925925925925, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-05 14:58:38,473 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1107249776:90 , srv1159430257:90 , srv1293657473:90 , srv1311409436:90 , srv1334604466:90 , srv1385760777:90 , srv1408908278:90 , srv1459287786:90 , srv1497807028:90 , srv1535470844:90 , srv1558659805:90 , srv1638808511:90 , srv1769684219:90 , srv1858767587:90 , srv1959547588:90 , srv1969143738:90 , srv2069676635:90 , srv250694053:90 , srv321476341:90 , srv377365299:90 , srv480012529:90 , srv488414605:90 , srv498019306:90 , srv514522257:90 , srv571716971:90 , srv588087848:90 , srv636472733:90 , srv860513161:90 , srv925216309:90 , srv951408979:90 }
2023-04-05 14:58:38,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-05 14:58:38,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv498019306=22, srv1311409436=3, srv1969143738=15, srv2069676635=16, srv377365299=19, srv860513161=27, srv514522257=23, srv321476341=18, srv1159430257=1, srv1293657473=2, srv250694053=17, srv925216309=28, srv1459287786=7, srv1107249776=0, srv636472733=26, srv1334604466=4, srv1558659805=10, srv480012529=20, srv488414605=21, srv588087848=25, srv1858767587=13, srv571716971=24, srv1638808511=11, srv1497807028=8, srv1769684219=12, srv1535470844=9, srv1385760777=5, srv1959547588=14, srv1408908278=6, srv951408979=29} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-05 14:58:38,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-05 14:58:38,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-05 14:58:38,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-05 14:58:38,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-05 14:58:38,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-05 14:58:38,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-05 14:58:38,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-05 14:58:38,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-05 14:58:38,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-05 14:58:38,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-05 14:58:38,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-05 14:58:38,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-05 14:58:38,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-05 14:58:38,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-05 14:58:38,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-05 14:58:38,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-05 14:58:38,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-05 14:58:38,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-05 14:58:38,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-05 14:58:38,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-05 14:58:38,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-05 14:58:38,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-05 14:58:38,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-05 14:58:38,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-05 14:58:38,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-05 14:58:38,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-05 14:58:38,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-05 14:58:38,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-05 14:58:38,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-05 14:58:38,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-05 14:58:38,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-04-05 14:58:38,497 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-05 14:58:38,497 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1107249776:90 , srv1159430257:90 , srv1293657473:90 , srv1311409436:90 , srv1334604466:90 , srv1385760777:90 , srv1408908278:90 , srv1459287786:90 , srv1497807028:90 , srv1535470844:90 , srv1558659805:90 , srv1638808511:90 , srv1769684219:90 , srv1858767587:90 , srv1959547588:90 , srv1969143738:90 , srv2069676635:90 , srv250694053:90 , srv321476341:90 , srv377365299:90 , srv480012529:90 , srv488414605:90 , srv498019306:90 , srv514522257:90 , srv571716971:90 , srv588087848:90 , srv636472733:90 , srv860513161:90 , srv925216309:90 , srv951408979:90 }
2023-04-05 14:58:38,511 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=9 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=257 (was 486), ProcessCount=170 (was 170), AvailableMemoryMB=1986 (was 1618) - AvailableMemoryMB LEAK? -