2023-04-06 20:03:25,303 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-04-06 20:03:25,578 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-04-06 20:03:25,673 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-04-06 20:03:25,725 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-06 20:03:25,732 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-04-06 20:03:25,742 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=133, ProcessCount=166, AvailableMemoryMB=4452
2023-04-06 20:03:25,744 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-06 20:03:25,744 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-04-06 20:03:25,865 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1018124988:84 , srv1038929634:84 , srv1042335791:84 , srv1051193109:84 , srv1134304730:84 , srv1135846405:84 , srv1139381026:84 , srv1142882389:84 , srv1153203045:84 , srv1191483811:84 , srv1197910104:84 , srv1217387153:84 , srv1233845994:84 , srv1257174692:84 , srv1259013337:84 , srv1378701764:84 , srv1413155860:84 , srv1425505754:84 , srv1444218048:84 , srv144685652:84 , srv1461848376:84 , srv1480839060:84 , srv1482362696:84 , srv1505325613:84 , srv154237056:84 , srv1582451280:84 , srv1602580706:84 , srv1624034144:84 , srv1626462396:84 , srv1628714970:84 , srv1646785811:84 , srv1650083938:84 , srv1655477269:84 , srv1716294845:84 , srv1750474229:84 , srv1766866817:84 , srv1772877938:84 , srv1795572560:84 , srv1816645501:84 , srv1826602891:84 , srv1875119427:84 , srv1888097983:84 , srv1922773099:84 , srv1930038896:84 , srv1945944733:84 , srv1947071269:84 , srv1985170786:84 , srv2021397478:84 , srv2029431996:84 , srv2030632749:84 , srv2035929967:84 , srv2036323398:84 , srv2037892577:84 , srv2072554744:84 , srv2075219913:84 , srv2099035431:84 , srv2105643095:84 , srv2116277276:84 , srv2119397421:84 , srv2121150561:84 , srv2123293047:84 , srv216764635:84 , srv243566377:84 , srv253760858:84 , srv278952067:84 , srv28398627:84 , srv289318109:84 , srv327080922:84 , srv339220233:84 , srv342112037:84 , srv348557052:84 , srv39659562:84 , srv410381411:84 , srv431521275:84 , srv444093384:84 , srv457297609:84 , srv468221100:84 , srv48913888:84 , srv521948054:84 , srv536637709:84 , srv573870400:84 , srv579900945:84 , srv61185647:84 , srv629501718:84 , srv645078803:84 , srv66032103:84 , srv692518543:84 , srv716592763:84 , srv731002160:84 , srv775432743:84 , srv781638819:84 , srv783057285:84 , srv793698909:84 , srv814978808:84 , srv821453056:84 , srv822755296:84 , srv880433418:84 , srv953819830:84 , srv968615175:84 , srv1288441709:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-04-06 20:03:25,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-06 20:03:25,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv253760858=64, srv1042335791=2, srv1816645501=39, srv1018124988=0, srv1772877938=37, srv1425505754=18, srv327080922=68, srv2037892577=53, srv692518543=87, srv1134304730=4, srv1139381026=6, srv1930038896=44, srv1257174692=13, srv243566377=63, srv1259013337=14, srv1922773099=43, srv457297609=76, srv1947071269=46, srv781638819=91, srv579900945=82, srv2036323398=52, srv1624034144=28, srv216764635=62, srv645078803=85, srv144685652=20, srv278952067=65, srv1582451280=26, srv154237056=25, srv536637709=80, srv1153203045=8, srv783057285=92, srv289318109=67, srv431521275=74, srv339220233=69, srv1038929634=1, srv1217387153=11, srv1378701764=16, srv793698909=93, srv1413155860=17, srv1985170786=47, srv1766866817=36, srv629501718=84, srv1505325613=24, srv342112037=70, srv2105643095=57, srv716592763=88, srv66032103=86, srv2121150561=60, srv2123293047=61, srv1888097983=42, srv2116277276=58, srv2075219913=55, srv1626462396=29, srv2030632749=50, srv1233845994=12, srv28398627=66, srv1461848376=21, srv2021397478=48, srv444093384=75, srv1945944733=45, srv2099035431=56, srv814978808=94, srv968615175=99, srv2119397421=59, srv1288441709=15, srv48913888=78, srv821453056=95, srv1191483811=9, srv1875119427=41, srv61185647=83, srv2072554744=54, srv1142882389=7, srv2029431996=49, srv1482362696=23, srv39659562=72, srv1650083938=32, srv410381411=73, srv521948054=79, srv348557052=71, srv1628714970=30, srv1750474229=35, srv1051193109=3, srv1716294845=34, srv468221100=77, srv1655477269=33, srv1795572560=38, srv775432743=90, srv953819830=98, srv1197910104=10, srv1444218048=19, srv1480839060=22, srv1602580706=27, srv2035929967=51, srv880433418=97, srv573870400=81, srv1135846405=5, srv1826602891=40, srv731002160=89, srv1646785811=31, srv822755296=96} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-06 20:03:25,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-06 20:03:25,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-06 20:03:25,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-06 20:03:25,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-06 20:03:25,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-06 20:03:25,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-06 20:03:25,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-06 20:03:25,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-06 20:03:25,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-06 20:03:25,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-06 20:03:25,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-06 20:03:25,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-06 20:03:25,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-06 20:03:25,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-06 20:03:25,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-06 20:03:25,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-06 20:03:25,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-06 20:03:25,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-06 20:03:25,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-06 20:03:25,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-06 20:03:25,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-06 20:03:25,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-06 20:03:25,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-06 20:03:25,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-06 20:03:25,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-06 20:03:25,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-06 20:03:25,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-06 20:03:25,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-06 20:03:25,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-06 20:03:25,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-06 20:03:25,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-06 20:03:25,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-06 20:03:25,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-06 20:03:25,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-06 20:03:25,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-06 20:03:25,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-06 20:03:25,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-06 20:03:25,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-06 20:03:25,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-06 20:03:25,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-06 20:03:25,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-06 20:03:25,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-06 20:03:25,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-06 20:03:25,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-06 20:03:25,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-06 20:03:25,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-06 20:03:25,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-06 20:03:25,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-06 20:03:25,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-06 20:03:25,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-06 20:03:25,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-06 20:03:25,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-06 20:03:25,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-06 20:03:25,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-06 20:03:25,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-06 20:03:25,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-06 20:03:25,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-06 20:03:25,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-06 20:03:25,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-06 20:03:25,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-06 20:03:25,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-06 20:03:25,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-06 20:03:25,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-06 20:03:25,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-06 20:03:25,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-06 20:03:25,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-06 20:03:25,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-06 20:03:25,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-06 20:03:25,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-06 20:03:25,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-06 20:03:25,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-06 20:03:25,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-06 20:03:25,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-06 20:03:25,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-06 20:03:25,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-06 20:03:25,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-06 20:03:25,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-06 20:03:25,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-06 20:03:25,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-06 20:03:25,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-06 20:03:25,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-06 20:03:25,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-06 20:03:25,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-06 20:03:25,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-06 20:03:25,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-06 20:03:25,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-06 20:03:25,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-06 20:03:25,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-06 20:03:25,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-06 20:03:25,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-06 20:03:25,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-06 20:03:25,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-06 20:03:25,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-06 20:03:25,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-06 20:03:25,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-06 20:03:25,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-06 20:03:25,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-06 20:03:25,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-06 20:03:25,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-06 20:03:25,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-06 20:03:25,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-06 20:03:26,096 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-06 20:03:26,096 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-06 20:03:26,097 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-06 20:03:26,305 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 312 ms to try 5000 different iterations.  Found a solution that moves 4747 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17268778830927303. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03983536389297637, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05827486247053352, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5274444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03983536389297637, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.16733333333333333, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23941666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-06 20:03:26,326 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv28398627:81 , srv1134304730:82 , srv1191483811:82 , srv1233845994:82 , srv2099035431:82 , srv781638819:82 , srv144685652:83 , srv1461848376:83 , srv1750474229:83 , srv348557052:83 , srv66032103:83 , srv953819830:83 , srv1142882389:84 , srv1197910104:84 , srv1217387153:84 , srv1259013337:84 , srv1505325613:84 , srv1624034144:84 , srv1716294845:84 , srv2116277276:84 , srv444093384:84 , srv468221100:84 , srv579900945:84 , srv775432743:84 , srv1018124988:85 , srv1051193109:85 , srv1139381026:85 , srv1153203045:85 , srv1257174692:85 , srv1582451280:85 , srv1655477269:85 , srv1772877938:85 , srv1922773099:85 , srv1947071269:85 , srv48913888:85 , srv793698909:85 , srv880433418:85 , srv1378701764:86 , srv1795572560:86 , srv1985170786:86 , srv2029431996:86 , srv2030632749:86 , srv2035929967:86 , srv2037892577:86 , srv2072554744:86 , srv216764635:86 , srv327080922:86 , srv339220233:86 , srv342112037:86 , srv410381411:86 , srv692518543:86 , srv783057285:86 , srv822755296:86 , srv1038929634:87 , srv1425505754:87 , srv1480839060:87 , srv1482362696:87 , srv154237056:87 , srv1626462396:87 , srv1628714970:87 , srv1875119427:87 , srv2105643095:87 , srv2119397421:87 , srv39659562:87 , srv431521275:87 , srv645078803:87 , srv716592763:87 , srv1042335791:88 , srv1646785811:88 , srv1766866817:88 , srv1888097983:88 , srv2075219913:88 , srv2123293047:88 , srv243566377:88 , srv253760858:88 , srv278952067:88 , srv457297609:88 , srv814978808:88 , srv968615175:88 , srv1602580706:89 , srv1650083938:89 , srv1930038896:89 , srv1945944733:89 , srv2021397478:89 , srv289318109:89 , srv61185647:89 , srv731002160:89 , srv1135846405:90 , srv1444218048:90 , srv1826602891:90 , srv2036323398:90 , srv521948054:90 , srv536637709:90 , srv629501718:90 , srv1413155860:91 , srv1816645501:91 , srv573870400:91 , srv821453056:94 , srv2121150561:95 , srv1288441709:444 }
2023-04-06 20:03:26,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-06 20:03:26,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv253760858=64, srv1042335791=2, srv1816645501=39, srv1018124988=0, srv1772877938=37, srv1425505754=18, srv327080922=68, srv2037892577=53, srv692518543=87, srv1134304730=4, srv1139381026=6, srv1930038896=44, srv1257174692=13, srv243566377=63, srv1259013337=14, srv1922773099=43, srv457297609=76, srv1947071269=46, srv781638819=91, srv579900945=82, srv2036323398=52, srv1624034144=28, srv216764635=62, srv645078803=85, srv144685652=20, srv278952067=65, srv1582451280=26, srv154237056=25, srv536637709=80, srv1153203045=8, srv783057285=92, srv289318109=67, srv431521275=74, srv339220233=69, srv1038929634=1, srv1217387153=11, srv1378701764=16, srv793698909=93, srv1413155860=17, srv1985170786=47, srv1766866817=36, srv629501718=84, srv1505325613=24, srv342112037=70, srv2105643095=57, srv716592763=88, srv66032103=86, srv2121150561=60, srv2123293047=61, srv1888097983=42, srv2116277276=58, srv2075219913=55, srv1626462396=29, srv2030632749=50, srv1233845994=12, srv28398627=66, srv1461848376=21, srv2021397478=48, srv444093384=75, srv1945944733=45, srv2099035431=56, srv814978808=94, srv968615175=99, srv2119397421=59, srv1288441709=15, srv48913888=78, srv821453056=95, srv1191483811=9, srv1875119427=41, srv61185647=83, srv2072554744=54, srv1142882389=7, srv2029431996=49, srv1482362696=23, srv39659562=72, srv1650083938=32, srv410381411=73, srv521948054=79, srv348557052=71, srv1628714970=30, srv1750474229=35, srv1051193109=3, srv1716294845=34, srv468221100=77, srv1655477269=33, srv1795572560=38, srv775432743=90, srv953819830=98, srv1197910104=10, srv1444218048=19, srv1480839060=22, srv1602580706=27, srv2035929967=51, srv880433418=97, srv573870400=81, srv1135846405=5, srv1826602891=40, srv731002160=89, srv1646785811=31, srv822755296=96} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-06 20:03:26,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-06 20:03:26,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-06 20:03:26,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-06 20:03:26,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-06 20:03:26,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-06 20:03:26,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-06 20:03:26,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-06 20:03:26,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-06 20:03:26,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-06 20:03:26,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-06 20:03:26,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-06 20:03:26,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-06 20:03:26,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-06 20:03:26,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-06 20:03:26,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-06 20:03:26,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-06 20:03:26,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-06 20:03:26,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-06 20:03:26,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-06 20:03:26,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-06 20:03:26,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-06 20:03:26,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-06 20:03:26,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-06 20:03:26,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-06 20:03:26,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-06 20:03:26,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-06 20:03:26,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-06 20:03:26,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-06 20:03:26,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-06 20:03:26,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-06 20:03:26,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-06 20:03:26,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-06 20:03:26,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-06 20:03:26,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-06 20:03:26,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-06 20:03:26,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-06 20:03:26,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-06 20:03:26,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-06 20:03:26,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-06 20:03:26,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-06 20:03:26,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-06 20:03:26,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-06 20:03:26,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-06 20:03:26,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-06 20:03:26,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-06 20:03:26,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-06 20:03:26,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-06 20:03:26,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-06 20:03:26,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-06 20:03:26,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-06 20:03:26,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-06 20:03:26,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-06 20:03:26,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-06 20:03:26,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-06 20:03:26,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-06 20:03:26,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-06 20:03:26,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-06 20:03:26,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-06 20:03:26,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-06 20:03:26,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-06 20:03:26,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-06 20:03:26,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-06 20:03:26,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-06 20:03:26,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-06 20:03:26,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-06 20:03:26,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-06 20:03:26,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-06 20:03:26,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-06 20:03:26,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-06 20:03:26,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-06 20:03:26,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-06 20:03:26,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-06 20:03:26,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-06 20:03:26,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-06 20:03:26,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-06 20:03:26,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-06 20:03:26,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-06 20:03:26,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-06 20:03:26,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-06 20:03:26,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-06 20:03:26,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-06 20:03:26,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-06 20:03:26,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-06 20:03:26,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-06 20:03:26,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-06 20:03:26,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-06 20:03:26,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-06 20:03:26,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-06 20:03:26,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-06 20:03:26,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-06 20:03:26,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-06 20:03:26,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-06 20:03:26,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-06 20:03:26,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-06 20:03:26,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-06 20:03:26,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-06 20:03:26,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-06 20:03:26,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-06 20:03:26,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-06 20:03:26,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-06 20:03:26,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-06 20:03:26,499 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03983536389297637, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05827486247053352, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03983536389297637, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.16733333333333333, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23941666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-06 20:03:26,500 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-06 20:03:26,500 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17265454910483727, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03983536389297637, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05827486247053352, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03983536389297637, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.16733333333333333, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23941666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-06 20:03:26,715 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 339 ms to try 5000 different iterations.  Found a solution that moves 2578 regions; Going from a computed imbalance of 0.17265454910483727 to a new imbalance of 0.015192735389087775. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022273229899833658); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03728435941236115, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.28644444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022273229899833658); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04633333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-06 20:03:26,725 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv2121150561:77 , srv821453056:78 , srv1816645501:80 , srv536637709:80 , srv573870400:80 , srv1135846405:81 , srv1413155860:81 , srv1650083938:81 , srv1826602891:81 , srv629501718:81 , srv731002160:81 , srv1930038896:82 , srv2036323398:82 , srv61185647:82 , srv1042335791:83 , srv1444218048:83 , srv1480839060:83 , srv1602580706:83 , srv1766866817:83 , srv1945944733:83 , srv2105643095:83 , srv243566377:83 , srv289318109:83 , srv521948054:83 , srv1378701764:84 , srv1646785811:84 , srv1888097983:84 , srv2021397478:84 , srv2119397421:84 , srv2123293047:84 , srv645078803:84 , srv814978808:84 , srv1139381026:85 , srv1425505754:85 , srv154237056:85 , srv1875119427:85 , srv1922773099:85 , srv1985170786:85 , srv2030632749:85 , srv2072554744:85 , srv253760858:85 , srv278952067:85 , srv39659562:85 , srv457297609:85 , srv692518543:85 , srv822755296:85 , srv968615175:85 , srv1217387153:86 , srv1482362696:86 , srv1795572560:86 , srv2035929967:86 , srv2037892577:86 , srv2116277276:86 , srv342112037:86 , srv431521275:86 , srv716592763:86 , srv1018124988:87 , srv1038929634:87 , srv1051193109:87 , srv1153203045:87 , srv1197910104:87 , srv1259013337:87 , srv1582451280:87 , srv1626462396:87 , srv1655477269:87 , srv1716294845:87 , srv1772877938:87 , srv2029431996:87 , srv2075219913:87 , srv216764635:87 , srv339220233:87 , srv444093384:87 , srv468221100:87 , srv48913888:87 , srv775432743:87 , srv1233845994:88 , srv1257174692:88 , srv1505325613:88 , srv1624034144:88 , srv1628714970:88 , srv1750474229:88 , srv410381411:88 , srv783057285:88 , srv793698909:88 , srv880433418:88 , srv1134304730:89 , srv1142882389:89 , srv1191483811:89 , srv144685652:89 , srv327080922:89 , srv579900945:89 , srv66032103:89 , srv953819830:89 , srv348557052:90 , srv781638819:90 , srv1461848376:92 , srv2099035431:92 , srv28398627:92 , srv1947071269:93 , srv1288441709:528 }
2023-04-06 20:03:26,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-06 20:03:26,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv253760858=64, srv1042335791=2, srv1816645501=39, srv1018124988=0, srv1772877938=37, srv1425505754=18, srv327080922=68, srv2037892577=53, srv692518543=87, srv1134304730=4, srv1139381026=6, srv1930038896=44, srv1257174692=13, srv243566377=63, srv1259013337=14, srv1922773099=43, srv457297609=76, srv1947071269=46, srv781638819=91, srv579900945=82, srv2036323398=52, srv1624034144=28, srv216764635=62, srv645078803=85, srv144685652=20, srv278952067=65, srv1582451280=26, srv154237056=25, srv536637709=80, srv1153203045=8, srv783057285=92, srv289318109=67, srv431521275=74, srv339220233=69, srv1038929634=1, srv1217387153=11, srv1378701764=16, srv793698909=93, srv1413155860=17, srv1985170786=47, srv1766866817=36, srv629501718=84, srv1505325613=24, srv342112037=70, srv2105643095=57, srv716592763=88, srv66032103=86, srv2121150561=60, srv2123293047=61, srv1888097983=42, srv2116277276=58, srv2075219913=55, srv1626462396=29, srv2030632749=50, srv1233845994=12, srv28398627=66, srv1461848376=21, srv2021397478=48, srv444093384=75, srv1945944733=45, srv2099035431=56, srv814978808=94, srv968615175=99, srv2119397421=59, srv1288441709=15, srv48913888=78, srv821453056=95, srv1191483811=9, srv1875119427=41, srv61185647=83, srv2072554744=54, srv1142882389=7, srv2029431996=49, srv1482362696=23, srv39659562=72, srv1650083938=32, srv410381411=73, srv521948054=79, srv348557052=71, srv1628714970=30, srv1750474229=35, srv1051193109=3, srv1716294845=34, srv468221100=77, srv1655477269=33, srv1795572560=38, srv775432743=90, srv953819830=98, srv1197910104=10, srv1444218048=19, srv1480839060=22, srv1602580706=27, srv2035929967=51, srv880433418=97, srv573870400=81, srv1135846405=5, srv1826602891=40, srv731002160=89, srv1646785811=31, srv822755296=96} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-06 20:03:26,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-06 20:03:26,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-06 20:03:26,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-06 20:03:26,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-06 20:03:26,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-06 20:03:26,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-06 20:03:26,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-06 20:03:26,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-06 20:03:26,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-06 20:03:26,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-06 20:03:26,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-06 20:03:26,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-06 20:03:26,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-06 20:03:26,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-06 20:03:26,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-06 20:03:26,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-06 20:03:26,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-06 20:03:26,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-06 20:03:26,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-06 20:03:26,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-06 20:03:26,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-06 20:03:26,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-06 20:03:26,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-06 20:03:26,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-06 20:03:26,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-06 20:03:26,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-06 20:03:26,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-06 20:03:26,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-06 20:03:26,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-06 20:03:26,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-06 20:03:26,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-06 20:03:26,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-06 20:03:26,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-06 20:03:26,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-06 20:03:26,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-06 20:03:26,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-06 20:03:26,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-06 20:03:26,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-06 20:03:26,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-06 20:03:26,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-06 20:03:26,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-06 20:03:26,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-06 20:03:26,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-06 20:03:26,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-06 20:03:26,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-06 20:03:26,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-06 20:03:26,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-06 20:03:26,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-06 20:03:26,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-06 20:03:26,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-06 20:03:26,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-06 20:03:26,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-06 20:03:26,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-06 20:03:26,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-06 20:03:26,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-06 20:03:26,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-06 20:03:26,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-06 20:03:26,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-06 20:03:26,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-06 20:03:26,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-06 20:03:26,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-06 20:03:26,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-06 20:03:26,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-06 20:03:26,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-06 20:03:26,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-06 20:03:26,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-06 20:03:26,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-06 20:03:26,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-06 20:03:26,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-06 20:03:26,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-06 20:03:26,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-06 20:03:26,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-06 20:03:26,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-06 20:03:26,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-06 20:03:26,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-06 20:03:26,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-06 20:03:26,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-06 20:03:26,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-06 20:03:26,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-06 20:03:26,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-06 20:03:26,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-06 20:03:26,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-06 20:03:26,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-06 20:03:26,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-06 20:03:26,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-06 20:03:26,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-06 20:03:26,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-06 20:03:26,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-06 20:03:26,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-06 20:03:26,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-06 20:03:26,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-06 20:03:26,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-06 20:03:26,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-06 20:03:26,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-06 20:03:26,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-06 20:03:26,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-06 20:03:26,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-06 20:03:26,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-06 20:03:26,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-06 20:03:26,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-06 20:03:26,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-06 20:03:26,846 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022273229899833658); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03728435941236115, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022273229899833658); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04633333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-06 20:03:26,847 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-06 20:03:26,847 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.015174683847264435, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022273229899833658); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03728435941236115, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022273229899833658); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04633333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-06 20:03:27,040 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 274 ms to try 5000 different iterations.  Found a solution that moves 969 regions; Going from a computed imbalance of 0.015174683847264435 to a new imbalance of 6.746186903312016E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0060960430498352425); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010172474468514046); MoveCostFunction : (multiplier=7.0, imbalance=0.10766666666666666, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0060960430498352425); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004083333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-06 20:03:27,042 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1947071269:79 , srv2075219913:82 , srv327080922:82 , srv1461848376:83 , srv1626462396:83 , srv2099035431:83 , srv1038929634:84 , srv1142882389:84 , srv1444218048:84 , srv144685652:84 , srv216764635:84 , srv28398627:84 , srv348557052:84 , srv410381411:84 , srv457297609:84 , srv521948054:84 , srv579900945:84 , srv783057285:84 , srv880433418:84 , srv968615175:84 , srv1018124988:85 , srv1051193109:85 , srv1257174692:85 , srv1413155860:85 , srv1482362696:85 , srv1505325613:85 , srv154237056:85 , srv1602580706:85 , srv1628714970:85 , srv1646785811:85 , srv1772877938:85 , srv1875119427:85 , srv1888097983:85 , srv2021397478:85 , srv2029431996:85 , srv2035929967:85 , srv2123293047:85 , srv253760858:85 , srv278952067:85 , srv339220233:85 , srv431521275:85 , srv48913888:85 , srv716592763:85 , srv781638819:85 , srv793698909:85 , srv814978808:85 , srv821453056:85 , srv1042335791:86 , srv1134304730:86 , srv1135846405:86 , srv1153203045:86 , srv1197910104:86 , srv1425505754:86 , srv1582451280:86 , srv1624034144:86 , srv1655477269:86 , srv1716294845:86 , srv1750474229:86 , srv1816645501:86 , srv1826602891:86 , srv1945944733:86 , srv1985170786:86 , srv2030632749:86 , srv2036323398:86 , srv2037892577:86 , srv2072554744:86 , srv2119397421:86 , srv2121150561:86 , srv243566377:86 , srv289318109:86 , srv342112037:86 , srv39659562:86 , srv444093384:86 , srv61185647:86 , srv645078803:86 , srv66032103:86 , srv692518543:86 , srv822755296:86 , srv953819830:86 , srv1191483811:87 , srv1217387153:87 , srv1233845994:87 , srv1259013337:87 , srv1480839060:87 , srv1766866817:87 , srv1795572560:87 , srv1922773099:87 , srv1930038896:87 , srv2105643095:87 , srv468221100:87 , srv573870400:87 , srv629501718:87 , srv731002160:87 , srv775432743:87 , srv1139381026:88 , srv1378701764:88 , srv1650083938:88 , srv2116277276:88 , srv536637709:88 , srv1288441709:540 }
2023-04-06 20:03:27,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-06 20:03:27,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv253760858=64, srv1042335791=2, srv1816645501=39, srv1018124988=0, srv1772877938=37, srv1425505754=18, srv327080922=68, srv2037892577=53, srv692518543=87, srv1134304730=4, srv1139381026=6, srv1930038896=44, srv1257174692=13, srv243566377=63, srv1259013337=14, srv1922773099=43, srv457297609=76, srv1947071269=46, srv781638819=91, srv579900945=82, srv2036323398=52, srv1624034144=28, srv216764635=62, srv645078803=85, srv144685652=20, srv278952067=65, srv1582451280=26, srv154237056=25, srv536637709=80, srv1153203045=8, srv783057285=92, srv289318109=67, srv431521275=74, srv339220233=69, srv1038929634=1, srv1217387153=11, srv1378701764=16, srv793698909=93, srv1413155860=17, srv1985170786=47, srv1766866817=36, srv629501718=84, srv1505325613=24, srv342112037=70, srv2105643095=57, srv716592763=88, srv66032103=86, srv2121150561=60, srv2123293047=61, srv1888097983=42, srv2116277276=58, srv2075219913=55, srv1626462396=29, srv2030632749=50, srv1233845994=12, srv28398627=66, srv1461848376=21, srv2021397478=48, srv444093384=75, srv1945944733=45, srv2099035431=56, srv814978808=94, srv968615175=99, srv2119397421=59, srv1288441709=15, srv48913888=78, srv821453056=95, srv1191483811=9, srv1875119427=41, srv61185647=83, srv2072554744=54, srv1142882389=7, srv2029431996=49, srv1482362696=23, srv39659562=72, srv1650083938=32, srv410381411=73, srv521948054=79, srv348557052=71, srv1628714970=30, srv1750474229=35, srv1051193109=3, srv1716294845=34, srv468221100=77, srv1655477269=33, srv1795572560=38, srv775432743=90, srv953819830=98, srv1197910104=10, srv1444218048=19, srv1480839060=22, srv1602580706=27, srv2035929967=51, srv880433418=97, srv573870400=81, srv1135846405=5, srv1826602891=40, srv731002160=89, srv1646785811=31, srv822755296=96} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-06 20:03:27,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-06 20:03:27,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-06 20:03:27,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-06 20:03:27,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-06 20:03:27,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-06 20:03:27,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-06 20:03:27,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-06 20:03:27,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-06 20:03:27,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-06 20:03:27,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-06 20:03:27,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-06 20:03:27,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-06 20:03:27,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-06 20:03:27,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-06 20:03:27,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-06 20:03:27,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-06 20:03:27,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-06 20:03:27,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-06 20:03:27,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-06 20:03:27,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-06 20:03:27,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-06 20:03:27,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-06 20:03:27,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-06 20:03:27,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-06 20:03:27,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-06 20:03:27,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-06 20:03:27,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-06 20:03:27,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-06 20:03:27,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-06 20:03:27,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-06 20:03:27,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-06 20:03:27,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-06 20:03:27,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-06 20:03:27,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-06 20:03:27,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-06 20:03:27,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-06 20:03:27,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-06 20:03:27,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-06 20:03:27,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-06 20:03:27,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-06 20:03:27,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-06 20:03:27,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-06 20:03:27,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-06 20:03:27,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-06 20:03:27,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-06 20:03:27,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-06 20:03:27,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-06 20:03:27,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-06 20:03:27,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-06 20:03:27,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-06 20:03:27,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-06 20:03:27,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-06 20:03:27,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-06 20:03:27,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-06 20:03:27,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-06 20:03:27,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-06 20:03:27,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-06 20:03:27,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-06 20:03:27,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-06 20:03:27,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-06 20:03:27,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-06 20:03:27,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-06 20:03:27,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-06 20:03:27,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-06 20:03:27,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-06 20:03:27,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-06 20:03:27,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-06 20:03:27,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-06 20:03:27,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-06 20:03:27,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-06 20:03:27,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-06 20:03:27,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-06 20:03:27,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-06 20:03:27,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-06 20:03:27,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-06 20:03:27,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-06 20:03:27,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-06 20:03:27,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-06 20:03:27,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-06 20:03:27,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-06 20:03:27,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-06 20:03:27,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-06 20:03:27,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-06 20:03:27,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-06 20:03:27,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-06 20:03:27,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-06 20:03:27,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-06 20:03:27,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-06 20:03:27,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-06 20:03:27,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-06 20:03:27,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-06 20:03:27,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-06 20:03:27,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-06 20:03:27,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-06 20:03:27,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-06 20:03:27,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-06 20:03:27,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-06 20:03:27,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-06 20:03:27,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-06 20:03:27,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-06 20:03:27,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-06 20:03:27,149 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0060960430498352425); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010172474468514046); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0060960430498352425); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004083333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-06 20:03:27,149 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-06 20:03:27,150 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=6.678336073107143E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0060960430498352425); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010172474468514046); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0060960430498352425); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004083333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-06 20:03:27,334 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 256 ms to try 5000 different iterations.  Found a solution that moves 253 regions; Going from a computed imbalance of 6.678336073107143E-4 to a new imbalance of 2.8106216610837467E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002010075630518424); MoveCostFunction : (multiplier=7.0, imbalance=0.02811111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-06 20:03:27,335 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1628714970:83 , srv1795572560:83 , srv253760858:83 , srv1038929634:84 , srv1139381026:84 , srv1142882389:84 , srv1153203045:84 , srv1191483811:84 , srv1257174692:84 , srv1259013337:84 , srv1413155860:84 , srv1425505754:84 , srv1461848376:84 , srv1482362696:84 , srv1582451280:84 , srv1602580706:84 , srv1624034144:84 , srv1650083938:84 , srv1655477269:84 , srv1750474229:84 , srv1766866817:84 , srv1816645501:84 , srv1930038896:84 , srv1945944733:84 , srv2021397478:84 , srv2029431996:84 , srv2036323398:84 , srv2037892577:84 , srv2116277276:84 , srv278952067:84 , srv289318109:84 , srv339220233:84 , srv342112037:84 , srv39659562:84 , srv410381411:84 , srv431521275:84 , srv468221100:84 , srv521948054:84 , srv536637709:84 , srv61185647:84 , srv645078803:84 , srv66032103:84 , srv716592763:84 , srv775432743:84 , srv783057285:84 , srv953819830:84 , srv1018124988:85 , srv1042335791:85 , srv1051193109:85 , srv1134304730:85 , srv1135846405:85 , srv1197910104:85 , srv1217387153:85 , srv1233845994:85 , srv1378701764:85 , srv1444218048:85 , srv1480839060:85 , srv1505325613:85 , srv154237056:85 , srv1626462396:85 , srv1646785811:85 , srv1716294845:85 , srv1826602891:85 , srv1875119427:85 , srv1888097983:85 , srv1922773099:85 , srv1985170786:85 , srv2030632749:85 , srv2035929967:85 , srv2072554744:85 , srv2075219913:85 , srv2099035431:85 , srv2105643095:85 , srv2119397421:85 , srv2121150561:85 , srv2123293047:85 , srv243566377:85 , srv28398627:85 , srv327080922:85 , srv348557052:85 , srv444093384:85 , srv457297609:85 , srv48913888:85 , srv573870400:85 , srv579900945:85 , srv629501718:85 , srv692518543:85 , srv731002160:85 , srv781638819:85 , srv793698909:85 , srv814978808:85 , srv821453056:85 , srv822755296:85 , srv880433418:85 , srv968615175:85 , srv144685652:86 , srv1772877938:86 , srv1947071269:86 , srv216764635:86 , srv1288441709:630 }
2023-04-06 20:03:27,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-06 20:03:27,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv253760858=64, srv1042335791=2, srv1816645501=39, srv1018124988=0, srv1772877938=37, srv1425505754=18, srv327080922=68, srv2037892577=53, srv692518543=87, srv1134304730=4, srv1139381026=6, srv1930038896=44, srv1257174692=13, srv243566377=63, srv1259013337=14, srv1922773099=43, srv457297609=76, srv1947071269=46, srv781638819=91, srv579900945=82, srv2036323398=52, srv1624034144=28, srv216764635=62, srv645078803=85, srv144685652=20, srv278952067=65, srv1582451280=26, srv154237056=25, srv536637709=80, srv1153203045=8, srv783057285=92, srv289318109=67, srv431521275=74, srv339220233=69, srv1038929634=1, srv1217387153=11, srv1378701764=16, srv793698909=93, srv1413155860=17, srv1985170786=47, srv1766866817=36, srv629501718=84, srv1505325613=24, srv342112037=70, srv2105643095=57, srv716592763=88, srv66032103=86, srv2121150561=60, srv2123293047=61, srv1888097983=42, srv2116277276=58, srv2075219913=55, srv1626462396=29, srv2030632749=50, srv1233845994=12, srv28398627=66, srv1461848376=21, srv2021397478=48, srv444093384=75, srv1945944733=45, srv2099035431=56, srv814978808=94, srv968615175=99, srv2119397421=59, srv1288441709=15, srv48913888=78, srv821453056=95, srv1191483811=9, srv1875119427=41, srv61185647=83, srv2072554744=54, srv1142882389=7, srv2029431996=49, srv1482362696=23, srv39659562=72, srv1650083938=32, srv410381411=73, srv521948054=79, srv348557052=71, srv1628714970=30, srv1750474229=35, srv1051193109=3, srv1716294845=34, srv468221100=77, srv1655477269=33, srv1795572560=38, srv775432743=90, srv953819830=98, srv1197910104=10, srv1444218048=19, srv1480839060=22, srv1602580706=27, srv2035929967=51, srv880433418=97, srv573870400=81, srv1135846405=5, srv1826602891=40, srv731002160=89, srv1646785811=31, srv822755296=96} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-06 20:03:27,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-06 20:03:27,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-06 20:03:27,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-06 20:03:27,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-06 20:03:27,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-06 20:03:27,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-06 20:03:27,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-06 20:03:27,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-06 20:03:27,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-06 20:03:27,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-06 20:03:27,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-06 20:03:27,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-06 20:03:27,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-06 20:03:27,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-06 20:03:27,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-06 20:03:27,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-06 20:03:27,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-06 20:03:27,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-06 20:03:27,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-06 20:03:27,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-06 20:03:27,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-06 20:03:27,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-06 20:03:27,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-06 20:03:27,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-06 20:03:27,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-06 20:03:27,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-06 20:03:27,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-06 20:03:27,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-06 20:03:27,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-06 20:03:27,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-06 20:03:27,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-06 20:03:27,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-06 20:03:27,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-06 20:03:27,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-06 20:03:27,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-06 20:03:27,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-06 20:03:27,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-06 20:03:27,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-06 20:03:27,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-06 20:03:27,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-06 20:03:27,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-06 20:03:27,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-06 20:03:27,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-06 20:03:27,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-06 20:03:27,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-06 20:03:27,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-06 20:03:27,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-06 20:03:27,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-06 20:03:27,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-06 20:03:27,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-06 20:03:27,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-06 20:03:27,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-06 20:03:27,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-06 20:03:27,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-06 20:03:27,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-06 20:03:27,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-06 20:03:27,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-06 20:03:27,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-06 20:03:27,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-06 20:03:27,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-06 20:03:27,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-06 20:03:27,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-06 20:03:27,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-06 20:03:27,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-06 20:03:27,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-06 20:03:27,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-06 20:03:27,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-06 20:03:27,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-06 20:03:27,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-06 20:03:27,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-06 20:03:27,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-06 20:03:27,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-06 20:03:27,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-06 20:03:27,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-06 20:03:27,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-06 20:03:27,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-06 20:03:27,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-06 20:03:27,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-06 20:03:27,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-06 20:03:27,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-06 20:03:27,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-06 20:03:27,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-06 20:03:27,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-06 20:03:27,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-06 20:03:27,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-06 20:03:27,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-06 20:03:27,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-06 20:03:27,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-06 20:03:27,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-06 20:03:27,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-06 20:03:27,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-06 20:03:27,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-06 20:03:27,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-06 20:03:27,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-06 20:03:27,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-06 20:03:27,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-06 20:03:27,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-06 20:03:27,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-06 20:03:27,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-06 20:03:27,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-06 20:03:27,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-06 20:03:27,431 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002010075630518424); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-06 20:03:27,431 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-06 20:03:27,432 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.6334672746871227E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002010075630518424); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-06 20:03:27,587 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 228 ms to try 5000 different iterations.  Found a solution that moves 28 regions; Going from a computed imbalance of 2.6334672746871227E-5 to a new imbalance of 6.594045862748175E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014213381090374027); MoveCostFunction : (multiplier=7.0, imbalance=0.003111111111111111); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-06 20:03:27,588 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1378701764:83 , srv1628714970:83 , srv1772877938:83 , srv1947071269:83 , srv2121150561:83 , srv216764635:83 , srv573870400:83 , srv629501718:83 , srv793698909:83 , srv1018124988:84 , srv1038929634:84 , srv1042335791:84 , srv1051193109:84 , srv1134304730:84 , srv1135846405:84 , srv1139381026:84 , srv1153203045:84 , srv1191483811:84 , srv1197910104:84 , srv1217387153:84 , srv1233845994:84 , srv1257174692:84 , srv1259013337:84 , srv1425505754:84 , srv1444218048:84 , srv144685652:84 , srv1461848376:84 , srv1480839060:84 , srv1482362696:84 , srv1505325613:84 , srv154237056:84 , srv1582451280:84 , srv1624034144:84 , srv1626462396:84 , srv1646785811:84 , srv1650083938:84 , srv1655477269:84 , srv1716294845:84 , srv1766866817:84 , srv1795572560:84 , srv1826602891:84 , srv1875119427:84 , srv1888097983:84 , srv1922773099:84 , srv1930038896:84 , srv1945944733:84 , srv1985170786:84 , srv2021397478:84 , srv2029431996:84 , srv2030632749:84 , srv2035929967:84 , srv2036323398:84 , srv2037892577:84 , srv2072554744:84 , srv2075219913:84 , srv2099035431:84 , srv2105643095:84 , srv2116277276:84 , srv2119397421:84 , srv2123293047:84 , srv243566377:84 , srv278952067:84 , srv28398627:84 , srv289318109:84 , srv327080922:84 , srv339220233:84 , srv342112037:84 , srv348557052:84 , srv39659562:84 , srv410381411:84 , srv431521275:84 , srv444093384:84 , srv457297609:84 , srv468221100:84 , srv48913888:84 , srv536637709:84 , srv579900945:84 , srv66032103:84 , srv692518543:84 , srv716592763:84 , srv731002160:84 , srv775432743:84 , srv781638819:84 , srv783057285:84 , srv814978808:84 , srv821453056:84 , srv822755296:84 , srv880433418:84 , srv953819830:84 , srv968615175:84 , srv1142882389:85 , srv1413155860:85 , srv1602580706:85 , srv1750474229:85 , srv1816645501:85 , srv253760858:85 , srv521948054:85 , srv61185647:85 , srv645078803:85 , srv1288441709:684 }
2023-04-06 20:03:27,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-06 20:03:27,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv253760858=64, srv1042335791=2, srv1816645501=39, srv1018124988=0, srv1772877938=37, srv1425505754=18, srv327080922=68, srv2037892577=53, srv692518543=87, srv1134304730=4, srv1139381026=6, srv1930038896=44, srv1257174692=13, srv243566377=63, srv1259013337=14, srv1922773099=43, srv457297609=76, srv1947071269=46, srv781638819=91, srv579900945=82, srv2036323398=52, srv1624034144=28, srv216764635=62, srv645078803=85, srv144685652=20, srv278952067=65, srv1582451280=26, srv154237056=25, srv536637709=80, srv1153203045=8, srv783057285=92, srv289318109=67, srv431521275=74, srv339220233=69, srv1038929634=1, srv1217387153=11, srv1378701764=16, srv793698909=93, srv1413155860=17, srv1985170786=47, srv1766866817=36, srv629501718=84, srv1505325613=24, srv342112037=70, srv2105643095=57, srv716592763=88, srv66032103=86, srv2121150561=60, srv2123293047=61, srv1888097983=42, srv2116277276=58, srv2075219913=55, srv1626462396=29, srv2030632749=50, srv1233845994=12, srv28398627=66, srv1461848376=21, srv2021397478=48, srv444093384=75, srv1945944733=45, srv2099035431=56, srv814978808=94, srv968615175=99, srv2119397421=59, srv1288441709=15, srv48913888=78, srv821453056=95, srv1191483811=9, srv1875119427=41, srv61185647=83, srv2072554744=54, srv1142882389=7, srv2029431996=49, srv1482362696=23, srv39659562=72, srv1650083938=32, srv410381411=73, srv521948054=79, srv348557052=71, srv1628714970=30, srv1750474229=35, srv1051193109=3, srv1716294845=34, srv468221100=77, srv1655477269=33, srv1795572560=38, srv775432743=90, srv953819830=98, srv1197910104=10, srv1444218048=19, srv1480839060=22, srv1602580706=27, srv2035929967=51, srv880433418=97, srv573870400=81, srv1135846405=5, srv1826602891=40, srv731002160=89, srv1646785811=31, srv822755296=96} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-06 20:03:27,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-06 20:03:27,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-06 20:03:27,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-06 20:03:27,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-06 20:03:27,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-06 20:03:27,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-06 20:03:27,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-06 20:03:27,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-06 20:03:27,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-06 20:03:27,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-06 20:03:27,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-06 20:03:27,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-06 20:03:27,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-06 20:03:27,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-06 20:03:27,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-06 20:03:27,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-06 20:03:27,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-06 20:03:27,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-06 20:03:27,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-06 20:03:27,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-06 20:03:27,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-06 20:03:27,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-06 20:03:27,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-06 20:03:27,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-06 20:03:27,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-06 20:03:27,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-06 20:03:27,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-06 20:03:27,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-06 20:03:27,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-06 20:03:27,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-06 20:03:27,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-06 20:03:27,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-06 20:03:27,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-06 20:03:27,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-06 20:03:27,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-06 20:03:27,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-06 20:03:27,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-06 20:03:27,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-06 20:03:27,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-06 20:03:27,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-06 20:03:27,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-06 20:03:27,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-06 20:03:27,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-06 20:03:27,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-06 20:03:27,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-06 20:03:27,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-06 20:03:27,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-06 20:03:27,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-06 20:03:27,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-06 20:03:27,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-06 20:03:27,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-06 20:03:27,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-06 20:03:27,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-06 20:03:27,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-06 20:03:27,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-06 20:03:27,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-06 20:03:27,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-06 20:03:27,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-06 20:03:27,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-06 20:03:27,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-06 20:03:27,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-06 20:03:27,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-06 20:03:27,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-06 20:03:27,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-06 20:03:27,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-06 20:03:27,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-06 20:03:27,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-06 20:03:27,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-06 20:03:27,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-06 20:03:27,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-06 20:03:27,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-06 20:03:27,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-06 20:03:27,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-06 20:03:27,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-06 20:03:27,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-06 20:03:27,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-06 20:03:27,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-06 20:03:27,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-06 20:03:27,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-06 20:03:27,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-06 20:03:27,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-06 20:03:27,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-06 20:03:27,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-06 20:03:27,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-06 20:03:27,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-06 20:03:27,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-06 20:03:27,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-06 20:03:27,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-06 20:03:27,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-06 20:03:27,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-06 20:03:27,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-06 20:03:27,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-06 20:03:27,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-06 20:03:27,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-06 20:03:27,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-06 20:03:27,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-06 20:03:27,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-06 20:03:27,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-06 20:03:27,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-06 20:03:27,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-06 20:03:27,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-06 20:03:27,682 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=6.397985672269699E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014213381090374027); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-06 20:03:27,683 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1378701764:83 , srv1628714970:83 , srv1772877938:83 , srv1947071269:83 , srv2121150561:83 , srv216764635:83 , srv573870400:83 , srv629501718:83 , srv793698909:83 , srv1018124988:84 , srv1038929634:84 , srv1042335791:84 , srv1051193109:84 , srv1134304730:84 , srv1135846405:84 , srv1139381026:84 , srv1153203045:84 , srv1191483811:84 , srv1197910104:84 , srv1217387153:84 , srv1233845994:84 , srv1257174692:84 , srv1259013337:84 , srv1425505754:84 , srv1444218048:84 , srv144685652:84 , srv1461848376:84 , srv1480839060:84 , srv1482362696:84 , srv1505325613:84 , srv154237056:84 , srv1582451280:84 , srv1624034144:84 , srv1626462396:84 , srv1646785811:84 , srv1650083938:84 , srv1655477269:84 , srv1716294845:84 , srv1766866817:84 , srv1795572560:84 , srv1826602891:84 , srv1875119427:84 , srv1888097983:84 , srv1922773099:84 , srv1930038896:84 , srv1945944733:84 , srv1985170786:84 , srv2021397478:84 , srv2029431996:84 , srv2030632749:84 , srv2035929967:84 , srv2036323398:84 , srv2037892577:84 , srv2072554744:84 , srv2075219913:84 , srv2099035431:84 , srv2105643095:84 , srv2116277276:84 , srv2119397421:84 , srv2123293047:84 , srv243566377:84 , srv278952067:84 , srv28398627:84 , srv289318109:84 , srv327080922:84 , srv339220233:84 , srv342112037:84 , srv348557052:84 , srv39659562:84 , srv410381411:84 , srv431521275:84 , srv444093384:84 , srv457297609:84 , srv468221100:84 , srv48913888:84 , srv536637709:84 , srv579900945:84 , srv66032103:84 , srv692518543:84 , srv716592763:84 , srv731002160:84 , srv775432743:84 , srv781638819:84 , srv783057285:84 , srv814978808:84 , srv821453056:84 , srv822755296:84 , srv880433418:84 , srv953819830:84 , srv968615175:84 , srv1142882389:85 , srv1413155860:85 , srv1602580706:85 , srv1750474229:85 , srv1816645501:85 , srv253760858:85 , srv521948054:85 , srv61185647:85 , srv645078803:85 , srv1288441709:684 }
2023-04-06 20:03:27,703 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=139 (was 133) - SystemLoadAverage LEAK? -, ProcessCount=166 (was 166), AvailableMemoryMB=3960 (was 4452)
2023-04-06 20:03:27,709 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=139, ProcessCount=166, AvailableMemoryMB=3960
2023-04-06 20:03:27,710 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-06 20:03:27,710 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-04-06 20:03:27,719 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1002265143:84 , srv1108591154:84 , srv1127710507:84 , srv1128312009:84 , srv1157770460:84 , srv1163851420:84 , srv1175979636:84 , srv1218501479:84 , srv1261415803:84 , srv1335529106:84 , srv1531958547:84 , srv1534107917:84 , srv1699470050:84 , srv181624335:84 , srv1874151782:84 , srv1959185704:84 , srv1984928217:84 , srv1999089437:84 , srv2003715434:84 , srv2059030738:84 , srv2080599684:84 , srv2120435487:84 , srv261143908:84 , srv343987277:84 , srv464180556:84 , srv585488401:84 , srv639289927:84 , srv803250177:84 , srv899986059:84 , srv1375973953:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-04-06 20:03:27,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-06 20:03:27,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1157770460=4, srv2080599684=21, srv1699470050=13, srv1984928217=17, srv1531958547=11, srv1108591154=1, srv1163851420=5, srv1959185704=16, srv2120435487=22, srv1261415803=8, srv1874151782=15, srv1335529106=9, srv261143908=23, srv1375973953=10, srv2003715434=19, srv181624335=14, srv343987277=24, srv464180556=25, srv1127710507=2, srv585488401=26, srv1175979636=6, srv803250177=28, srv1999089437=18, srv1002265143=0, srv1218501479=7, srv899986059=29, srv1128312009=3, srv1534107917=12, srv2059030738=20, srv639289927=27} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-06 20:03:27,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-06 20:03:27,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-06 20:03:27,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-06 20:03:27,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-06 20:03:27,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-06 20:03:27,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-06 20:03:27,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-06 20:03:27,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-06 20:03:27,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-06 20:03:27,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-06 20:03:27,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-06 20:03:27,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-06 20:03:27,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-06 20:03:27,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-06 20:03:27,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-06 20:03:27,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-06 20:03:27,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-06 20:03:27,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-06 20:03:27,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-06 20:03:27,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-06 20:03:27,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-06 20:03:27,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-06 20:03:27,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-06 20:03:27,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-06 20:03:27,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-06 20:03:27,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-06 20:03:27,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-06 20:03:27,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-06 20:03:27,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-06 20:03:27,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-06 20:03:27,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-04-06 20:03:27,750 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.122749815107666, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-06 20:03:27,750 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912579823923534, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.122749815107666, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-04-06 20:05:27,739 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 9277624 different iterations.  Found a solution that moves 1844 regions; Going from a computed imbalance of 0.9912579823923534 to a new imbalance of 4.303987990979898E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.682962962962963, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-06 20:05:27,745 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1002265143:90 , srv1108591154:90 , srv1127710507:90 , srv1128312009:90 , srv1157770460:90 , srv1163851420:90 , srv1175979636:90 , srv1218501479:90 , srv1261415803:90 , srv1335529106:90 , srv1375973953:90 , srv1531958547:90 , srv1534107917:90 , srv1699470050:90 , srv181624335:90 , srv1874151782:90 , srv1959185704:90 , srv1984928217:90 , srv1999089437:90 , srv2003715434:90 , srv2059030738:90 , srv2080599684:90 , srv2120435487:90 , srv261143908:90 , srv343987277:90 , srv464180556:90 , srv585488401:90 , srv639289927:90 , srv803250177:90 , srv899986059:90 }
2023-04-06 20:05:27,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-06 20:05:27,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1157770460=4, srv2080599684=21, srv1699470050=13, srv1984928217=17, srv1531958547=11, srv1108591154=1, srv1163851420=5, srv1959185704=16, srv2120435487=22, srv1261415803=8, srv1874151782=15, srv1335529106=9, srv261143908=23, srv1375973953=10, srv2003715434=19, srv181624335=14, srv343987277=24, srv464180556=25, srv1127710507=2, srv585488401=26, srv1175979636=6, srv803250177=28, srv1999089437=18, srv1002265143=0, srv1218501479=7, srv899986059=29, srv1128312009=3, srv1534107917=12, srv2059030738=20, srv639289927=27} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-06 20:05:27,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-06 20:05:27,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-06 20:05:27,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-06 20:05:27,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-06 20:05:27,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-06 20:05:27,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-06 20:05:27,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-06 20:05:27,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-06 20:05:27,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-06 20:05:27,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-06 20:05:27,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-06 20:05:27,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-06 20:05:27,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-06 20:05:27,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-06 20:05:27,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-06 20:05:27,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-06 20:05:27,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-06 20:05:27,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-06 20:05:27,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-06 20:05:27,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-06 20:05:27,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-06 20:05:27,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-06 20:05:27,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-06 20:05:27,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-06 20:05:27,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-06 20:05:27,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-06 20:05:27,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-06 20:05:27,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-06 20:05:27,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-06 20:05:27,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-06 20:05:27,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-04-06 20:05:27,764 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-06 20:05:27,764 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1002265143:90 , srv1108591154:90 , srv1127710507:90 , srv1128312009:90 , srv1157770460:90 , srv1163851420:90 , srv1175979636:90 , srv1218501479:90 , srv1261415803:90 , srv1335529106:90 , srv1375973953:90 , srv1531958547:90 , srv1534107917:90 , srv1699470050:90 , srv181624335:90 , srv1874151782:90 , srv1959185704:90 , srv1984928217:90 , srv1999089437:90 , srv2003715434:90 , srv2059030738:90 , srv2080599684:90 , srv2120435487:90 , srv261143908:90 , srv343987277:90 , srv464180556:90 , srv585488401:90 , srv639289927:90 , srv803250177:90 , srv899986059:90 }
2023-04-06 20:05:27,776 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=9 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=154 (was 139) - SystemLoadAverage LEAK? -, ProcessCount=165 (was 166), AvailableMemoryMB=4010 (was 3960) - AvailableMemoryMB LEAK? -