2023-02-21 10:53:59,102 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-02-21 10:53:59,456 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-02-21 10:53:59,585 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-02-21 10:53:59,652 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-02-21 10:53:59,660 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-02-21 10:53:59,673 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=302, ProcessCount=172, AvailableMemoryMB=6226
2023-02-21 10:53:59,675 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-02-21 10:53:59,675 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-02-21 10:53:59,797 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1030250218:84 , srv1042995049:84 , srv1075677111:84 , srv1114699897:84 , srv1118057474:84 , srv1140850764:84 , srv1154692692:84 , srv1168221267:84 , srv118152944:84 , srv1194582436:84 , srv1231474104:84 , srv1240321576:84 , srv1271843523:84 , srv1285756283:84 , srv1297787959:84 , srv1311954907:84 , srv1321406044:84 , srv1327825847:84 , srv1391377997:84 , srv1391539774:84 , srv1402888998:84 , srv1411236830:84 , srv1451556653:84 , srv1459032638:84 , srv1460294301:84 , srv1501593808:84 , srv1516352214:84 , srv1524898521:84 , srv1581403645:84 , srv1617100679:84 , srv1653518024:84 , srv1659758630:84 , srv1685944642:84 , srv1694288636:84 , srv1702878041:84 , srv1731246517:84 , srv1737387325:84 , srv1742721450:84 , srv177711894:84 , srv179067690:84 , srv1817475182:84 , srv182001663:84 , srv1838985676:84 , srv1847709343:84 , srv1885074600:84 , srv190074795:84 , srv1906241128:84 , srv1940727652:84 , srv1956686785:84 , srv1959199068:84 , srv1997869299:84 , srv2032698429:84 , srv2044637749:84 , srv2057416333:84 , srv2082441624:84 , srv2084745774:84 , srv224866896:84 , srv226020418:84 , srv239827233:84 , srv245333289:84 , srv28727386:84 , srv327002158:84 , srv38601442:84 , srv431409185:84 , srv431471014:84 , srv499574904:84 , srv499639608:84 , srv506649128:84 , srv545693669:84 , srv550139816:84 , srv595072780:84 , srv621459552:84 , srv624316833:84 , srv654403858:84 , srv657851405:84 , srv673127028:84 , srv673963604:84 , srv699989428:84 , srv703060532:84 , srv716910029:84 , srv726548631:84 , srv731794269:84 , srv748788125:84 , srv767335932:84 , srv787976204:84 , srv798904812:84 , srv817726427:84 , srv835534409:84 , srv840899829:84 , srv86897783:84 , srv892073221:84 , srv902523410:84 , srv903036133:84 , srv912636444:84 , srv913156128:84 , srv91782939:84 , srv925120977:84 , srv964412739:84 , srv968069391:84 , srv1846089114:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-02-21 10:53:59,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-21 10:53:59,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv224866896=57, srv654403858=74, srv716910029=80, srv239827233=59, srv1271843523=12, srv1321406044=16, srv1694288636=33, srv1659758630=31, srv817726427=87, srv1154692692=6, srv1997869299=51, srv38601442=63, srv1240321576=11, srv1847709343=44, srv1391539774=19, srv1297787959=14, srv1459032638=23, srv1959199068=50, srv1114699897=3, srv1906241128=47, srv902523410=92, srv1391377997=18, srv1742721450=37, srv431409185=64, srv182001663=41, srv177711894=38, srv892073221=91, srv1817475182=40, srv86897783=90, srv703060532=79, srv964412739=98, srv506649128=68, srv1581403645=28, srv1140850764=5, srv748788125=83, srv2057416333=54, srv624316833=73, srv903036133=93, srv1311954907=15, srv621459552=72, srv1411236830=21, srv1737387325=36, srv91782939=96, srv1846089114=43, srv1194582436=9, srv499574904=66, srv1885074600=45, srv726548631=81, srv913156128=95, srv835534409=88, srv118152944=8, srv499639608=67, srv798904812=86, srv968069391=99, srv2044637749=53, srv1451556653=22, srv179067690=39, srv767335932=84, srv1460294301=24, srv731794269=82, srv912636444=94, srv2084745774=56, srv226020418=58, srv431471014=65, srv1042995049=1, srv1956686785=49, srv1685944642=32, srv657851405=75, srv1285756283=13, srv699989428=78, srv1940727652=48, srv190074795=46, srv925120977=97, srv1524898521=27, srv673963604=77, srv595072780=71, srv1617100679=29, srv1653518024=30, srv1516352214=26, srv1118057474=4, srv1327825847=17, srv1702878041=34, srv2032698429=52, srv673127028=76, srv550139816=70, srv840899829=89, srv1168221267=7, srv1231474104=10, srv245333289=60, srv787976204=85, srv2082441624=55, srv327002158=62, srv1838985676=42, srv1731246517=35, srv1075677111=2, srv1402888998=20, srv28727386=61, srv545693669=69, srv1501593808=25, srv1030250218=0} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-21 10:53:59,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-21 10:53:59,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-21 10:53:59,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-21 10:53:59,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-21 10:53:59,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-21 10:53:59,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-21 10:53:59,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-21 10:53:59,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-21 10:53:59,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-21 10:53:59,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-21 10:53:59,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-21 10:53:59,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-21 10:53:59,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-21 10:53:59,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-21 10:53:59,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-21 10:53:59,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-21 10:53:59,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-21 10:53:59,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-21 10:53:59,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-21 10:53:59,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-21 10:53:59,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-21 10:53:59,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-21 10:53:59,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-21 10:53:59,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-21 10:53:59,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-21 10:53:59,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-21 10:53:59,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-21 10:53:59,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-21 10:53:59,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-21 10:53:59,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-21 10:53:59,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-21 10:53:59,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-21 10:53:59,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-21 10:53:59,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-21 10:53:59,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-21 10:53:59,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-21 10:53:59,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-21 10:53:59,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-21 10:53:59,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-21 10:53:59,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-21 10:53:59,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-21 10:53:59,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-21 10:53:59,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-21 10:53:59,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-21 10:53:59,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-21 10:53:59,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-21 10:53:59,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-21 10:53:59,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-21 10:53:59,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-21 10:53:59,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-21 10:53:59,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-21 10:53:59,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-21 10:53:59,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-21 10:53:59,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-21 10:53:59,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-21 10:53:59,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-21 10:53:59,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-21 10:53:59,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-21 10:53:59,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-21 10:53:59,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-21 10:53:59,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-21 10:53:59,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-21 10:53:59,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-21 10:53:59,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-21 10:53:59,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-21 10:53:59,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-21 10:53:59,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-21 10:53:59,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-21 10:53:59,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-21 10:53:59,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-21 10:53:59,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-21 10:53:59,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-21 10:53:59,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-21 10:53:59,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-21 10:53:59,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-21 10:53:59,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-21 10:53:59,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-21 10:53:59,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-21 10:53:59,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-21 10:53:59,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-21 10:53:59,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-21 10:53:59,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-21 10:53:59,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-21 10:53:59,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-21 10:53:59,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-21 10:53:59,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-21 10:53:59,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-21 10:53:59,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-21 10:53:59,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-21 10:53:59,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-21 10:53:59,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-21 10:53:59,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-21 10:53:59,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-21 10:53:59,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-21 10:53:59,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-21 10:53:59,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-21 10:53:59,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-21 10:53:59,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-21 10:53:59,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-21 10:53:59,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-21 10:53:59,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-21 10:54:00,082 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-21 10:54:00,083 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-02-21 10:54:00,083 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-02-21 10:54:00,394 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 452 ms to try 5000 different iterations.  Found a solution that moves 4701 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18289050486482009. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04155356891606366, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05641556566571602, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5223333333333333, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04155356891606366, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17808333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24525, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-21 10:54:00,405 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv726548631:80 , srv1194582436:81 , srv1685944642:81 , srv1817475182:81 , srv673963604:81 , srv1847709343:82 , srv1997869299:82 , srv1285756283:83 , srv1402888998:83 , srv1451556653:83 , srv1956686785:83 , srv2057416333:83 , srv621459552:83 , srv624316833:83 , srv716910029:83 , srv1231474104:84 , srv1297787959:84 , srv1516352214:84 , srv1524898521:84 , srv1737387325:84 , srv1885074600:84 , srv190074795:84 , srv1959199068:84 , srv431471014:84 , srv499639608:84 , srv903036133:84 , srv1154692692:85 , srv1311954907:85 , srv1411236830:85 , srv1501593808:85 , srv1653518024:85 , srv1742721450:85 , srv1838985676:85 , srv1940727652:85 , srv2032698429:85 , srv224866896:85 , srv226020418:85 , srv506649128:85 , srv545693669:85 , srv699989428:85 , srv748788125:85 , srv798904812:85 , srv913156128:85 , srv964412739:85 , srv1075677111:86 , srv1459032638:86 , srv1581403645:86 , srv182001663:86 , srv2084745774:86 , srv431409185:86 , srv654403858:86 , srv703060532:86 , srv731794269:86 , srv817726427:86 , srv835534409:86 , srv902523410:86 , srv1030250218:87 , srv1042995049:87 , srv1240321576:87 , srv1321406044:87 , srv1460294301:87 , srv1694288636:87 , srv1702878041:87 , srv1731246517:87 , srv239827233:87 , srv28727386:87 , srv327002158:87 , srv38601442:87 , srv673127028:87 , srv840899829:87 , srv912636444:87 , srv91782939:87 , srv1118057474:88 , srv1140850764:88 , srv1168221267:88 , srv1271843523:88 , srv1391377997:88 , srv1617100679:88 , srv177711894:88 , srv595072780:88 , srv925120977:88 , srv1327825847:89 , srv1659758630:89 , srv1906241128:89 , srv2044637749:89 , srv245333289:89 , srv767335932:89 , srv86897783:89 , srv499574904:90 , srv550139816:90 , srv1114699897:91 , srv118152944:91 , srv2082441624:91 , srv657851405:91 , srv179067690:92 , srv892073221:92 , srv787976204:93 , srv1391539774:97 , srv968069391:98 , srv1846089114:459 }
2023-02-21 10:54:00,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-21 10:54:00,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv224866896=57, srv654403858=74, srv716910029=80, srv239827233=59, srv1271843523=12, srv1321406044=16, srv1694288636=33, srv1659758630=31, srv817726427=87, srv1154692692=6, srv1997869299=51, srv38601442=63, srv1240321576=11, srv1847709343=44, srv1391539774=19, srv1297787959=14, srv1459032638=23, srv1959199068=50, srv1114699897=3, srv1906241128=47, srv902523410=92, srv1391377997=18, srv1742721450=37, srv431409185=64, srv182001663=41, srv177711894=38, srv892073221=91, srv1817475182=40, srv86897783=90, srv703060532=79, srv964412739=98, srv506649128=68, srv1581403645=28, srv1140850764=5, srv748788125=83, srv2057416333=54, srv624316833=73, srv903036133=93, srv1311954907=15, srv621459552=72, srv1411236830=21, srv1737387325=36, srv91782939=96, srv1846089114=43, srv1194582436=9, srv499574904=66, srv1885074600=45, srv726548631=81, srv913156128=95, srv835534409=88, srv118152944=8, srv499639608=67, srv798904812=86, srv968069391=99, srv2044637749=53, srv1451556653=22, srv179067690=39, srv767335932=84, srv1460294301=24, srv731794269=82, srv912636444=94, srv2084745774=56, srv226020418=58, srv431471014=65, srv1042995049=1, srv1956686785=49, srv1685944642=32, srv657851405=75, srv1285756283=13, srv699989428=78, srv1940727652=48, srv190074795=46, srv925120977=97, srv1524898521=27, srv673963604=77, srv595072780=71, srv1617100679=29, srv1653518024=30, srv1516352214=26, srv1118057474=4, srv1327825847=17, srv1702878041=34, srv2032698429=52, srv673127028=76, srv550139816=70, srv840899829=89, srv1168221267=7, srv1231474104=10, srv245333289=60, srv787976204=85, srv2082441624=55, srv327002158=62, srv1838985676=42, srv1731246517=35, srv1075677111=2, srv1402888998=20, srv28727386=61, srv545693669=69, srv1501593808=25, srv1030250218=0} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-21 10:54:00,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-21 10:54:00,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-21 10:54:00,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-21 10:54:00,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-21 10:54:00,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-21 10:54:00,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-21 10:54:00,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-21 10:54:00,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-21 10:54:00,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-21 10:54:00,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-21 10:54:00,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-21 10:54:00,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-21 10:54:00,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-21 10:54:00,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-21 10:54:00,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-21 10:54:00,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-21 10:54:00,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-21 10:54:00,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-21 10:54:00,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-21 10:54:00,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-21 10:54:00,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-21 10:54:00,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-21 10:54:00,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-21 10:54:00,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-21 10:54:00,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-21 10:54:00,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-21 10:54:00,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-21 10:54:00,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-21 10:54:00,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-21 10:54:00,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-21 10:54:00,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-21 10:54:00,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-21 10:54:00,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-21 10:54:00,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-21 10:54:00,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-21 10:54:00,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-21 10:54:00,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-21 10:54:00,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-21 10:54:00,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-21 10:54:00,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-21 10:54:00,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-21 10:54:00,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-21 10:54:00,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-21 10:54:00,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-21 10:54:00,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-21 10:54:00,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-21 10:54:00,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-21 10:54:00,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-21 10:54:00,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-21 10:54:00,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-21 10:54:00,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-21 10:54:00,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-21 10:54:00,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-21 10:54:00,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-21 10:54:00,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-21 10:54:00,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-21 10:54:00,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-21 10:54:00,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-21 10:54:00,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-21 10:54:00,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-21 10:54:00,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-21 10:54:00,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-21 10:54:00,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-21 10:54:00,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-21 10:54:00,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-21 10:54:00,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-21 10:54:00,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-21 10:54:00,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-21 10:54:00,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-21 10:54:00,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-21 10:54:00,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-21 10:54:00,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-21 10:54:00,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-21 10:54:00,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-21 10:54:00,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-21 10:54:00,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-21 10:54:00,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-21 10:54:00,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-21 10:54:00,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-21 10:54:00,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-21 10:54:00,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-21 10:54:00,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-21 10:54:00,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-21 10:54:00,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-21 10:54:00,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-21 10:54:00,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-21 10:54:00,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-21 10:54:00,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-21 10:54:00,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-21 10:54:00,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-21 10:54:00,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-21 10:54:00,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-21 10:54:00,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-21 10:54:00,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-21 10:54:00,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-21 10:54:00,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-21 10:54:00,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-21 10:54:00,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-21 10:54:00,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-21 10:54:00,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-21 10:54:00,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-21 10:54:00,543 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04155356891606366, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05641556566571602, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04155356891606366, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17808333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24525, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-21 10:54:00,543 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-02-21 10:54:00,544 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.1828575877592687, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04155356891606366, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05641556566571602, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04155356891606366, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17808333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24525, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-02-21 10:54:00,829 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 387 ms to try 5000 different iterations.  Found a solution that moves 2643 regions; Going from a computed imbalance of 0.1828575877592687 to a new imbalance of 0.01575809741456368. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020591696320393097); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.029579924638825708, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2936666666666667, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020591696320393097); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01275); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04475, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-21 10:54:00,843 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1391539774:73 , srv968069391:73 , srv787976204:79 , srv657851405:80 , srv86897783:80 , srv179067690:81 , srv2044637749:81 , srv892073221:81 , srv118152944:82 , srv1617100679:82 , srv245333289:82 , srv499574904:82 , srv767335932:82 , srv1114699897:83 , srv1140850764:83 , srv1271843523:83 , srv1460294301:83 , srv925120977:83 , srv1118057474:84 , srv1168221267:84 , srv1327825847:84 , srv1659758630:84 , srv1906241128:84 , srv2082441624:84 , srv38601442:84 , srv550139816:84 , srv902523410:84 , srv1030250218:85 , srv1042995049:85 , srv1240321576:85 , srv1694288636:85 , srv1731246517:85 , srv1742721450:85 , srv182001663:85 , srv2032698429:85 , srv239827233:85 , srv595072780:85 , srv912636444:85 , srv913156128:85 , srv1459032638:86 , srv1702878041:86 , srv177711894:86 , srv1838985676:86 , srv190074795:86 , srv28727386:86 , srv431409185:86 , srv654403858:86 , srv903036133:86 , srv91782939:86 , srv1075677111:87 , srv1154692692:87 , srv1231474104:87 , srv1297787959:87 , srv1321406044:87 , srv1391377997:87 , srv1501593808:87 , srv1516352214:87 , srv1581403645:87 , srv1653518024:87 , srv1959199068:87 , srv327002158:87 , srv545693669:87 , srv673127028:87 , srv703060532:87 , srv731794269:87 , srv798904812:87 , srv817726427:87 , srv840899829:87 , srv964412739:87 , srv1285756283:88 , srv1311954907:88 , srv1411236830:88 , srv1885074600:88 , srv1940727652:88 , srv1956686785:88 , srv2057416333:88 , srv2084745774:88 , srv224866896:88 , srv431471014:88 , srv506649128:88 , srv624316833:88 , srv699989428:88 , srv748788125:88 , srv835534409:88 , srv1524898521:89 , srv1685944642:89 , srv1847709343:89 , srv226020418:89 , srv499639608:89 , srv1402888998:90 , srv1817475182:90 , srv716910029:90 , srv1194582436:91 , srv1451556653:91 , srv1737387325:91 , srv1997869299:91 , srv621459552:91 , srv726548631:91 , srv673963604:92 , srv1846089114:498 }
2023-02-21 10:54:00,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-21 10:54:00,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv224866896=57, srv654403858=74, srv716910029=80, srv239827233=59, srv1271843523=12, srv1321406044=16, srv1694288636=33, srv1659758630=31, srv817726427=87, srv1154692692=6, srv1997869299=51, srv38601442=63, srv1240321576=11, srv1847709343=44, srv1391539774=19, srv1297787959=14, srv1459032638=23, srv1959199068=50, srv1114699897=3, srv1906241128=47, srv902523410=92, srv1391377997=18, srv1742721450=37, srv431409185=64, srv182001663=41, srv177711894=38, srv892073221=91, srv1817475182=40, srv86897783=90, srv703060532=79, srv964412739=98, srv506649128=68, srv1581403645=28, srv1140850764=5, srv748788125=83, srv2057416333=54, srv624316833=73, srv903036133=93, srv1311954907=15, srv621459552=72, srv1411236830=21, srv1737387325=36, srv91782939=96, srv1846089114=43, srv1194582436=9, srv499574904=66, srv1885074600=45, srv726548631=81, srv913156128=95, srv835534409=88, srv118152944=8, srv499639608=67, srv798904812=86, srv968069391=99, srv2044637749=53, srv1451556653=22, srv179067690=39, srv767335932=84, srv1460294301=24, srv731794269=82, srv912636444=94, srv2084745774=56, srv226020418=58, srv431471014=65, srv1042995049=1, srv1956686785=49, srv1685944642=32, srv657851405=75, srv1285756283=13, srv699989428=78, srv1940727652=48, srv190074795=46, srv925120977=97, srv1524898521=27, srv673963604=77, srv595072780=71, srv1617100679=29, srv1653518024=30, srv1516352214=26, srv1118057474=4, srv1327825847=17, srv1702878041=34, srv2032698429=52, srv673127028=76, srv550139816=70, srv840899829=89, srv1168221267=7, srv1231474104=10, srv245333289=60, srv787976204=85, srv2082441624=55, srv327002158=62, srv1838985676=42, srv1731246517=35, srv1075677111=2, srv1402888998=20, srv28727386=61, srv545693669=69, srv1501593808=25, srv1030250218=0} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-21 10:54:00,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-21 10:54:00,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-21 10:54:00,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-21 10:54:00,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-21 10:54:00,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-21 10:54:00,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-21 10:54:00,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-21 10:54:00,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-21 10:54:00,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-21 10:54:00,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-21 10:54:00,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-21 10:54:00,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-21 10:54:00,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-21 10:54:00,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-21 10:54:00,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-21 10:54:00,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-21 10:54:00,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-21 10:54:00,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-21 10:54:00,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-21 10:54:00,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-21 10:54:00,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-21 10:54:00,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-21 10:54:00,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-21 10:54:00,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-21 10:54:00,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-21 10:54:00,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-21 10:54:00,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-21 10:54:00,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-21 10:54:00,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-21 10:54:00,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-21 10:54:00,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-21 10:54:00,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-21 10:54:00,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-21 10:54:00,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-21 10:54:00,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-21 10:54:00,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-21 10:54:00,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-21 10:54:00,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-21 10:54:00,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-21 10:54:00,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-21 10:54:00,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-21 10:54:00,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-21 10:54:00,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-21 10:54:00,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-21 10:54:00,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-21 10:54:00,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-21 10:54:00,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-21 10:54:00,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-21 10:54:00,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-21 10:54:00,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-21 10:54:00,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-21 10:54:00,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-21 10:54:00,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-21 10:54:00,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-21 10:54:00,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-21 10:54:00,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-21 10:54:00,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-21 10:54:00,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-21 10:54:00,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-21 10:54:00,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-21 10:54:00,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-21 10:54:00,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-21 10:54:00,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-21 10:54:00,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-21 10:54:00,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-21 10:54:00,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-21 10:54:00,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-21 10:54:00,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-21 10:54:00,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-21 10:54:00,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-21 10:54:00,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-21 10:54:00,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-21 10:54:00,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-21 10:54:00,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-21 10:54:00,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-21 10:54:00,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-21 10:54:00,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-21 10:54:00,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-21 10:54:00,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-21 10:54:00,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-21 10:54:00,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-21 10:54:00,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-21 10:54:00,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-21 10:54:00,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-21 10:54:00,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-21 10:54:00,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-21 10:54:00,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-21 10:54:00,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-21 10:54:00,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-21 10:54:00,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-21 10:54:00,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-21 10:54:00,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-21 10:54:00,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-21 10:54:00,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-21 10:54:00,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-21 10:54:00,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-21 10:54:00,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-21 10:54:00,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-21 10:54:00,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-21 10:54:00,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-21 10:54:00,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-21 10:54:01,017 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020591696320393097); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.029579924638825708, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020591696320393097); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01275); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04475, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-21 10:54:01,017 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-02-21 10:54:01,017 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.015739590733012444, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020591696320393097); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.029579924638825708, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020591696320393097); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01275); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04475, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-02-21 10:54:01,273 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 359 ms to try 5000 different iterations.  Found a solution that moves 987 regions; Going from a computed imbalance of 0.015739590733012444 to a new imbalance of 0.0012564647598245907. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006091950371931928); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007741618689438271); MoveCostFunction : (multiplier=7.0, imbalance=0.10966666666666666, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006091950371931928); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333334E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004833333333333334); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-21 10:54:01,275 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1737387325:82 , srv2082441624:82 , srv1114699897:83 , srv1391377997:83 , srv1451556653:83 , srv1940727652:83 , srv2084745774:83 , srv226020418:83 , srv550139816:83 , srv673127028:83 , srv840899829:83 , srv1311954907:84 , srv1321406044:84 , srv1411236830:84 , srv1524898521:84 , srv1581403645:84 , srv177711894:84 , srv179067690:84 , srv1997869299:84 , srv224866896:84 , srv28727386:84 , srv327002158:84 , srv499639608:84 , srv506649128:84 , srv621459552:84 , srv699989428:84 , srv703060532:84 , srv716910029:84 , srv892073221:84 , srv1075677111:85 , srv1154692692:85 , srv118152944:85 , srv1240321576:85 , srv1327825847:85 , srv1402888998:85 , srv1659758630:85 , srv1694288636:85 , srv1702878041:85 , srv1731246517:85 , srv1885074600:85 , srv1906241128:85 , srv239827233:85 , srv431409185:85 , srv431471014:85 , srv545693669:85 , srv595072780:85 , srv654403858:85 , srv673963604:85 , srv731794269:85 , srv748788125:85 , srv817726427:85 , srv835534409:85 , srv912636444:85 , srv91782939:85 , srv1030250218:86 , srv1042995049:86 , srv1118057474:86 , srv1168221267:86 , srv1194582436:86 , srv1231474104:86 , srv1271843523:86 , srv1285756283:86 , srv1297787959:86 , srv1459032638:86 , srv1501593808:86 , srv1653518024:86 , srv182001663:86 , srv1838985676:86 , srv1959199068:86 , srv2057416333:86 , srv38601442:86 , srv499574904:86 , srv624316833:86 , srv657851405:86 , srv726548631:86 , srv787976204:86 , srv798904812:86 , srv925120977:86 , srv964412739:86 , srv1140850764:87 , srv1516352214:87 , srv1617100679:87 , srv1685944642:87 , srv1817475182:87 , srv1847709343:87 , srv190074795:87 , srv1956686785:87 , srv2044637749:87 , srv245333289:87 , srv767335932:87 , srv902523410:87 , srv903036133:87 , srv913156128:87 , srv968069391:87 , srv1391539774:88 , srv1742721450:88 , srv2032698429:88 , srv1460294301:89 , srv86897783:89 , srv1846089114:555 }
2023-02-21 10:54:01,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-21 10:54:01,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv224866896=57, srv654403858=74, srv716910029=80, srv239827233=59, srv1271843523=12, srv1321406044=16, srv1694288636=33, srv1659758630=31, srv817726427=87, srv1154692692=6, srv1997869299=51, srv38601442=63, srv1240321576=11, srv1847709343=44, srv1391539774=19, srv1297787959=14, srv1459032638=23, srv1959199068=50, srv1114699897=3, srv1906241128=47, srv902523410=92, srv1391377997=18, srv1742721450=37, srv431409185=64, srv182001663=41, srv177711894=38, srv892073221=91, srv1817475182=40, srv86897783=90, srv703060532=79, srv964412739=98, srv506649128=68, srv1581403645=28, srv1140850764=5, srv748788125=83, srv2057416333=54, srv624316833=73, srv903036133=93, srv1311954907=15, srv621459552=72, srv1411236830=21, srv1737387325=36, srv91782939=96, srv1846089114=43, srv1194582436=9, srv499574904=66, srv1885074600=45, srv726548631=81, srv913156128=95, srv835534409=88, srv118152944=8, srv499639608=67, srv798904812=86, srv968069391=99, srv2044637749=53, srv1451556653=22, srv179067690=39, srv767335932=84, srv1460294301=24, srv731794269=82, srv912636444=94, srv2084745774=56, srv226020418=58, srv431471014=65, srv1042995049=1, srv1956686785=49, srv1685944642=32, srv657851405=75, srv1285756283=13, srv699989428=78, srv1940727652=48, srv190074795=46, srv925120977=97, srv1524898521=27, srv673963604=77, srv595072780=71, srv1617100679=29, srv1653518024=30, srv1516352214=26, srv1118057474=4, srv1327825847=17, srv1702878041=34, srv2032698429=52, srv673127028=76, srv550139816=70, srv840899829=89, srv1168221267=7, srv1231474104=10, srv245333289=60, srv787976204=85, srv2082441624=55, srv327002158=62, srv1838985676=42, srv1731246517=35, srv1075677111=2, srv1402888998=20, srv28727386=61, srv545693669=69, srv1501593808=25, srv1030250218=0} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-21 10:54:01,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-21 10:54:01,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-21 10:54:01,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-21 10:54:01,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-21 10:54:01,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-21 10:54:01,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-21 10:54:01,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-21 10:54:01,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-21 10:54:01,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-21 10:54:01,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-21 10:54:01,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-21 10:54:01,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-21 10:54:01,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-21 10:54:01,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-21 10:54:01,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-21 10:54:01,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-21 10:54:01,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-21 10:54:01,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-21 10:54:01,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-21 10:54:01,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-21 10:54:01,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-21 10:54:01,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-21 10:54:01,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-21 10:54:01,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-21 10:54:01,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-21 10:54:01,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-21 10:54:01,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-21 10:54:01,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-21 10:54:01,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-21 10:54:01,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-21 10:54:01,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-21 10:54:01,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-21 10:54:01,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-21 10:54:01,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-21 10:54:01,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-21 10:54:01,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-21 10:54:01,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-21 10:54:01,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-21 10:54:01,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-21 10:54:01,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-21 10:54:01,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-21 10:54:01,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-21 10:54:01,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-21 10:54:01,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-21 10:54:01,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-21 10:54:01,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-21 10:54:01,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-21 10:54:01,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-21 10:54:01,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-21 10:54:01,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-21 10:54:01,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-21 10:54:01,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-21 10:54:01,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-21 10:54:01,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-21 10:54:01,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-21 10:54:01,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-21 10:54:01,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-21 10:54:01,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-21 10:54:01,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-21 10:54:01,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-21 10:54:01,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-21 10:54:01,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-21 10:54:01,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-21 10:54:01,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-21 10:54:01,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-21 10:54:01,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-21 10:54:01,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-21 10:54:01,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-21 10:54:01,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-21 10:54:01,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-21 10:54:01,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-21 10:54:01,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-21 10:54:01,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-21 10:54:01,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-21 10:54:01,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-21 10:54:01,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-21 10:54:01,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-21 10:54:01,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-21 10:54:01,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-21 10:54:01,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-21 10:54:01,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-21 10:54:01,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-21 10:54:01,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-21 10:54:01,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-21 10:54:01,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-21 10:54:01,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-21 10:54:01,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-21 10:54:01,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-21 10:54:01,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-21 10:54:01,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-21 10:54:01,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-21 10:54:01,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-21 10:54:01,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-21 10:54:01,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-21 10:54:01,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-21 10:54:01,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-21 10:54:01,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-21 10:54:01,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-21 10:54:01,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-21 10:54:01,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-21 10:54:01,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-21 10:54:01,425 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006091950371931928); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007741618689438271); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006091950371931928); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333334E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004833333333333334); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-21 10:54:01,426 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-02-21 10:54:01,426 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.0012495536381102244, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006091950371931928); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007741618689438271); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006091950371931928); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333334E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004833333333333334); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-02-21 10:54:01,805 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 491 ms to try 5000 different iterations.  Found a solution that moves 250 regions; Going from a computed imbalance of 0.0012495536381102244 to a new imbalance of 2.6886275363365925E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.027777777777777776, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-21 10:54:01,806 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1391539774:83 , srv1459032638:83 , srv1460294301:83 , srv748788125:83 , srv817726427:83 , srv835534409:83 , srv1030250218:84 , srv1042995049:84 , srv1075677111:84 , srv1114699897:84 , srv1118057474:84 , srv1140850764:84 , srv1168221267:84 , srv118152944:84 , srv1194582436:84 , srv1391377997:84 , srv1402888998:84 , srv1501593808:84 , srv1516352214:84 , srv1653518024:84 , srv1659758630:84 , srv1702878041:84 , srv1731246517:84 , srv1742721450:84 , srv177711894:84 , srv1817475182:84 , srv1847709343:84 , srv1906241128:84 , srv1956686785:84 , srv1997869299:84 , srv2032698429:84 , srv245333289:84 , srv327002158:84 , srv499574904:84 , srv595072780:84 , srv621459552:84 , srv673963604:84 , srv731794269:84 , srv767335932:84 , srv787976204:84 , srv86897783:84 , srv913156128:84 , srv91782939:84 , srv964412739:84 , srv968069391:84 , srv1154692692:85 , srv1231474104:85 , srv1240321576:85 , srv1271843523:85 , srv1285756283:85 , srv1297787959:85 , srv1311954907:85 , srv1321406044:85 , srv1327825847:85 , srv1411236830:85 , srv1524898521:85 , srv1581403645:85 , srv1617100679:85 , srv1685944642:85 , srv1694288636:85 , srv1737387325:85 , srv179067690:85 , srv1838985676:85 , srv1885074600:85 , srv190074795:85 , srv1959199068:85 , srv2057416333:85 , srv2082441624:85 , srv2084745774:85 , srv224866896:85 , srv239827233:85 , srv28727386:85 , srv38601442:85 , srv431409185:85 , srv431471014:85 , srv499639608:85 , srv506649128:85 , srv550139816:85 , srv624316833:85 , srv654403858:85 , srv657851405:85 , srv673127028:85 , srv699989428:85 , srv703060532:85 , srv716910029:85 , srv726548631:85 , srv798904812:85 , srv840899829:85 , srv892073221:85 , srv902523410:85 , srv903036133:85 , srv912636444:85 , srv925120977:85 , srv1451556653:86 , srv182001663:86 , srv1940727652:86 , srv2044637749:86 , srv226020418:86 , srv545693669:86 , srv1846089114:630 }
2023-02-21 10:54:01,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-21 10:54:01,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv224866896=57, srv654403858=74, srv716910029=80, srv239827233=59, srv1271843523=12, srv1321406044=16, srv1694288636=33, srv1659758630=31, srv817726427=87, srv1154692692=6, srv1997869299=51, srv38601442=63, srv1240321576=11, srv1847709343=44, srv1391539774=19, srv1297787959=14, srv1459032638=23, srv1959199068=50, srv1114699897=3, srv1906241128=47, srv902523410=92, srv1391377997=18, srv1742721450=37, srv431409185=64, srv182001663=41, srv177711894=38, srv892073221=91, srv1817475182=40, srv86897783=90, srv703060532=79, srv964412739=98, srv506649128=68, srv1581403645=28, srv1140850764=5, srv748788125=83, srv2057416333=54, srv624316833=73, srv903036133=93, srv1311954907=15, srv621459552=72, srv1411236830=21, srv1737387325=36, srv91782939=96, srv1846089114=43, srv1194582436=9, srv499574904=66, srv1885074600=45, srv726548631=81, srv913156128=95, srv835534409=88, srv118152944=8, srv499639608=67, srv798904812=86, srv968069391=99, srv2044637749=53, srv1451556653=22, srv179067690=39, srv767335932=84, srv1460294301=24, srv731794269=82, srv912636444=94, srv2084745774=56, srv226020418=58, srv431471014=65, srv1042995049=1, srv1956686785=49, srv1685944642=32, srv657851405=75, srv1285756283=13, srv699989428=78, srv1940727652=48, srv190074795=46, srv925120977=97, srv1524898521=27, srv673963604=77, srv595072780=71, srv1617100679=29, srv1653518024=30, srv1516352214=26, srv1118057474=4, srv1327825847=17, srv1702878041=34, srv2032698429=52, srv673127028=76, srv550139816=70, srv840899829=89, srv1168221267=7, srv1231474104=10, srv245333289=60, srv787976204=85, srv2082441624=55, srv327002158=62, srv1838985676=42, srv1731246517=35, srv1075677111=2, srv1402888998=20, srv28727386=61, srv545693669=69, srv1501593808=25, srv1030250218=0} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-21 10:54:01,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-21 10:54:01,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-21 10:54:01,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-21 10:54:01,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-21 10:54:01,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-21 10:54:01,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-21 10:54:01,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-21 10:54:01,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-21 10:54:01,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-21 10:54:01,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-21 10:54:01,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-21 10:54:01,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-21 10:54:01,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-21 10:54:01,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-21 10:54:01,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-21 10:54:01,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-21 10:54:01,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-21 10:54:01,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-21 10:54:01,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-21 10:54:01,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-21 10:54:01,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-21 10:54:01,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-21 10:54:01,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-21 10:54:01,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-21 10:54:01,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-21 10:54:01,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-21 10:54:01,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-21 10:54:01,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-21 10:54:01,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-21 10:54:01,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-21 10:54:01,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-21 10:54:01,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-21 10:54:01,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-21 10:54:01,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-21 10:54:01,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-21 10:54:01,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-21 10:54:01,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-21 10:54:01,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-21 10:54:01,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-21 10:54:01,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-21 10:54:01,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-21 10:54:01,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-21 10:54:01,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-21 10:54:01,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-21 10:54:01,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-21 10:54:01,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-21 10:54:01,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-21 10:54:01,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-21 10:54:01,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-21 10:54:01,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-21 10:54:01,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-21 10:54:01,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-21 10:54:01,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-21 10:54:01,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-21 10:54:01,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-21 10:54:01,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-21 10:54:01,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-21 10:54:01,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-21 10:54:01,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-21 10:54:01,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-21 10:54:01,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-21 10:54:01,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-21 10:54:01,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-21 10:54:01,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-21 10:54:01,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-21 10:54:01,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-21 10:54:01,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-21 10:54:01,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-21 10:54:01,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-21 10:54:01,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-21 10:54:01,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-21 10:54:01,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-21 10:54:01,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-21 10:54:01,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-21 10:54:01,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-21 10:54:01,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-21 10:54:01,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-21 10:54:01,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-21 10:54:01,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-21 10:54:01,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-21 10:54:01,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-21 10:54:01,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-21 10:54:01,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-21 10:54:01,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-21 10:54:01,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-21 10:54:01,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-21 10:54:01,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-21 10:54:01,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-21 10:54:01,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-21 10:54:01,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-21 10:54:01,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-21 10:54:01,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-21 10:54:01,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-21 10:54:01,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-21 10:54:01,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-21 10:54:01,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-21 10:54:01,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-21 10:54:01,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-21 10:54:01,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-21 10:54:01,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-21 10:54:01,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-21 10:54:01,994 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-21 10:54:01,994 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-02-21 10:54:01,995 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.513573794837952E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-02-21 10:54:02,234 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 378 ms to try 5000 different iterations.  Found a solution that moves 18 regions; Going from a computed imbalance of 2.513573794837952E-5 to a new imbalance of 8.105728810919609E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.002); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-21 10:54:02,235 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1321406044:83 , srv1327825847:83 , srv1451556653:83 , srv182001663:83 , srv2044637749:83 , srv226020418:83 , srv545693669:83 , srv798904812:83 , srv1030250218:84 , srv1042995049:84 , srv1075677111:84 , srv1118057474:84 , srv1140850764:84 , srv1154692692:84 , srv1168221267:84 , srv118152944:84 , srv1194582436:84 , srv1231474104:84 , srv1240321576:84 , srv1271843523:84 , srv1285756283:84 , srv1297787959:84 , srv1311954907:84 , srv1391377997:84 , srv1402888998:84 , srv1411236830:84 , srv1460294301:84 , srv1501593808:84 , srv1516352214:84 , srv1524898521:84 , srv1581403645:84 , srv1617100679:84 , srv1653518024:84 , srv1659758630:84 , srv1685944642:84 , srv1694288636:84 , srv1702878041:84 , srv1737387325:84 , srv1742721450:84 , srv177711894:84 , srv179067690:84 , srv1817475182:84 , srv1838985676:84 , srv1847709343:84 , srv1885074600:84 , srv190074795:84 , srv1906241128:84 , srv1940727652:84 , srv1956686785:84 , srv1959199068:84 , srv2032698429:84 , srv2057416333:84 , srv2082441624:84 , srv2084745774:84 , srv224866896:84 , srv239827233:84 , srv245333289:84 , srv28727386:84 , srv327002158:84 , srv38601442:84 , srv431409185:84 , srv431471014:84 , srv499574904:84 , srv499639608:84 , srv506649128:84 , srv550139816:84 , srv595072780:84 , srv621459552:84 , srv624316833:84 , srv654403858:84 , srv657851405:84 , srv673127028:84 , srv673963604:84 , srv699989428:84 , srv703060532:84 , srv716910029:84 , srv726548631:84 , srv731794269:84 , srv767335932:84 , srv787976204:84 , srv835534409:84 , srv840899829:84 , srv86897783:84 , srv892073221:84 , srv902523410:84 , srv903036133:84 , srv912636444:84 , srv91782939:84 , srv925120977:84 , srv964412739:84 , srv968069391:84 , srv1114699897:85 , srv1391539774:85 , srv1459032638:85 , srv1731246517:85 , srv1997869299:85 , srv748788125:85 , srv817726427:85 , srv913156128:85 , srv1846089114:684 }
2023-02-21 10:54:02,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-21 10:54:02,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv224866896=57, srv654403858=74, srv716910029=80, srv239827233=59, srv1271843523=12, srv1321406044=16, srv1694288636=33, srv1659758630=31, srv817726427=87, srv1154692692=6, srv1997869299=51, srv38601442=63, srv1240321576=11, srv1847709343=44, srv1391539774=19, srv1297787959=14, srv1459032638=23, srv1959199068=50, srv1114699897=3, srv1906241128=47, srv902523410=92, srv1391377997=18, srv1742721450=37, srv431409185=64, srv182001663=41, srv177711894=38, srv892073221=91, srv1817475182=40, srv86897783=90, srv703060532=79, srv964412739=98, srv506649128=68, srv1581403645=28, srv1140850764=5, srv748788125=83, srv2057416333=54, srv624316833=73, srv903036133=93, srv1311954907=15, srv621459552=72, srv1411236830=21, srv1737387325=36, srv91782939=96, srv1846089114=43, srv1194582436=9, srv499574904=66, srv1885074600=45, srv726548631=81, srv913156128=95, srv835534409=88, srv118152944=8, srv499639608=67, srv798904812=86, srv968069391=99, srv2044637749=53, srv1451556653=22, srv179067690=39, srv767335932=84, srv1460294301=24, srv731794269=82, srv912636444=94, srv2084745774=56, srv226020418=58, srv431471014=65, srv1042995049=1, srv1956686785=49, srv1685944642=32, srv657851405=75, srv1285756283=13, srv699989428=78, srv1940727652=48, srv190074795=46, srv925120977=97, srv1524898521=27, srv673963604=77, srv595072780=71, srv1617100679=29, srv1653518024=30, srv1516352214=26, srv1118057474=4, srv1327825847=17, srv1702878041=34, srv2032698429=52, srv673127028=76, srv550139816=70, srv840899829=89, srv1168221267=7, srv1231474104=10, srv245333289=60, srv787976204=85, srv2082441624=55, srv327002158=62, srv1838985676=42, srv1731246517=35, srv1075677111=2, srv1402888998=20, srv28727386=61, srv545693669=69, srv1501593808=25, srv1030250218=0} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-21 10:54:02,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-21 10:54:02,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-21 10:54:02,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-21 10:54:02,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-21 10:54:02,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-21 10:54:02,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-21 10:54:02,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-21 10:54:02,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-21 10:54:02,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-21 10:54:02,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-21 10:54:02,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-21 10:54:02,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-21 10:54:02,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-21 10:54:02,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-21 10:54:02,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-21 10:54:02,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-21 10:54:02,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-21 10:54:02,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-21 10:54:02,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-21 10:54:02,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-21 10:54:02,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-21 10:54:02,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-21 10:54:02,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-21 10:54:02,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-21 10:54:02,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-21 10:54:02,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-21 10:54:02,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-21 10:54:02,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-21 10:54:02,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-21 10:54:02,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-21 10:54:02,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-21 10:54:02,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-21 10:54:02,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-21 10:54:02,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-21 10:54:02,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-21 10:54:02,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-21 10:54:02,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-21 10:54:02,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-21 10:54:02,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-21 10:54:02,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-21 10:54:02,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-21 10:54:02,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-21 10:54:02,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-21 10:54:02,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-21 10:54:02,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-21 10:54:02,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-21 10:54:02,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-21 10:54:02,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-21 10:54:02,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-21 10:54:02,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-21 10:54:02,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-21 10:54:02,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-21 10:54:02,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-21 10:54:02,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-21 10:54:02,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-21 10:54:02,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-21 10:54:02,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-21 10:54:02,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-21 10:54:02,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-21 10:54:02,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-21 10:54:02,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-21 10:54:02,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-21 10:54:02,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-21 10:54:02,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-21 10:54:02,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-21 10:54:02,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-21 10:54:02,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-21 10:54:02,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-21 10:54:02,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-21 10:54:02,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-21 10:54:02,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-21 10:54:02,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-21 10:54:02,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-21 10:54:02,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-21 10:54:02,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-21 10:54:02,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-21 10:54:02,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-21 10:54:02,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-21 10:54:02,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-21 10:54:02,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-21 10:54:02,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-21 10:54:02,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-21 10:54:02,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-21 10:54:02,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-21 10:54:02,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-21 10:54:02,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-21 10:54:02,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-21 10:54:02,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-21 10:54:02,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-21 10:54:02,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-21 10:54:02,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-21 10:54:02,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-21 10:54:02,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-21 10:54:02,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-21 10:54:02,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-21 10:54:02,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-21 10:54:02,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-21 10:54:02,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-21 10:54:02,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-21 10:54:02,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-21 10:54:02,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-21 10:54:02,402 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.979690117040589E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-21 10:54:02,402 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1321406044:83 , srv1327825847:83 , srv1451556653:83 , srv182001663:83 , srv2044637749:83 , srv226020418:83 , srv545693669:83 , srv798904812:83 , srv1030250218:84 , srv1042995049:84 , srv1075677111:84 , srv1118057474:84 , srv1140850764:84 , srv1154692692:84 , srv1168221267:84 , srv118152944:84 , srv1194582436:84 , srv1231474104:84 , srv1240321576:84 , srv1271843523:84 , srv1285756283:84 , srv1297787959:84 , srv1311954907:84 , srv1391377997:84 , srv1402888998:84 , srv1411236830:84 , srv1460294301:84 , srv1501593808:84 , srv1516352214:84 , srv1524898521:84 , srv1581403645:84 , srv1617100679:84 , srv1653518024:84 , srv1659758630:84 , srv1685944642:84 , srv1694288636:84 , srv1702878041:84 , srv1737387325:84 , srv1742721450:84 , srv177711894:84 , srv179067690:84 , srv1817475182:84 , srv1838985676:84 , srv1847709343:84 , srv1885074600:84 , srv190074795:84 , srv1906241128:84 , srv1940727652:84 , srv1956686785:84 , srv1959199068:84 , srv2032698429:84 , srv2057416333:84 , srv2082441624:84 , srv2084745774:84 , srv224866896:84 , srv239827233:84 , srv245333289:84 , srv28727386:84 , srv327002158:84 , srv38601442:84 , srv431409185:84 , srv431471014:84 , srv499574904:84 , srv499639608:84 , srv506649128:84 , srv550139816:84 , srv595072780:84 , srv621459552:84 , srv624316833:84 , srv654403858:84 , srv657851405:84 , srv673127028:84 , srv673963604:84 , srv699989428:84 , srv703060532:84 , srv716910029:84 , srv726548631:84 , srv731794269:84 , srv767335932:84 , srv787976204:84 , srv835534409:84 , srv840899829:84 , srv86897783:84 , srv892073221:84 , srv902523410:84 , srv903036133:84 , srv912636444:84 , srv91782939:84 , srv925120977:84 , srv964412739:84 , srv968069391:84 , srv1114699897:85 , srv1391539774:85 , srv1459032638:85 , srv1731246517:85 , srv1997869299:85 , srv748788125:85 , srv817726427:85 , srv913156128:85 , srv1846089114:684 }
2023-02-21 10:54:02,426 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=326 (was 302) - SystemLoadAverage LEAK? -, ProcessCount=172 (was 172), AvailableMemoryMB=5725 (was 6226)
2023-02-21 10:54:02,434 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=326, ProcessCount=172, AvailableMemoryMB=5724
2023-02-21 10:54:02,435 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-02-21 10:54:02,435 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-02-21 10:54:02,444 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1029530855:84 , srv1077801999:84 , srv1095662611:84 , srv1120639501:84 , srv1123064034:84 , srv1146456636:84 , srv1150853531:84 , srv142393324:84 , srv1565800960:84 , srv1636325094:84 , srv1639690271:84 , srv1676975454:84 , srv1906826257:84 , srv1948773033:84 , srv1988494427:84 , srv2005907972:84 , srv217954873:84 , srv255627591:84 , srv269444347:84 , srv397139930:84 , srv469634149:84 , srv469803988:84 , srv704707366:84 , srv732077459:84 , srv747307904:84 , srv786296795:84 , srv860616981:84 , srv96984533:84 , srv970902668:84 , srv1188260070:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-02-21 10:54:02,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-21 10:54:02,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1948773033=14, srv860616981=27, srv255627591=18, srv732077459=24, srv217954873=17, srv1150853531=6, srv469803988=22, srv747307904=25, srv1077801999=1, srv1120639501=3, srv704707366=23, srv786296795=26, srv397139930=20, srv1565800960=9, srv1095662611=2, srv970902668=29, srv1676975454=12, srv1906826257=13, srv1123064034=4, srv1146456636=5, srv1988494427=15, srv469634149=21, srv142393324=8, srv269444347=19, srv96984533=28, srv1636325094=10, srv1029530855=0, srv2005907972=16, srv1188260070=7, srv1639690271=11} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-21 10:54:02,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-21 10:54:02,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-21 10:54:02,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-21 10:54:02,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-21 10:54:02,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-21 10:54:02,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-21 10:54:02,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-21 10:54:02,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-21 10:54:02,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-21 10:54:02,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-21 10:54:02,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-21 10:54:02,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-21 10:54:02,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-21 10:54:02,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-21 10:54:02,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-21 10:54:02,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-21 10:54:02,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-21 10:54:02,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-21 10:54:02,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-21 10:54:02,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-21 10:54:02,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-21 10:54:02,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-21 10:54:02,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-21 10:54:02,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-21 10:54:02,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-21 10:54:02,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-21 10:54:02,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-21 10:54:02,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-21 10:54:02,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-21 10:54:02,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-21 10:54:02,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-02-21 10:54:02,470 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0798107864793274, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-21 10:54:02,470 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912444524446415, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0798107864793274, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-02-21 10:56:02,458 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6298893 different iterations.  Found a solution that moves 1856 regions; Going from a computed imbalance of 0.9912444524446415 to a new imbalance of 4.3319965896196796E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6874074074074074, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-21 10:56:02,466 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1029530855:90 , srv1077801999:90 , srv1095662611:90 , srv1120639501:90 , srv1123064034:90 , srv1146456636:90 , srv1150853531:90 , srv1188260070:90 , srv142393324:90 , srv1565800960:90 , srv1636325094:90 , srv1639690271:90 , srv1676975454:90 , srv1906826257:90 , srv1948773033:90 , srv1988494427:90 , srv2005907972:90 , srv217954873:90 , srv255627591:90 , srv269444347:90 , srv397139930:90 , srv469634149:90 , srv469803988:90 , srv704707366:90 , srv732077459:90 , srv747307904:90 , srv786296795:90 , srv860616981:90 , srv96984533:90 , srv970902668:90 }
2023-02-21 10:56:02,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-21 10:56:02,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1948773033=14, srv860616981=27, srv255627591=18, srv732077459=24, srv217954873=17, srv1150853531=6, srv469803988=22, srv747307904=25, srv1077801999=1, srv1120639501=3, srv704707366=23, srv786296795=26, srv397139930=20, srv1565800960=9, srv1095662611=2, srv970902668=29, srv1676975454=12, srv1906826257=13, srv1123064034=4, srv1146456636=5, srv1988494427=15, srv469634149=21, srv142393324=8, srv269444347=19, srv96984533=28, srv1636325094=10, srv1029530855=0, srv2005907972=16, srv1188260070=7, srv1639690271=11} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-21 10:56:02,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-21 10:56:02,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-21 10:56:02,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-21 10:56:02,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-21 10:56:02,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-21 10:56:02,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-21 10:56:02,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-21 10:56:02,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-21 10:56:02,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-21 10:56:02,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-21 10:56:02,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-21 10:56:02,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-21 10:56:02,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-21 10:56:02,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-21 10:56:02,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-21 10:56:02,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-21 10:56:02,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-21 10:56:02,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-21 10:56:02,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-21 10:56:02,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-21 10:56:02,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-21 10:56:02,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-21 10:56:02,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-21 10:56:02,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-21 10:56:02,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-21 10:56:02,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-21 10:56:02,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-21 10:56:02,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-21 10:56:02,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-21 10:56:02,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-21 10:56:02,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-02-21 10:56:02,490 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-21 10:56:02,491 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1029530855:90 , srv1077801999:90 , srv1095662611:90 , srv1120639501:90 , srv1123064034:90 , srv1146456636:90 , srv1150853531:90 , srv1188260070:90 , srv142393324:90 , srv1565800960:90 , srv1636325094:90 , srv1639690271:90 , srv1676975454:90 , srv1906826257:90 , srv1948773033:90 , srv1988494427:90 , srv2005907972:90 , srv217954873:90 , srv255627591:90 , srv269444347:90 , srv397139930:90 , srv469634149:90 , srv469803988:90 , srv704707366:90 , srv732077459:90 , srv747307904:90 , srv786296795:90 , srv860616981:90 , srv96984533:90 , srv970902668:90 }
2023-02-21 10:56:02,506 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=9 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=157 (was 326), ProcessCount=172 (was 172), AvailableMemoryMB=5662 (was 5724)