2024-04-06 04:53:13,654 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2024-04-06 04:53:13,976 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2024-04-06 04:53:14,086 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2024-04-06 04:53:14,147 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-04-06 04:53:14,154 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-04-06 04:53:14,170 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=304, ProcessCount=172, AvailableMemoryMB=10969
2024-04-06 04:53:14,172 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-04-06 04:53:14,172 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-04-06 04:53:14,287 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv100445676:84 , srv1013500298:84 , srv1047787580:84 , srv1052000468:84 , srv1116008301:84 , srv1117148452:84 , srv1209401213:84 , srv1249372264:84 , srv1273105882:84 , srv1276871544:84 , srv1284211044:84 , srv1290696016:84 , srv1294373625:84 , srv1294528962:84 , srv1295441389:84 , srv1360043559:84 , srv1367740445:84 , srv1370362306:84 , srv1394281125:84 , srv1463932930:84 , srv1471146614:84 , srv1512682153:84 , srv1538731738:84 , srv1546154494:84 , srv1560363132:84 , srv1573268231:84 , srv1585097210:84 , srv1593377968:84 , srv1614468590:84 , srv1630272005:84 , srv1630656074:84 , srv1643521916:84 , srv1644027064:84 , srv1670359643:84 , srv1687248088:84 , srv1687993139:84 , srv1689815017:84 , srv169589445:84 , srv1701121833:84 , srv1705243257:84 , srv1718979354:84 , srv1726827904:84 , srv1730867590:84 , srv1735037161:84 , srv1736304422:84 , srv1767910198:84 , srv1782828197:84 , srv1786057120:84 , srv1797616755:84 , srv1818750563:84 , srv18217004:84 , srv1831953645:84 , srv1844569158:84 , srv1865824773:84 , srv1872762437:84 , srv1907230655:84 , srv1945220624:84 , srv1984088225:84 , srv2017696821:84 , srv2056304677:84 , srv2092085892:84 , srv2092628978:84 , srv2093800900:84 , srv2108337245:84 , srv2115819527:84 , srv2124973595:84 , srv2129992504:84 , srv21859518:84 , srv236028638:84 , srv282605673:84 , srv294447006:84 , srv324657577:84 , srv386038318:84 , srv413275167:84 , srv416102551:84 , srv423272867:84 , srv477375114:84 , srv477780892:84 , srv478784562:84 , srv485926847:84 , srv568038280:84 , srv590382952:84 , srv634085424:84 , srv669378119:84 , srv678247115:84 , srv6914517:84 , srv6977439:84 , srv7227041:84 , srv730318944:84 , srv754160346:84 , srv796872928:84 , srv81493031:84 , srv844345406:84 , srv922504236:84 , srv931724882:84 , srv942254445:84 , srv942418437:84 , srv951218005:84 , srv990020556:84 , srv459891972:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2024-04-06 04:53:14,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-06 04:53:14,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv568038280=81, srv922504236=94, srv2093800900=62, srv1644027064=32, srv2092085892=60, srv1945220624=56, srv1726827904=41, srv1614468590=28, srv1786057120=47, srv1284211044=10, srv1818750563=49, srv2108337245=63, srv942254445=96, srv1116008301=4, srv416102551=74, srv21859518=67, srv413275167=73, srv236028638=68, srv6977439=87, srv477780892=78, srv669378119=84, srv477375114=77, srv423272867=75, srv1736304422=44, srv1670359643=33, srv634085424=83, srv324657577=71, srv730318944=89, srv459891972=76, srv796872928=91, srv2017696821=58, srv1630656074=30, srv1782828197=46, srv294447006=70, srv1512682153=21, srv1471146614=20, srv169589445=37, srv1687993139=35, srv1705243257=39, srv1573268231=25, srv1767910198=45, srv1538731738=22, srv282605673=69, srv1276871544=9, srv100445676=0, srv942418437=97, srv931724882=95, srv2092628978=61, srv1052000468=3, srv1360043559=15, srv2115819527=64, srv1249372264=7, srv1463932930=19, srv1865824773=53, srv844345406=93, srv7227041=88, srv2056304677=59, srv1546154494=23, srv1117148452=5, srv1907230655=55, srv1718979354=40, srv1730867590=42, srv2124973595=65, srv1394281125=18, srv1294373625=12, srv1689815017=36, srv990020556=99, srv18217004=50, srv754160346=90, srv1735037161=43, srv1290696016=11, srv1687248088=34, srv2129992504=66, srv478784562=79, srv1593377968=27, srv386038318=72, srv6914517=86, srv1643521916=31, srv1294528962=13, srv1047787580=2, srv1872762437=54, srv1844569158=52, srv590382952=82, srv1630272005=29, srv1273105882=8, srv485926847=80, srv1013500298=1, srv1295441389=14, srv1209401213=6, srv1831953645=51, srv1701121833=38, srv1367740445=16, srv1370362306=17, srv1560363132=24, srv1984088225=57, srv951218005=98, srv678247115=85, srv1585097210=26, srv81493031=92, srv1797616755=48} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-06 04:53:14,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-06 04:53:14,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-06 04:53:14,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-06 04:53:14,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-06 04:53:14,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-06 04:53:14,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-06 04:53:14,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-06 04:53:14,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-06 04:53:14,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-06 04:53:14,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-06 04:53:14,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-06 04:53:14,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-06 04:53:14,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-06 04:53:14,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-06 04:53:14,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-06 04:53:14,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-06 04:53:14,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-06 04:53:14,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-06 04:53:14,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-06 04:53:14,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-06 04:53:14,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-06 04:53:14,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-06 04:53:14,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-06 04:53:14,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-06 04:53:14,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-06 04:53:14,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-06 04:53:14,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-06 04:53:14,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-06 04:53:14,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-06 04:53:14,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-06 04:53:14,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-06 04:53:14,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-06 04:53:14,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-06 04:53:14,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-06 04:53:14,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-06 04:53:14,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-06 04:53:14,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-06 04:53:14,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-06 04:53:14,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-06 04:53:14,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-06 04:53:14,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-06 04:53:14,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-06 04:53:14,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-06 04:53:14,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-06 04:53:14,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-06 04:53:14,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-06 04:53:14,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-06 04:53:14,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-06 04:53:14,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-06 04:53:14,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-06 04:53:14,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-06 04:53:14,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-06 04:53:14,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-06 04:53:14,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-06 04:53:14,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-06 04:53:14,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-06 04:53:14,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-06 04:53:14,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-06 04:53:14,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-06 04:53:14,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-06 04:53:14,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-06 04:53:14,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-06 04:53:14,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-06 04:53:14,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-06 04:53:14,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-06 04:53:14,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-06 04:53:14,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-06 04:53:14,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-06 04:53:14,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-06 04:53:14,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-06 04:53:14,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-06 04:53:14,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-06 04:53:14,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-06 04:53:14,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-06 04:53:14,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-06 04:53:14,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-06 04:53:14,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-06 04:53:14,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-06 04:53:14,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-06 04:53:14,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-06 04:53:14,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-06 04:53:14,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-06 04:53:14,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-06 04:53:14,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-06 04:53:14,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-06 04:53:14,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-06 04:53:14,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-06 04:53:14,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-06 04:53:14,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-06 04:53:14,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-06 04:53:14,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-06 04:53:14,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-06 04:53:14,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-06 04:53:14,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-06 04:53:14,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-06 04:53:14,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-06 04:53:14,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-06 04:53:14,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-06 04:53:14,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-06 04:53:14,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-06 04:53:14,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-06 04:53:14,554 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-06 04:53:14,554 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-04-06 04:53:14,555 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-04-06 04:53:14,909 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 492 ms to try 5000 different iterations.  Found a solution that moves 4693 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17654010575215673. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03872452036328216, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05535519425369401, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5214444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03872452036328216, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17066666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24908333333333332, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-06 04:53:14,926 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1767910198:80 , srv478784562:80 , srv1463932930:81 , srv1546154494:81 , srv169589445:82 , srv1573268231:83 , srv2093800900:83 , srv754160346:83 , srv1249372264:84 , srv1560363132:84 , srv1585097210:84 , srv1614468590:84 , srv1705243257:84 , srv1718979354:84 , srv1782828197:84 , srv1797616755:84 , srv1872762437:84 , srv2124973595:84 , srv324657577:84 , srv485926847:84 , srv634085424:84 , srv6977439:84 , srv844345406:84 , srv1273105882:85 , srv1394281125:85 , srv1512682153:85 , srv1670359643:85 , srv1701121833:85 , srv1726827904:85 , srv1730867590:85 , srv477780892:85 , srv6914517:85 , srv1013500298:86 , srv1047787580:86 , srv1116008301:86 , srv1209401213:86 , srv1276871544:86 , srv1367740445:86 , srv1630272005:86 , srv1687993139:86 , srv1689815017:86 , srv1865824773:86 , srv2017696821:86 , srv236028638:86 , srv282605673:86 , srv294447006:86 , srv386038318:86 , srv416102551:86 , srv730318944:86 , srv796872928:86 , srv931724882:86 , srv1052000468:87 , srv1370362306:87 , srv1471146614:87 , srv1630656074:87 , srv1644027064:87 , srv1736304422:87 , srv1786057120:87 , srv18217004:87 , srv2092628978:87 , srv2115819527:87 , srv413275167:87 , srv568038280:87 , srv669378119:87 , srv942418437:87 , srv951218005:87 , srv1284211044:88 , srv1290696016:88 , srv1294528962:88 , srv1360043559:88 , srv1538731738:88 , srv1687248088:88 , srv1735037161:88 , srv1818750563:88 , srv1984088225:88 , srv2056304677:88 , srv2108337245:88 , srv2129992504:88 , srv7227041:88 , srv1117148452:89 , srv1294373625:89 , srv1295441389:89 , srv1593377968:89 , srv1643521916:89 , srv1831953645:89 , srv1844569158:89 , srv1907230655:89 , srv1945220624:89 , srv678247115:89 , srv81493031:89 , srv990020556:89 , srv21859518:90 , srv423272867:90 , srv477375114:90 , srv100445676:92 , srv2092085892:92 , srv590382952:93 , srv942254445:93 , srv922504236:97 , srv459891972:434 }
2024-04-06 04:53:14,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-06 04:53:14,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv568038280=81, srv922504236=94, srv2093800900=62, srv1644027064=32, srv2092085892=60, srv1945220624=56, srv1726827904=41, srv1614468590=28, srv1786057120=47, srv1284211044=10, srv1818750563=49, srv2108337245=63, srv942254445=96, srv1116008301=4, srv416102551=74, srv21859518=67, srv413275167=73, srv236028638=68, srv6977439=87, srv477780892=78, srv669378119=84, srv477375114=77, srv423272867=75, srv1736304422=44, srv1670359643=33, srv634085424=83, srv324657577=71, srv730318944=89, srv459891972=76, srv796872928=91, srv2017696821=58, srv1630656074=30, srv1782828197=46, srv294447006=70, srv1512682153=21, srv1471146614=20, srv169589445=37, srv1687993139=35, srv1705243257=39, srv1573268231=25, srv1767910198=45, srv1538731738=22, srv282605673=69, srv1276871544=9, srv100445676=0, srv942418437=97, srv931724882=95, srv2092628978=61, srv1052000468=3, srv1360043559=15, srv2115819527=64, srv1249372264=7, srv1463932930=19, srv1865824773=53, srv844345406=93, srv7227041=88, srv2056304677=59, srv1546154494=23, srv1117148452=5, srv1907230655=55, srv1718979354=40, srv1730867590=42, srv2124973595=65, srv1394281125=18, srv1294373625=12, srv1689815017=36, srv990020556=99, srv18217004=50, srv754160346=90, srv1735037161=43, srv1290696016=11, srv1687248088=34, srv2129992504=66, srv478784562=79, srv1593377968=27, srv386038318=72, srv6914517=86, srv1643521916=31, srv1294528962=13, srv1047787580=2, srv1872762437=54, srv1844569158=52, srv590382952=82, srv1630272005=29, srv1273105882=8, srv485926847=80, srv1013500298=1, srv1295441389=14, srv1209401213=6, srv1831953645=51, srv1701121833=38, srv1367740445=16, srv1370362306=17, srv1560363132=24, srv1984088225=57, srv951218005=98, srv678247115=85, srv1585097210=26, srv81493031=92, srv1797616755=48} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-06 04:53:14,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-06 04:53:14,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-06 04:53:14,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-06 04:53:14,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-06 04:53:14,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-06 04:53:14,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-06 04:53:14,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-06 04:53:14,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-06 04:53:14,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-06 04:53:14,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-06 04:53:14,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-06 04:53:14,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-06 04:53:14,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-06 04:53:14,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-06 04:53:14,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-06 04:53:14,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-06 04:53:14,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-06 04:53:14,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-06 04:53:14,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-06 04:53:14,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-06 04:53:14,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-06 04:53:14,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-06 04:53:14,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-06 04:53:14,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-06 04:53:14,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-06 04:53:14,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-06 04:53:14,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-06 04:53:14,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-06 04:53:14,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-06 04:53:14,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-06 04:53:14,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-06 04:53:14,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-06 04:53:14,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-06 04:53:14,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-06 04:53:14,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-06 04:53:14,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-06 04:53:14,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-06 04:53:14,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-06 04:53:14,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-06 04:53:14,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-06 04:53:14,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-06 04:53:14,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-06 04:53:14,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-06 04:53:14,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-06 04:53:14,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-06 04:53:14,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-06 04:53:14,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-06 04:53:14,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-06 04:53:14,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-06 04:53:14,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-06 04:53:14,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-06 04:53:14,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-06 04:53:14,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-06 04:53:14,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-06 04:53:14,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-06 04:53:14,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-06 04:53:14,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-06 04:53:14,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-06 04:53:14,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-06 04:53:14,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-06 04:53:14,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-06 04:53:14,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-06 04:53:14,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-06 04:53:14,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-06 04:53:14,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-06 04:53:14,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-06 04:53:14,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-06 04:53:14,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-06 04:53:14,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-06 04:53:14,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-06 04:53:14,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-06 04:53:14,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-06 04:53:14,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-06 04:53:14,955 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-06 04:53:14,955 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-06 04:53:14,955 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-06 04:53:14,955 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-06 04:53:14,955 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-06 04:53:14,955 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-06 04:53:14,955 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-06 04:53:14,955 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-06 04:53:14,956 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-06 04:53:14,956 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-06 04:53:14,956 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-06 04:53:14,956 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-06 04:53:14,956 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-06 04:53:14,956 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-06 04:53:14,956 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-06 04:53:14,956 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-06 04:53:14,956 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-06 04:53:14,956 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-06 04:53:14,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-06 04:53:14,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-06 04:53:14,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-06 04:53:14,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-06 04:53:14,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-06 04:53:14,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-06 04:53:14,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-06 04:53:14,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-06 04:53:14,958 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-06 04:53:14,958 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-06 04:53:15,095 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03872452036328216, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05535519425369401, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03872452036328216, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17066666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24908333333333332, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-06 04:53:15,095 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-04-06 04:53:15,095 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.1765072446638026, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03872452036328216, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05535519425369401, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03872452036328216, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17066666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24908333333333332, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-04-06 04:53:15,362 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 378 ms to try 5000 different iterations.  Found a solution that moves 2604 regions; Going from a computed imbalance of 0.1765072446638026 to a new imbalance of 0.017152950776440305. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.019926288908112877); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.033558164324305036, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.28933333333333333, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.019926288908112877); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01375); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.050083333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-06 04:53:15,371 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv922504236:77 , srv100445676:78 , srv590382952:79 , srv1117148452:81 , srv2092085892:81 , srv423272867:81 , srv477375114:81 , srv942254445:81 , srv1294373625:82 , srv1907230655:82 , srv678247115:82 , srv1295441389:83 , srv1360043559:83 , srv1593377968:83 , srv1687248088:83 , srv1786057120:83 , srv1831953645:83 , srv1984088225:83 , srv942418437:83 , srv1276871544:84 , srv1290696016:84 , srv1370362306:84 , srv1538731738:84 , srv1644027064:84 , srv1735037161:84 , srv1844569158:84 , srv1945220624:84 , srv2092628978:84 , srv2129992504:84 , srv21859518:84 , srv7227041:84 , srv1013500298:85 , srv1052000468:85 , srv1116008301:85 , srv1284211044:85 , srv1294528962:85 , srv1367740445:85 , srv1630272005:85 , srv1818750563:85 , srv413275167:85 , srv568038280:85 , srv730318944:85 , srv796872928:85 , srv951218005:85 , srv990020556:85 , srv1209401213:86 , srv1471146614:86 , srv1512682153:86 , srv1585097210:86 , srv1630656074:86 , srv1643521916:86 , srv1687993139:86 , srv1689815017:86 , srv1736304422:86 , srv18217004:86 , srv1865824773:86 , srv2108337245:86 , srv236028638:86 , srv282605673:86 , srv294447006:86 , srv477780892:86 , srv669378119:86 , srv81493031:86 , srv1273105882:87 , srv1670359643:87 , srv1782828197:87 , srv1797616755:87 , srv2017696821:87 , srv324657577:87 , srv416102551:87 , srv6914517:87 , srv1249372264:88 , srv1394281125:88 , srv1546154494:88 , srv1701121833:88 , srv1718979354:88 , srv1726827904:88 , srv2056304677:88 , srv2115819527:88 , srv386038318:88 , srv485926847:88 , srv634085424:88 , srv844345406:88 , srv931724882:88 , srv1047787580:89 , srv1463932930:89 , srv1560363132:89 , srv1573268231:89 , srv1705243257:89 , srv1872762437:89 , srv2124973595:89 , srv6977439:89 , srv1767910198:90 , srv2093800900:90 , srv754160346:90 , srv169589445:91 , srv1730867590:91 , srv1614468590:92 , srv478784562:92 , srv459891972:517 }
2024-04-06 04:53:15,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-06 04:53:15,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv568038280=81, srv922504236=94, srv2093800900=62, srv1644027064=32, srv2092085892=60, srv1945220624=56, srv1726827904=41, srv1614468590=28, srv1786057120=47, srv1284211044=10, srv1818750563=49, srv2108337245=63, srv942254445=96, srv1116008301=4, srv416102551=74, srv21859518=67, srv413275167=73, srv236028638=68, srv6977439=87, srv477780892=78, srv669378119=84, srv477375114=77, srv423272867=75, srv1736304422=44, srv1670359643=33, srv634085424=83, srv324657577=71, srv730318944=89, srv459891972=76, srv796872928=91, srv2017696821=58, srv1630656074=30, srv1782828197=46, srv294447006=70, srv1512682153=21, srv1471146614=20, srv169589445=37, srv1687993139=35, srv1705243257=39, srv1573268231=25, srv1767910198=45, srv1538731738=22, srv282605673=69, srv1276871544=9, srv100445676=0, srv942418437=97, srv931724882=95, srv2092628978=61, srv1052000468=3, srv1360043559=15, srv2115819527=64, srv1249372264=7, srv1463932930=19, srv1865824773=53, srv844345406=93, srv7227041=88, srv2056304677=59, srv1546154494=23, srv1117148452=5, srv1907230655=55, srv1718979354=40, srv1730867590=42, srv2124973595=65, srv1394281125=18, srv1294373625=12, srv1689815017=36, srv990020556=99, srv18217004=50, srv754160346=90, srv1735037161=43, srv1290696016=11, srv1687248088=34, srv2129992504=66, srv478784562=79, srv1593377968=27, srv386038318=72, srv6914517=86, srv1643521916=31, srv1294528962=13, srv1047787580=2, srv1872762437=54, srv1844569158=52, srv590382952=82, srv1630272005=29, srv1273105882=8, srv485926847=80, srv1013500298=1, srv1295441389=14, srv1209401213=6, srv1831953645=51, srv1701121833=38, srv1367740445=16, srv1370362306=17, srv1560363132=24, srv1984088225=57, srv951218005=98, srv678247115=85, srv1585097210=26, srv81493031=92, srv1797616755=48} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-06 04:53:15,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-06 04:53:15,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-06 04:53:15,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-06 04:53:15,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-06 04:53:15,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-06 04:53:15,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-06 04:53:15,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-06 04:53:15,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-06 04:53:15,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-06 04:53:15,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-06 04:53:15,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-06 04:53:15,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-06 04:53:15,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-06 04:53:15,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-06 04:53:15,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-06 04:53:15,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-06 04:53:15,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-06 04:53:15,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-06 04:53:15,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-06 04:53:15,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-06 04:53:15,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-06 04:53:15,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-06 04:53:15,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-06 04:53:15,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-06 04:53:15,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-06 04:53:15,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-06 04:53:15,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-06 04:53:15,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-06 04:53:15,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-06 04:53:15,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-06 04:53:15,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-06 04:53:15,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-06 04:53:15,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-06 04:53:15,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-06 04:53:15,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-06 04:53:15,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-06 04:53:15,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-06 04:53:15,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-06 04:53:15,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-06 04:53:15,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-06 04:53:15,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-06 04:53:15,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-06 04:53:15,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-06 04:53:15,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-06 04:53:15,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-06 04:53:15,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-06 04:53:15,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-06 04:53:15,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-06 04:53:15,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-06 04:53:15,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-06 04:53:15,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-06 04:53:15,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-06 04:53:15,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-06 04:53:15,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-06 04:53:15,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-06 04:53:15,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-06 04:53:15,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-06 04:53:15,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-06 04:53:15,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-06 04:53:15,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-06 04:53:15,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-06 04:53:15,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-06 04:53:15,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-06 04:53:15,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-06 04:53:15,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-06 04:53:15,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-06 04:53:15,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-06 04:53:15,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-06 04:53:15,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-06 04:53:15,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-06 04:53:15,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-06 04:53:15,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-06 04:53:15,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-06 04:53:15,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-06 04:53:15,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-06 04:53:15,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-06 04:53:15,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-06 04:53:15,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-06 04:53:15,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-06 04:53:15,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-06 04:53:15,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-06 04:53:15,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-06 04:53:15,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-06 04:53:15,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-06 04:53:15,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-06 04:53:15,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-06 04:53:15,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-06 04:53:15,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-06 04:53:15,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-06 04:53:15,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-06 04:53:15,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-06 04:53:15,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-06 04:53:15,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-06 04:53:15,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-06 04:53:15,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-06 04:53:15,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-06 04:53:15,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-06 04:53:15,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-06 04:53:15,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-06 04:53:15,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-06 04:53:15,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-06 04:53:15,560 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.019926288908112877); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.033558164324305036, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.019926288908112877); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01375); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.050083333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-06 04:53:15,561 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-04-06 04:53:15,561 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.017134717178725802, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.019926288908112877); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.033558164324305036, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.019926288908112877); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01375); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.050083333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-04-06 04:53:15,835 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 405 ms to try 5000 different iterations.  Found a solution that moves 1010 regions; Going from a computed imbalance of 0.017134717178725802 to a new imbalance of 6.931127426300711E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005883687854222971); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.011111111111111112); MoveCostFunction : (multiplier=7.0, imbalance=0.11222222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005883687854222971); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00425); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-06 04:53:15,838 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1614468590:81 , srv1730867590:82 , srv2056304677:82 , srv81493031:82 , srv1047787580:83 , srv1630656074:83 , srv2092085892:83 , srv2093800900:83 , srv2108337245:83 , srv2115819527:83 , srv942254445:83 , srv1284211044:84 , srv1643521916:84 , srv1689815017:84 , srv169589445:84 , srv1701121833:84 , srv1705243257:84 , srv1726827904:84 , srv1736304422:84 , srv1865824773:84 , srv1872762437:84 , srv1945220624:84 , srv21859518:84 , srv386038318:84 , srv669378119:84 , srv754160346:84 , srv922504236:84 , srv990020556:84 , srv1209401213:85 , srv1273105882:85 , srv1290696016:85 , srv1294528962:85 , srv1394281125:85 , srv1471146614:85 , srv1538731738:85 , srv1560363132:85 , srv1573268231:85 , srv1593377968:85 , srv1687993139:85 , srv1818750563:85 , srv18217004:85 , srv1831953645:85 , srv2017696821:85 , srv2124973595:85 , srv294447006:85 , srv416102551:85 , srv478784562:85 , srv485926847:85 , srv634085424:85 , srv6914517:85 , srv6977439:85 , srv7227041:85 , srv931724882:85 , srv1013500298:86 , srv1052000468:86 , srv1116008301:86 , srv1249372264:86 , srv1512682153:86 , srv1630272005:86 , srv1644027064:86 , srv1670359643:86 , srv1687248088:86 , srv1718979354:86 , srv1735037161:86 , srv1782828197:86 , srv1844569158:86 , srv1984088225:86 , srv2092628978:86 , srv2129992504:86 , srv236028638:86 , srv282605673:86 , srv324657577:86 , srv413275167:86 , srv477375114:86 , srv590382952:86 , srv730318944:86 , srv844345406:86 , srv951218005:86 , srv100445676:87 , srv1276871544:87 , srv1294373625:87 , srv1295441389:87 , srv1360043559:87 , srv1367740445:87 , srv1370362306:87 , srv1463932930:87 , srv1585097210:87 , srv1786057120:87 , srv1797616755:87 , srv1907230655:87 , srv423272867:87 , srv477780892:87 , srv568038280:87 , srv678247115:87 , srv796872928:87 , srv942418437:87 , srv1117148452:88 , srv1546154494:88 , srv1767910198:88 , srv459891972:559 }
2024-04-06 04:53:15,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-06 04:53:15,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv568038280=81, srv922504236=94, srv2093800900=62, srv1644027064=32, srv2092085892=60, srv1945220624=56, srv1726827904=41, srv1614468590=28, srv1786057120=47, srv1284211044=10, srv1818750563=49, srv2108337245=63, srv942254445=96, srv1116008301=4, srv416102551=74, srv21859518=67, srv413275167=73, srv236028638=68, srv6977439=87, srv477780892=78, srv669378119=84, srv477375114=77, srv423272867=75, srv1736304422=44, srv1670359643=33, srv634085424=83, srv324657577=71, srv730318944=89, srv459891972=76, srv796872928=91, srv2017696821=58, srv1630656074=30, srv1782828197=46, srv294447006=70, srv1512682153=21, srv1471146614=20, srv169589445=37, srv1687993139=35, srv1705243257=39, srv1573268231=25, srv1767910198=45, srv1538731738=22, srv282605673=69, srv1276871544=9, srv100445676=0, srv942418437=97, srv931724882=95, srv2092628978=61, srv1052000468=3, srv1360043559=15, srv2115819527=64, srv1249372264=7, srv1463932930=19, srv1865824773=53, srv844345406=93, srv7227041=88, srv2056304677=59, srv1546154494=23, srv1117148452=5, srv1907230655=55, srv1718979354=40, srv1730867590=42, srv2124973595=65, srv1394281125=18, srv1294373625=12, srv1689815017=36, srv990020556=99, srv18217004=50, srv754160346=90, srv1735037161=43, srv1290696016=11, srv1687248088=34, srv2129992504=66, srv478784562=79, srv1593377968=27, srv386038318=72, srv6914517=86, srv1643521916=31, srv1294528962=13, srv1047787580=2, srv1872762437=54, srv1844569158=52, srv590382952=82, srv1630272005=29, srv1273105882=8, srv485926847=80, srv1013500298=1, srv1295441389=14, srv1209401213=6, srv1831953645=51, srv1701121833=38, srv1367740445=16, srv1370362306=17, srv1560363132=24, srv1984088225=57, srv951218005=98, srv678247115=85, srv1585097210=26, srv81493031=92, srv1797616755=48} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-06 04:53:15,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-06 04:53:15,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-06 04:53:15,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-06 04:53:15,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-06 04:53:15,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-06 04:53:15,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-06 04:53:15,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-06 04:53:15,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-06 04:53:15,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-06 04:53:15,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-06 04:53:15,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-06 04:53:15,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-06 04:53:15,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-06 04:53:15,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-06 04:53:15,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-06 04:53:15,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-06 04:53:15,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-06 04:53:15,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-06 04:53:15,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-06 04:53:15,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-06 04:53:15,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-06 04:53:15,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-06 04:53:15,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-06 04:53:15,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-06 04:53:15,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-06 04:53:15,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-06 04:53:15,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-06 04:53:15,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-06 04:53:15,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-06 04:53:15,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-06 04:53:15,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-06 04:53:15,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-06 04:53:15,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-06 04:53:15,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-06 04:53:15,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-06 04:53:15,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-06 04:53:15,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-06 04:53:15,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-06 04:53:15,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-06 04:53:15,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-06 04:53:15,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-06 04:53:15,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-06 04:53:15,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-06 04:53:15,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-06 04:53:15,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-06 04:53:15,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-06 04:53:15,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-06 04:53:15,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-06 04:53:15,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-06 04:53:15,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-06 04:53:15,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-06 04:53:15,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-06 04:53:15,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-06 04:53:15,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-06 04:53:15,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-06 04:53:15,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-06 04:53:15,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-06 04:53:15,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-06 04:53:15,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-06 04:53:15,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-06 04:53:15,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-06 04:53:15,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-06 04:53:15,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-06 04:53:15,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-06 04:53:15,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-06 04:53:15,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-06 04:53:15,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-06 04:53:15,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-06 04:53:15,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-06 04:53:15,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-06 04:53:15,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-06 04:53:15,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-06 04:53:15,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-06 04:53:15,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-06 04:53:15,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-06 04:53:15,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-06 04:53:15,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-06 04:53:15,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-06 04:53:15,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-06 04:53:15,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-06 04:53:15,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-06 04:53:15,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-06 04:53:15,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-06 04:53:15,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-06 04:53:15,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-06 04:53:15,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-06 04:53:15,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-06 04:53:15,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-06 04:53:15,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-06 04:53:15,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-06 04:53:15,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-06 04:53:15,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-06 04:53:15,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-06 04:53:15,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-06 04:53:15,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-06 04:53:15,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-06 04:53:15,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-06 04:53:15,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-06 04:53:15,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-06 04:53:15,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-06 04:53:15,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-06 04:53:16,023 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005883687854222971); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.011111111111111112); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005883687854222971); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00425); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-06 04:53:16,024 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-04-06 04:53:16,024 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=6.86040571473526E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005883687854222971); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.011111111111111112); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005883687854222971); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00425); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-04-06 04:53:16,430 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 540 ms to try 5000 different iterations.  Found a solution that moves 219 regions; Going from a computed imbalance of 6.86040571473526E-4 to a new imbalance of 4.760376727601918E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0030336681651881225); MoveCostFunction : (multiplier=7.0, imbalance=0.024333333333333332); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-06 04:53:16,431 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1844569158:82 , srv1295441389:83 , srv1643521916:83 , srv568038280:83 , srv931724882:83 , srv1047787580:84 , srv1052000468:84 , srv1116008301:84 , srv1249372264:84 , srv1273105882:84 , srv1294373625:84 , srv1294528962:84 , srv1360043559:84 , srv1367740445:84 , srv1370362306:84 , srv1471146614:84 , srv1546154494:84 , srv1560363132:84 , srv1614468590:84 , srv1670359643:84 , srv1718979354:84 , srv1730867590:84 , srv1735037161:84 , srv1736304422:84 , srv1767910198:84 , srv1797616755:84 , srv1818750563:84 , srv18217004:84 , srv1907230655:84 , srv2017696821:84 , srv2056304677:84 , srv2115819527:84 , srv2129992504:84 , srv236028638:84 , srv282605673:84 , srv324657577:84 , srv386038318:84 , srv413275167:84 , srv423272867:84 , srv477780892:84 , srv485926847:84 , srv590382952:84 , srv678247115:84 , srv6977439:84 , srv7227041:84 , srv796872928:84 , srv922504236:84 , srv951218005:84 , srv990020556:84 , srv100445676:85 , srv1013500298:85 , srv1117148452:85 , srv1209401213:85 , srv1276871544:85 , srv1284211044:85 , srv1290696016:85 , srv1394281125:85 , srv1463932930:85 , srv1512682153:85 , srv1538731738:85 , srv1573268231:85 , srv1585097210:85 , srv1593377968:85 , srv1630272005:85 , srv1644027064:85 , srv1687248088:85 , srv1687993139:85 , srv169589445:85 , srv1705243257:85 , srv1726827904:85 , srv1782828197:85 , srv1786057120:85 , srv1831953645:85 , srv1872762437:85 , srv1945220624:85 , srv1984088225:85 , srv2092628978:85 , srv2108337245:85 , srv2124973595:85 , srv21859518:85 , srv294447006:85 , srv416102551:85 , srv478784562:85 , srv634085424:85 , srv669378119:85 , srv730318944:85 , srv754160346:85 , srv81493031:85 , srv844345406:85 , srv942254445:85 , srv942418437:85 , srv1689815017:86 , srv1701121833:86 , srv1865824773:86 , srv2092085892:86 , srv2093800900:86 , srv477375114:86 , srv6914517:86 , srv1630656074:87 , srv459891972:631 }
2024-04-06 04:53:16,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-06 04:53:16,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv568038280=81, srv922504236=94, srv2093800900=62, srv1644027064=32, srv2092085892=60, srv1945220624=56, srv1726827904=41, srv1614468590=28, srv1786057120=47, srv1284211044=10, srv1818750563=49, srv2108337245=63, srv942254445=96, srv1116008301=4, srv416102551=74, srv21859518=67, srv413275167=73, srv236028638=68, srv6977439=87, srv477780892=78, srv669378119=84, srv477375114=77, srv423272867=75, srv1736304422=44, srv1670359643=33, srv634085424=83, srv324657577=71, srv730318944=89, srv459891972=76, srv796872928=91, srv2017696821=58, srv1630656074=30, srv1782828197=46, srv294447006=70, srv1512682153=21, srv1471146614=20, srv169589445=37, srv1687993139=35, srv1705243257=39, srv1573268231=25, srv1767910198=45, srv1538731738=22, srv282605673=69, srv1276871544=9, srv100445676=0, srv942418437=97, srv931724882=95, srv2092628978=61, srv1052000468=3, srv1360043559=15, srv2115819527=64, srv1249372264=7, srv1463932930=19, srv1865824773=53, srv844345406=93, srv7227041=88, srv2056304677=59, srv1546154494=23, srv1117148452=5, srv1907230655=55, srv1718979354=40, srv1730867590=42, srv2124973595=65, srv1394281125=18, srv1294373625=12, srv1689815017=36, srv990020556=99, srv18217004=50, srv754160346=90, srv1735037161=43, srv1290696016=11, srv1687248088=34, srv2129992504=66, srv478784562=79, srv1593377968=27, srv386038318=72, srv6914517=86, srv1643521916=31, srv1294528962=13, srv1047787580=2, srv1872762437=54, srv1844569158=52, srv590382952=82, srv1630272005=29, srv1273105882=8, srv485926847=80, srv1013500298=1, srv1295441389=14, srv1209401213=6, srv1831953645=51, srv1701121833=38, srv1367740445=16, srv1370362306=17, srv1560363132=24, srv1984088225=57, srv951218005=98, srv678247115=85, srv1585097210=26, srv81493031=92, srv1797616755=48} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-06 04:53:16,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-06 04:53:16,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-06 04:53:16,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-06 04:53:16,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-06 04:53:16,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-06 04:53:16,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-06 04:53:16,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-06 04:53:16,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-06 04:53:16,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-06 04:53:16,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-06 04:53:16,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-06 04:53:16,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-06 04:53:16,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-06 04:53:16,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-06 04:53:16,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-06 04:53:16,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-06 04:53:16,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-06 04:53:16,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-06 04:53:16,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-06 04:53:16,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-06 04:53:16,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-06 04:53:16,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-06 04:53:16,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-06 04:53:16,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-06 04:53:16,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-06 04:53:16,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-06 04:53:16,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-06 04:53:16,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-06 04:53:16,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-06 04:53:16,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-06 04:53:16,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-06 04:53:16,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-06 04:53:16,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-06 04:53:16,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-06 04:53:16,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-06 04:53:16,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-06 04:53:16,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-06 04:53:16,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-06 04:53:16,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-06 04:53:16,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-06 04:53:16,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-06 04:53:16,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-06 04:53:16,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-06 04:53:16,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-06 04:53:16,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-06 04:53:16,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-06 04:53:16,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-06 04:53:16,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-06 04:53:16,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-06 04:53:16,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-06 04:53:16,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-06 04:53:16,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-06 04:53:16,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-06 04:53:16,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-06 04:53:16,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-06 04:53:16,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-06 04:53:16,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-06 04:53:16,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-06 04:53:16,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-06 04:53:16,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-06 04:53:16,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-06 04:53:16,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-06 04:53:16,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-06 04:53:16,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-06 04:53:16,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-06 04:53:16,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-06 04:53:16,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-06 04:53:16,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-06 04:53:16,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-06 04:53:16,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-06 04:53:16,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-06 04:53:16,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-06 04:53:16,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-06 04:53:16,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-06 04:53:16,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-06 04:53:16,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-06 04:53:16,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-06 04:53:16,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-06 04:53:16,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-06 04:53:16,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-06 04:53:16,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-06 04:53:16,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-06 04:53:16,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-06 04:53:16,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-06 04:53:16,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-06 04:53:16,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-06 04:53:16,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-06 04:53:16,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-06 04:53:16,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-06 04:53:16,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-06 04:53:16,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-06 04:53:16,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-06 04:53:16,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-06 04:53:16,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-06 04:53:16,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-06 04:53:16,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-06 04:53:16,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-06 04:53:16,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-06 04:53:16,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-06 04:53:16,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-06 04:53:16,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-06 04:53:16,611 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0030336681651881225); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-06 04:53:16,612 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-04-06 04:53:16,612 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=4.6070296500491095E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0030336681651881225); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-04-06 04:53:16,872 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 396 ms to try 5000 different iterations.  Found a solution that moves 48 regions; Going from a computed imbalance of 4.6070296500491095E-5 to a new imbalance of 7.409342480006837E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.005333333333333333); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-06 04:53:16,873 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1117148452:83 , srv1394281125:83 , srv1630656074:83 , srv1701121833:83 , srv2124973595:83 , srv21859518:83 , srv416102551:83 , srv477375114:83 , srv6914517:83 , srv844345406:83 , srv100445676:84 , srv1013500298:84 , srv1047787580:84 , srv1052000468:84 , srv1209401213:84 , srv1249372264:84 , srv1276871544:84 , srv1284211044:84 , srv1290696016:84 , srv1294373625:84 , srv1294528962:84 , srv1295441389:84 , srv1360043559:84 , srv1367740445:84 , srv1370362306:84 , srv1463932930:84 , srv1471146614:84 , srv1512682153:84 , srv1538731738:84 , srv1560363132:84 , srv1573268231:84 , srv1585097210:84 , srv1593377968:84 , srv1630272005:84 , srv1643521916:84 , srv1644027064:84 , srv1670359643:84 , srv1687248088:84 , srv1687993139:84 , srv1689815017:84 , srv169589445:84 , srv1705243257:84 , srv1718979354:84 , srv1726827904:84 , srv1730867590:84 , srv1735037161:84 , srv1767910198:84 , srv1782828197:84 , srv1786057120:84 , srv1797616755:84 , srv1818750563:84 , srv18217004:84 , srv1831953645:84 , srv1865824773:84 , srv1872762437:84 , srv1907230655:84 , srv1945220624:84 , srv1984088225:84 , srv2017696821:84 , srv2056304677:84 , srv2092085892:84 , srv2092628978:84 , srv2093800900:84 , srv2108337245:84 , srv2115819527:84 , srv2129992504:84 , srv236028638:84 , srv282605673:84 , srv294447006:84 , srv386038318:84 , srv413275167:84 , srv423272867:84 , srv477780892:84 , srv478784562:84 , srv568038280:84 , srv590382952:84 , srv634085424:84 , srv669378119:84 , srv678247115:84 , srv6977439:84 , srv730318944:84 , srv754160346:84 , srv796872928:84 , srv81493031:84 , srv922504236:84 , srv931724882:84 , srv942254445:84 , srv942418437:84 , srv951218005:84 , srv990020556:84 , srv1116008301:85 , srv1273105882:85 , srv1546154494:85 , srv1614468590:85 , srv1736304422:85 , srv1844569158:85 , srv324657577:85 , srv485926847:85 , srv7227041:85 , srv459891972:685 }
2024-04-06 04:53:16,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-06 04:53:16,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv568038280=81, srv922504236=94, srv2093800900=62, srv1644027064=32, srv2092085892=60, srv1945220624=56, srv1726827904=41, srv1614468590=28, srv1786057120=47, srv1284211044=10, srv1818750563=49, srv2108337245=63, srv942254445=96, srv1116008301=4, srv416102551=74, srv21859518=67, srv413275167=73, srv236028638=68, srv6977439=87, srv477780892=78, srv669378119=84, srv477375114=77, srv423272867=75, srv1736304422=44, srv1670359643=33, srv634085424=83, srv324657577=71, srv730318944=89, srv459891972=76, srv796872928=91, srv2017696821=58, srv1630656074=30, srv1782828197=46, srv294447006=70, srv1512682153=21, srv1471146614=20, srv169589445=37, srv1687993139=35, srv1705243257=39, srv1573268231=25, srv1767910198=45, srv1538731738=22, srv282605673=69, srv1276871544=9, srv100445676=0, srv942418437=97, srv931724882=95, srv2092628978=61, srv1052000468=3, srv1360043559=15, srv2115819527=64, srv1249372264=7, srv1463932930=19, srv1865824773=53, srv844345406=93, srv7227041=88, srv2056304677=59, srv1546154494=23, srv1117148452=5, srv1907230655=55, srv1718979354=40, srv1730867590=42, srv2124973595=65, srv1394281125=18, srv1294373625=12, srv1689815017=36, srv990020556=99, srv18217004=50, srv754160346=90, srv1735037161=43, srv1290696016=11, srv1687248088=34, srv2129992504=66, srv478784562=79, srv1593377968=27, srv386038318=72, srv6914517=86, srv1643521916=31, srv1294528962=13, srv1047787580=2, srv1872762437=54, srv1844569158=52, srv590382952=82, srv1630272005=29, srv1273105882=8, srv485926847=80, srv1013500298=1, srv1295441389=14, srv1209401213=6, srv1831953645=51, srv1701121833=38, srv1367740445=16, srv1370362306=17, srv1560363132=24, srv1984088225=57, srv951218005=98, srv678247115=85, srv1585097210=26, srv81493031=92, srv1797616755=48} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-06 04:53:16,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-06 04:53:16,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-06 04:53:16,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-06 04:53:16,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-06 04:53:16,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-06 04:53:16,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-06 04:53:16,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-06 04:53:16,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-06 04:53:16,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-06 04:53:16,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-06 04:53:16,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-06 04:53:16,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-06 04:53:16,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-06 04:53:16,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-06 04:53:16,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-06 04:53:16,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-06 04:53:16,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-06 04:53:16,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-06 04:53:16,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-06 04:53:16,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-06 04:53:16,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-06 04:53:16,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-06 04:53:16,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-06 04:53:16,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-06 04:53:16,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-06 04:53:16,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-06 04:53:16,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-06 04:53:16,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-06 04:53:16,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-06 04:53:16,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-06 04:53:16,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-06 04:53:16,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-06 04:53:16,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-06 04:53:16,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-06 04:53:16,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-06 04:53:16,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-06 04:53:16,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-06 04:53:16,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-06 04:53:16,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-06 04:53:16,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-06 04:53:16,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-06 04:53:16,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-06 04:53:16,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-06 04:53:16,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-06 04:53:16,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-06 04:53:16,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-06 04:53:16,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-06 04:53:16,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-06 04:53:16,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-06 04:53:16,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-06 04:53:16,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-06 04:53:16,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-06 04:53:16,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-06 04:53:16,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-06 04:53:16,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-06 04:53:16,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-06 04:53:16,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-06 04:53:16,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-06 04:53:16,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-06 04:53:16,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-06 04:53:16,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-06 04:53:16,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-06 04:53:16,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-06 04:53:16,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-06 04:53:16,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-06 04:53:16,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-06 04:53:16,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-06 04:53:16,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-06 04:53:16,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-06 04:53:16,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-06 04:53:16,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-06 04:53:16,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-06 04:53:16,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-06 04:53:16,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-06 04:53:16,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-06 04:53:16,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-06 04:53:16,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-06 04:53:16,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-06 04:53:16,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-06 04:53:16,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-06 04:53:16,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-06 04:53:16,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-06 04:53:16,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-06 04:53:16,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-06 04:53:16,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-06 04:53:16,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-06 04:53:16,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-06 04:53:16,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-06 04:53:16,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-06 04:53:16,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-06 04:53:16,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-06 04:53:16,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-06 04:53:16,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-06 04:53:16,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-06 04:53:16,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-06 04:53:16,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-06 04:53:16,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-06 04:53:16,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-06 04:53:16,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-06 04:53:16,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-06 04:53:16,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-06 04:53:16,997 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.073239296329447E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-06 04:53:16,997 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1117148452:83 , srv1394281125:83 , srv1630656074:83 , srv1701121833:83 , srv2124973595:83 , srv21859518:83 , srv416102551:83 , srv477375114:83 , srv6914517:83 , srv844345406:83 , srv100445676:84 , srv1013500298:84 , srv1047787580:84 , srv1052000468:84 , srv1209401213:84 , srv1249372264:84 , srv1276871544:84 , srv1284211044:84 , srv1290696016:84 , srv1294373625:84 , srv1294528962:84 , srv1295441389:84 , srv1360043559:84 , srv1367740445:84 , srv1370362306:84 , srv1463932930:84 , srv1471146614:84 , srv1512682153:84 , srv1538731738:84 , srv1560363132:84 , srv1573268231:84 , srv1585097210:84 , srv1593377968:84 , srv1630272005:84 , srv1643521916:84 , srv1644027064:84 , srv1670359643:84 , srv1687248088:84 , srv1687993139:84 , srv1689815017:84 , srv169589445:84 , srv1705243257:84 , srv1718979354:84 , srv1726827904:84 , srv1730867590:84 , srv1735037161:84 , srv1767910198:84 , srv1782828197:84 , srv1786057120:84 , srv1797616755:84 , srv1818750563:84 , srv18217004:84 , srv1831953645:84 , srv1865824773:84 , srv1872762437:84 , srv1907230655:84 , srv1945220624:84 , srv1984088225:84 , srv2017696821:84 , srv2056304677:84 , srv2092085892:84 , srv2092628978:84 , srv2093800900:84 , srv2108337245:84 , srv2115819527:84 , srv2129992504:84 , srv236028638:84 , srv282605673:84 , srv294447006:84 , srv386038318:84 , srv413275167:84 , srv423272867:84 , srv477780892:84 , srv478784562:84 , srv568038280:84 , srv590382952:84 , srv634085424:84 , srv669378119:84 , srv678247115:84 , srv6977439:84 , srv730318944:84 , srv754160346:84 , srv796872928:84 , srv81493031:84 , srv922504236:84 , srv931724882:84 , srv942254445:84 , srv942418437:84 , srv951218005:84 , srv990020556:84 , srv1116008301:85 , srv1273105882:85 , srv1546154494:85 , srv1614468590:85 , srv1736304422:85 , srv1844569158:85 , srv324657577:85 , srv485926847:85 , srv7227041:85 , srv459891972:685 }
2024-04-06 04:53:17,022 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=327 (was 304) - SystemLoadAverage LEAK? -, ProcessCount=172 (was 172), AvailableMemoryMB=10226 (was 10969)
2024-04-06 04:53:17,031 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=327, ProcessCount=172, AvailableMemoryMB=10226
2024-04-06 04:53:17,031 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-04-06 04:53:17,031 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2024-04-06 04:53:17,039 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1148315139:84 , srv1208730298:84 , srv1429708897:84 , srv1431065218:84 , srv1445905861:84 , srv1463524404:84 , srv1510086591:84 , srv1577912652:84 , srv1608761283:84 , srv1747559349:84 , srv1772898874:84 , srv177728827:84 , srv1811795231:84 , srv1847797812:84 , srv185166487:84 , srv1927179447:84 , srv2100308498:84 , srv2107071761:84 , srv392113821:84 , srv575047654:84 , srv636586779:84 , srv692909845:84 , srv708778559:84 , srv828638757:84 , srv868293211:84 , srv893575642:84 , srv897499182:84 , srv907744513:84 , srv943002965:84 , srv1013746325:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2024-04-06 04:53:17,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-06 04:53:17,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1608761283=9, srv1463524404=6, srv868293211=25, srv1148315139=1, srv185166487=15, srv1445905861=5, srv1747559349=10, srv2100308498=17, srv907744513=28, srv1013746325=0, srv828638757=24, srv392113821=19, srv897499182=27, srv943002965=29, srv1772898874=11, srv692909845=22, srv575047654=20, srv2107071761=18, srv708778559=23, srv1510086591=7, srv1811795231=13, srv1847797812=14, srv636586779=21, srv893575642=26, srv1577912652=8, srv1429708897=3, srv1927179447=16, srv1431065218=4, srv1208730298=2, srv177728827=12} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-06 04:53:17,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-06 04:53:17,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-06 04:53:17,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-06 04:53:17,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-06 04:53:17,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-06 04:53:17,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-06 04:53:17,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-06 04:53:17,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-06 04:53:17,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-06 04:53:17,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-06 04:53:17,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-06 04:53:17,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-06 04:53:17,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-06 04:53:17,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-06 04:53:17,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-06 04:53:17,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-06 04:53:17,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-06 04:53:17,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-06 04:53:17,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-06 04:53:17,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-06 04:53:17,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-06 04:53:17,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-06 04:53:17,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-06 04:53:17,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-06 04:53:17,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-06 04:53:17,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-06 04:53:17,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-06 04:53:17,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-06 04:53:17,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-06 04:53:17,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-06 04:53:17,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-04-06 04:53:17,063 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.083856301484648, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-06 04:53:17,063 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912457271732098, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.083856301484648, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2024-04-06 04:55:17,052 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6677510 different iterations.  Found a solution that moves 1841 regions; Going from a computed imbalance of 0.9912457271732098 to a new imbalance of 4.296985841319951E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6818518518518518, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-06 04:55:17,060 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1013746325:90 , srv1148315139:90 , srv1208730298:90 , srv1429708897:90 , srv1431065218:90 , srv1445905861:90 , srv1463524404:90 , srv1510086591:90 , srv1577912652:90 , srv1608761283:90 , srv1747559349:90 , srv1772898874:90 , srv177728827:90 , srv1811795231:90 , srv1847797812:90 , srv185166487:90 , srv1927179447:90 , srv2100308498:90 , srv2107071761:90 , srv392113821:90 , srv575047654:90 , srv636586779:90 , srv692909845:90 , srv708778559:90 , srv828638757:90 , srv868293211:90 , srv893575642:90 , srv897499182:90 , srv907744513:90 , srv943002965:90 }
2024-04-06 04:55:17,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-06 04:55:17,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1608761283=9, srv1463524404=6, srv868293211=25, srv1148315139=1, srv185166487=15, srv1445905861=5, srv1747559349=10, srv2100308498=17, srv907744513=28, srv1013746325=0, srv828638757=24, srv392113821=19, srv897499182=27, srv943002965=29, srv1772898874=11, srv692909845=22, srv575047654=20, srv2107071761=18, srv708778559=23, srv1510086591=7, srv1811795231=13, srv1847797812=14, srv636586779=21, srv893575642=26, srv1577912652=8, srv1429708897=3, srv1927179447=16, srv1431065218=4, srv1208730298=2, srv177728827=12} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-06 04:55:17,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-06 04:55:17,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-06 04:55:17,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-06 04:55:17,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-06 04:55:17,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-06 04:55:17,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-06 04:55:17,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-06 04:55:17,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-06 04:55:17,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-06 04:55:17,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-06 04:55:17,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-06 04:55:17,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-06 04:55:17,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-06 04:55:17,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-06 04:55:17,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-06 04:55:17,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-06 04:55:17,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-06 04:55:17,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-06 04:55:17,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-06 04:55:17,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-06 04:55:17,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-06 04:55:17,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-06 04:55:17,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-06 04:55:17,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-06 04:55:17,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-06 04:55:17,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-06 04:55:17,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-06 04:55:17,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-06 04:55:17,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-06 04:55:17,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-06 04:55:17,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-04-06 04:55:17,078 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-06 04:55:17,078 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1013746325:90 , srv1148315139:90 , srv1208730298:90 , srv1429708897:90 , srv1431065218:90 , srv1445905861:90 , srv1463524404:90 , srv1510086591:90 , srv1577912652:90 , srv1608761283:90 , srv1747559349:90 , srv1772898874:90 , srv177728827:90 , srv1811795231:90 , srv1847797812:90 , srv185166487:90 , srv1927179447:90 , srv2100308498:90 , srv2107071761:90 , srv392113821:90 , srv575047654:90 , srv636586779:90 , srv692909845:90 , srv708778559:90 , srv828638757:90 , srv868293211:90 , srv893575642:90 , srv897499182:90 , srv907744513:90 , srv943002965:90 }
2024-04-06 04:55:17,091 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=314 (was 327), ProcessCount=167 (was 172), AvailableMemoryMB=9343 (was 10226)