2024-03-01 18:53:18,491 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2024-03-01 18:53:18,838 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2024-03-01 18:53:18,954 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2024-03-01 18:53:19,024 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-03-01 18:53:19,035 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-03-01 18:53:19,052 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=287, ProcessCount=170, AvailableMemoryMB=10343
2024-03-01 18:53:19,054 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-03-01 18:53:19,055 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-03-01 18:53:19,188 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1033590213:84 , srv1059104371:84 , srv1073143213:84 , srv1084439693:84 , srv1151052315:84 , srv1177205705:84 , srv1204208:84 , srv1245216962:84 , srv132537820:84 , srv1333602721:84 , srv14035263:84 , srv1403641949:84 , srv1411117789:84 , srv1429254028:84 , srv1429707920:84 , srv1437200318:84 , srv1468300190:84 , srv1471954890:84 , srv1489220091:84 , srv1496678414:84 , srv1528028341:84 , srv1550470386:84 , srv1551773678:84 , srv1552768859:84 , srv1570632207:84 , srv1578197234:84 , srv1598364732:84 , srv1622728513:84 , srv1644218081:84 , srv1649233505:84 , srv166693771:84 , srv1692481288:84 , srv1697664455:84 , srv1704770587:84 , srv1710721463:84 , srv1733298636:84 , srv1753430617:84 , srv1759683478:84 , srv1781313756:84 , srv1782884744:84 , srv1784914789:84 , srv1813978467:84 , srv1827180776:84 , srv1844071846:84 , srv1844885528:84 , srv1861197586:84 , srv1877138106:84 , srv18805151:84 , srv1883212251:84 , srv1885616195:84 , srv1886108625:84 , srv1917343811:84 , srv1936348659:84 , srv2009608428:84 , srv2013774898:84 , srv2025734516:84 , srv2029270370:84 , srv2048894320:84 , srv2068806920:84 , srv2096057271:84 , srv2125368666:84 , srv2130783396:84 , srv223188701:84 , srv248383462:84 , srv257248820:84 , srv267813962:84 , srv295967958:84 , srv301746290:84 , srv320135483:84 , srv321178672:84 , srv346610794:84 , srv41857349:84 , srv419882147:84 , srv436748096:84 , srv453263206:84 , srv461297520:84 , srv531884078:84 , srv569120017:84 , srv574521716:84 , srv580413253:84 , srv597861642:84 , srv598060195:84 , srv646488862:84 , srv654676229:84 , srv701289072:84 , srv708677690:84 , srv734987619:84 , srv79497470:84 , srv816725810:84 , srv856572929:84 , srv85851768:84 , srv868095678:84 , srv872891794:84 , srv886382793:84 , srv920479163:84 , srv932087280:84 , srv932226618:84 , srv935858046:84 , srv981521990:84 , srv1295433308:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2024-03-01 18:53:19,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-03-01 18:53:19,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1782884744=40, srv223188701=63, srv2048894320=58, srv920479163=95, srv2125368666=61, srv1598364732=27, srv1733298636=36, srv1429254028=14, srv1644218081=29, srv1784914789=41, srv531884078=77, srv1403641949=12, srv1883212251=49, srv2130783396=62, srv436748096=74, srv1917343811=52, srv1578197234=26, srv1827180776=43, srv1333602721=10, srv2013774898=55, srv320135483=69, srv267813962=66, srv1704770587=34, srv1813978467=42, srv1551773678=23, srv1552768859=24, srv701289072=85, srv935858046=98, srv574521716=79, srv816725810=89, srv419882147=73, srv1496678414=20, srv646488862=83, srv856572929=90, srv2068806920=59, srv248383462=64, srv79497470=88, srv2025734516=56, srv1622728513=28, srv166693771=31, srv2009608428=54, srv654676229=84, srv868095678=92, srv1033590213=0, srv453263206=75, srv85851768=91, srv2029270370=57, srv1844885528=45, srv2096057271=60, srv1753430617=37, srv872891794=93, srv1697664455=33, srv1528028341=21, srv132537820=9, srv321178672=70, srv1429707920=15, srv1471954890=18, srv461297520=76, srv1073143213=2, srv257248820=65, srv1861197586=46, srv569120017=78, srv1411117789=13, srv708677690=86, srv1936348659=53, srv1759683478=38, srv1468300190=17, srv1885616195=50, srv1886108625=51, srv1710721463=35, srv1781313756=39, srv18805151=48, srv1059104371=1, srv301746290=68, srv1084439693=3, srv1151052315=4, srv1204208=6, srv1844071846=44, srv598060195=82, srv1245216962=7, srv1550470386=22, srv1570632207=25, srv41857349=72, srv580413253=80, srv1649233505=30, srv1437200318=16, srv932226618=97, srv295967958=67, srv1877138106=47, srv14035263=11, srv886382793=94, srv981521990=99, srv734987619=87, srv1295433308=8, srv346610794=71, srv1177205705=5, srv1489220091=19, srv1692481288=32, srv932087280=96, srv597861642=81} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-03-01 18:53:19,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-03-01 18:53:19,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-03-01 18:53:19,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-03-01 18:53:19,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-03-01 18:53:19,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-03-01 18:53:19,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-03-01 18:53:19,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-03-01 18:53:19,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-03-01 18:53:19,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-03-01 18:53:19,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-03-01 18:53:19,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-03-01 18:53:19,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-03-01 18:53:19,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-03-01 18:53:19,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-03-01 18:53:19,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-03-01 18:53:19,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-03-01 18:53:19,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-03-01 18:53:19,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-03-01 18:53:19,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-03-01 18:53:19,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-03-01 18:53:19,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-03-01 18:53:19,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-03-01 18:53:19,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-03-01 18:53:19,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-03-01 18:53:19,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-03-01 18:53:19,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-03-01 18:53:19,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-03-01 18:53:19,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-03-01 18:53:19,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-03-01 18:53:19,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-03-01 18:53:19,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-03-01 18:53:19,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-03-01 18:53:19,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-03-01 18:53:19,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-03-01 18:53:19,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-03-01 18:53:19,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-03-01 18:53:19,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-03-01 18:53:19,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-03-01 18:53:19,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-03-01 18:53:19,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-03-01 18:53:19,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-03-01 18:53:19,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-03-01 18:53:19,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-03-01 18:53:19,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-03-01 18:53:19,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-03-01 18:53:19,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-03-01 18:53:19,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-03-01 18:53:19,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-03-01 18:53:19,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-03-01 18:53:19,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-03-01 18:53:19,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-03-01 18:53:19,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-03-01 18:53:19,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-03-01 18:53:19,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-03-01 18:53:19,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-03-01 18:53:19,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-03-01 18:53:19,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-03-01 18:53:19,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-03-01 18:53:19,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-03-01 18:53:19,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-03-01 18:53:19,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-03-01 18:53:19,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-03-01 18:53:19,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-03-01 18:53:19,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-03-01 18:53:19,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-03-01 18:53:19,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-03-01 18:53:19,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-03-01 18:53:19,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-03-01 18:53:19,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-03-01 18:53:19,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-03-01 18:53:19,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-03-01 18:53:19,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-03-01 18:53:19,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-03-01 18:53:19,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-03-01 18:53:19,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-03-01 18:53:19,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-03-01 18:53:19,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-03-01 18:53:19,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-03-01 18:53:19,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-03-01 18:53:19,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-03-01 18:53:19,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-03-01 18:53:19,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-03-01 18:53:19,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-03-01 18:53:19,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-03-01 18:53:19,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-03-01 18:53:19,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-03-01 18:53:19,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-03-01 18:53:19,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-03-01 18:53:19,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-03-01 18:53:19,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-03-01 18:53:19,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-03-01 18:53:19,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-03-01 18:53:19,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-03-01 18:53:19,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-03-01 18:53:19,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-03-01 18:53:19,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-03-01 18:53:19,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-03-01 18:53:19,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-03-01 18:53:19,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-03-01 18:53:19,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-03-01 18:53:19,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-03-01 18:53:19,550 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-01 18:53:19,550 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-03-01 18:53:19,551 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-03-01 18:53:19,962 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 598 ms to try 5000 different iterations.  Found a solution that moves 4680 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.1771943583531518. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03993947284902227, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05275358297095894, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.52, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03993947284902227, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17266666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23641666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-01 18:53:19,982 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv132537820:81 , srv1844071846:82 , srv531884078:82 , srv1177205705:83 , srv1333602721:83 , srv14035263:83 , srv1697664455:83 , srv1813978467:83 , srv935858046:83 , srv1033590213:84 , srv1411117789:84 , srv1550470386:84 , srv1551773678:84 , srv1622728513:84 , srv1733298636:84 , srv1753430617:84 , srv1861197586:84 , srv2029270370:84 , srv646488862:84 , srv654676229:84 , srv708677690:84 , srv1084439693:85 , srv1403641949:85 , srv1471954890:85 , srv1528028341:85 , srv1552768859:85 , srv1692481288:85 , srv1759683478:85 , srv1781313756:85 , srv1827180776:85 , srv1885616195:85 , srv1936348659:85 , srv2068806920:85 , srv2096057271:85 , srv2130783396:85 , srv321178672:85 , srv346610794:85 , srv436748096:85 , srv598060195:85 , srv872891794:85 , srv886382793:85 , srv932226618:85 , srv1245216962:86 , srv1437200318:86 , srv1570632207:86 , srv1782884744:86 , srv18805151:86 , srv320135483:86 , srv461297520:86 , srv580413253:86 , srv597861642:86 , srv868095678:86 , srv920479163:86 , srv1059104371:87 , srv1204208:87 , srv1644218081:87 , srv1649233505:87 , srv1710721463:87 , srv1883212251:87 , srv1917343811:87 , srv2009608428:87 , srv2048894320:87 , srv223188701:87 , srv248383462:87 , srv267813962:87 , srv295967958:87 , srv569120017:87 , srv701289072:87 , srv79497470:87 , srv856572929:87 , srv932087280:87 , srv1429707920:88 , srv1496678414:88 , srv1598364732:88 , srv1704770587:88 , srv2125368666:88 , srv257248820:88 , srv301746290:88 , srv41857349:88 , srv419882147:88 , srv85851768:88 , srv1429254028:89 , srv1468300190:89 , srv166693771:89 , srv1784914789:89 , srv1844885528:89 , srv1886108625:89 , srv453263206:89 , srv816725810:89 , srv1578197234:90 , srv1877138106:90 , srv981521990:90 , srv1073143213:91 , srv1151052315:91 , srv734987619:91 , srv1489220091:92 , srv574521716:92 , srv2013774898:93 , srv2025734516:95 , srv1295433308:445 }
2024-03-01 18:53:19,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-03-01 18:53:19,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1782884744=40, srv223188701=63, srv2048894320=58, srv920479163=95, srv2125368666=61, srv1598364732=27, srv1733298636=36, srv1429254028=14, srv1644218081=29, srv1784914789=41, srv531884078=77, srv1403641949=12, srv1883212251=49, srv2130783396=62, srv436748096=74, srv1917343811=52, srv1578197234=26, srv1827180776=43, srv1333602721=10, srv2013774898=55, srv320135483=69, srv267813962=66, srv1704770587=34, srv1813978467=42, srv1551773678=23, srv1552768859=24, srv701289072=85, srv935858046=98, srv574521716=79, srv816725810=89, srv419882147=73, srv1496678414=20, srv646488862=83, srv856572929=90, srv2068806920=59, srv248383462=64, srv79497470=88, srv2025734516=56, srv1622728513=28, srv166693771=31, srv2009608428=54, srv654676229=84, srv868095678=92, srv1033590213=0, srv453263206=75, srv85851768=91, srv2029270370=57, srv1844885528=45, srv2096057271=60, srv1753430617=37, srv872891794=93, srv1697664455=33, srv1528028341=21, srv132537820=9, srv321178672=70, srv1429707920=15, srv1471954890=18, srv461297520=76, srv1073143213=2, srv257248820=65, srv1861197586=46, srv569120017=78, srv1411117789=13, srv708677690=86, srv1936348659=53, srv1759683478=38, srv1468300190=17, srv1885616195=50, srv1886108625=51, srv1710721463=35, srv1781313756=39, srv18805151=48, srv1059104371=1, srv301746290=68, srv1084439693=3, srv1151052315=4, srv1204208=6, srv1844071846=44, srv598060195=82, srv1245216962=7, srv1550470386=22, srv1570632207=25, srv41857349=72, srv580413253=80, srv1649233505=30, srv1437200318=16, srv932226618=97, srv295967958=67, srv1877138106=47, srv14035263=11, srv886382793=94, srv981521990=99, srv734987619=87, srv1295433308=8, srv346610794=71, srv1177205705=5, srv1489220091=19, srv1692481288=32, srv932087280=96, srv597861642=81} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-03-01 18:53:20,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-03-01 18:53:20,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-03-01 18:53:20,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-03-01 18:53:20,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-03-01 18:53:20,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-03-01 18:53:20,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-03-01 18:53:20,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-03-01 18:53:20,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-03-01 18:53:20,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-03-01 18:53:20,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-03-01 18:53:20,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-03-01 18:53:20,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-03-01 18:53:20,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-03-01 18:53:20,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-03-01 18:53:20,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-03-01 18:53:20,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-03-01 18:53:20,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-03-01 18:53:20,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-03-01 18:53:20,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-03-01 18:53:20,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-03-01 18:53:20,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-03-01 18:53:20,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-03-01 18:53:20,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-03-01 18:53:20,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-03-01 18:53:20,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-03-01 18:53:20,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-03-01 18:53:20,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-03-01 18:53:20,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-03-01 18:53:20,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-03-01 18:53:20,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-03-01 18:53:20,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-03-01 18:53:20,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-03-01 18:53:20,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-03-01 18:53:20,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-03-01 18:53:20,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-03-01 18:53:20,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-03-01 18:53:20,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-03-01 18:53:20,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-03-01 18:53:20,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-03-01 18:53:20,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-03-01 18:53:20,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-03-01 18:53:20,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-03-01 18:53:20,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-03-01 18:53:20,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-03-01 18:53:20,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-03-01 18:53:20,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-03-01 18:53:20,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-03-01 18:53:20,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-03-01 18:53:20,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-03-01 18:53:20,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-03-01 18:53:20,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-03-01 18:53:20,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-03-01 18:53:20,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-03-01 18:53:20,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-03-01 18:53:20,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-03-01 18:53:20,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-03-01 18:53:20,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-03-01 18:53:20,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-03-01 18:53:20,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-03-01 18:53:20,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-03-01 18:53:20,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-03-01 18:53:20,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-03-01 18:53:20,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-03-01 18:53:20,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-03-01 18:53:20,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-03-01 18:53:20,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-03-01 18:53:20,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-03-01 18:53:20,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-03-01 18:53:20,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-03-01 18:53:20,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-03-01 18:53:20,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-03-01 18:53:20,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-03-01 18:53:20,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-03-01 18:53:20,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-03-01 18:53:20,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-03-01 18:53:20,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-03-01 18:53:20,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-03-01 18:53:20,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-03-01 18:53:20,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-03-01 18:53:20,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-03-01 18:53:20,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-03-01 18:53:20,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-03-01 18:53:20,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-03-01 18:53:20,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-03-01 18:53:20,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-03-01 18:53:20,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-03-01 18:53:20,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-03-01 18:53:20,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-03-01 18:53:20,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-03-01 18:53:20,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-03-01 18:53:20,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-03-01 18:53:20,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-03-01 18:53:20,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-03-01 18:53:20,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-03-01 18:53:20,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-03-01 18:53:20,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-03-01 18:53:20,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-03-01 18:53:20,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-03-01 18:53:20,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-03-01 18:53:20,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-03-01 18:53:20,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-03-01 18:53:20,196 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03993947284902227, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05275358297095894, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03993947284902227, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17266666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23641666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-01 18:53:20,196 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-03-01 18:53:20,197 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17716158829274323, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03993947284902227, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05275358297095894, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03993947284902227, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17266666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23641666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-03-01 18:53:20,565 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 506 ms to try 5000 different iterations.  Found a solution that moves 2603 regions; Going from a computed imbalance of 0.17716158829274323 to a new imbalance of 0.017647265901814948. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021639958790070846); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.034873508801977704, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2892222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021639958790070846); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.014666666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04625, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-01 18:53:20,583 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv2013774898:77 , srv2025734516:78 , srv166693771:80 , srv574521716:80 , srv1151052315:81 , srv734987619:81 , srv1073143213:82 , srv1468300190:82 , srv1598364732:82 , srv1782884744:82 , srv1877138106:82 , srv2048894320:82 , srv453263206:82 , srv1059104371:83 , srv1204208:83 , srv1245216962:83 , srv1429707920:83 , srv1489220091:83 , srv1844885528:83 , srv2009608428:83 , srv2125368666:83 , srv321178672:83 , srv1578197234:84 , srv1644218081:84 , srv1710721463:84 , srv1784914789:84 , srv223188701:84 , srv257248820:84 , srv41857349:84 , srv856572929:84 , srv1429254028:85 , srv1704770587:85 , srv1781313756:85 , srv18805151:85 , srv1886108625:85 , srv1917343811:85 , srv248383462:85 , srv580413253:85 , srv597861642:85 , srv701289072:85 , srv932087280:85 , srv1496678414:86 , srv1528028341:86 , srv1551773678:86 , srv1552768859:86 , srv1570632207:86 , srv1733298636:86 , srv1861197586:86 , srv1883212251:86 , srv267813962:86 , srv320135483:86 , srv436748096:86 , srv461297520:86 , srv816725810:86 , srv920479163:86 , srv1033590213:87 , srv1084439693:87 , srv1437200318:87 , srv1471954890:87 , srv1759683478:87 , srv1813978467:87 , srv1827180776:87 , srv1936348659:87 , srv301746290:87 , srv346610794:87 , srv419882147:87 , srv569120017:87 , srv598060195:87 , srv646488862:87 , srv654676229:87 , srv708677690:87 , srv79497470:87 , srv1177205705:88 , srv1333602721:88 , srv14035263:88 , srv1403641949:88 , srv1411117789:88 , srv1550470386:88 , srv1622728513:88 , srv1753430617:88 , srv2029270370:88 , srv2068806920:88 , srv2096057271:88 , srv2130783396:88 , srv295967958:88 , srv868095678:88 , srv872891794:88 , srv886382793:88 , srv932226618:88 , srv981521990:88 , srv1844071846:89 , srv1885616195:89 , srv531884078:89 , srv85851768:89 , srv935858046:89 , srv1649233505:90 , srv1697664455:90 , srv132537820:91 , srv1692481288:91 , srv1295433308:521 }
2024-03-01 18:53:20,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-03-01 18:53:20,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1782884744=40, srv223188701=63, srv2048894320=58, srv920479163=95, srv2125368666=61, srv1598364732=27, srv1733298636=36, srv1429254028=14, srv1644218081=29, srv1784914789=41, srv531884078=77, srv1403641949=12, srv1883212251=49, srv2130783396=62, srv436748096=74, srv1917343811=52, srv1578197234=26, srv1827180776=43, srv1333602721=10, srv2013774898=55, srv320135483=69, srv267813962=66, srv1704770587=34, srv1813978467=42, srv1551773678=23, srv1552768859=24, srv701289072=85, srv935858046=98, srv574521716=79, srv816725810=89, srv419882147=73, srv1496678414=20, srv646488862=83, srv856572929=90, srv2068806920=59, srv248383462=64, srv79497470=88, srv2025734516=56, srv1622728513=28, srv166693771=31, srv2009608428=54, srv654676229=84, srv868095678=92, srv1033590213=0, srv453263206=75, srv85851768=91, srv2029270370=57, srv1844885528=45, srv2096057271=60, srv1753430617=37, srv872891794=93, srv1697664455=33, srv1528028341=21, srv132537820=9, srv321178672=70, srv1429707920=15, srv1471954890=18, srv461297520=76, srv1073143213=2, srv257248820=65, srv1861197586=46, srv569120017=78, srv1411117789=13, srv708677690=86, srv1936348659=53, srv1759683478=38, srv1468300190=17, srv1885616195=50, srv1886108625=51, srv1710721463=35, srv1781313756=39, srv18805151=48, srv1059104371=1, srv301746290=68, srv1084439693=3, srv1151052315=4, srv1204208=6, srv1844071846=44, srv598060195=82, srv1245216962=7, srv1550470386=22, srv1570632207=25, srv41857349=72, srv580413253=80, srv1649233505=30, srv1437200318=16, srv932226618=97, srv295967958=67, srv1877138106=47, srv14035263=11, srv886382793=94, srv981521990=99, srv734987619=87, srv1295433308=8, srv346610794=71, srv1177205705=5, srv1489220091=19, srv1692481288=32, srv932087280=96, srv597861642=81} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-03-01 18:53:20,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-03-01 18:53:20,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-03-01 18:53:20,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-03-01 18:53:20,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-03-01 18:53:20,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-03-01 18:53:20,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-03-01 18:53:20,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-03-01 18:53:20,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-03-01 18:53:20,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-03-01 18:53:20,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-03-01 18:53:20,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-03-01 18:53:20,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-03-01 18:53:20,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-03-01 18:53:20,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-03-01 18:53:20,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-03-01 18:53:20,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-03-01 18:53:20,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-03-01 18:53:20,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-03-01 18:53:20,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-03-01 18:53:20,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-03-01 18:53:20,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-03-01 18:53:20,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-03-01 18:53:20,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-03-01 18:53:20,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-03-01 18:53:20,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-03-01 18:53:20,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-03-01 18:53:20,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-03-01 18:53:20,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-03-01 18:53:20,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-03-01 18:53:20,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-03-01 18:53:20,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-03-01 18:53:20,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-03-01 18:53:20,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-03-01 18:53:20,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-03-01 18:53:20,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-03-01 18:53:20,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-03-01 18:53:20,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-03-01 18:53:20,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-03-01 18:53:20,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-03-01 18:53:20,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-03-01 18:53:20,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-03-01 18:53:20,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-03-01 18:53:20,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-03-01 18:53:20,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-03-01 18:53:20,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-03-01 18:53:20,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-03-01 18:53:20,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-03-01 18:53:20,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-03-01 18:53:20,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-03-01 18:53:20,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-03-01 18:53:20,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-03-01 18:53:20,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-03-01 18:53:20,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-03-01 18:53:20,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-03-01 18:53:20,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-03-01 18:53:20,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-03-01 18:53:20,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-03-01 18:53:20,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-03-01 18:53:20,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-03-01 18:53:20,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-03-01 18:53:20,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-03-01 18:53:20,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-03-01 18:53:20,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-03-01 18:53:20,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-03-01 18:53:20,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-03-01 18:53:20,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-03-01 18:53:20,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-03-01 18:53:20,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-03-01 18:53:20,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-03-01 18:53:20,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-03-01 18:53:20,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-03-01 18:53:20,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-03-01 18:53:20,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-03-01 18:53:20,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-03-01 18:53:20,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-03-01 18:53:20,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-03-01 18:53:20,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-03-01 18:53:20,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-03-01 18:53:20,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-03-01 18:53:20,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-03-01 18:53:20,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-03-01 18:53:20,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-03-01 18:53:20,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-03-01 18:53:20,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-03-01 18:53:20,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-03-01 18:53:20,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-03-01 18:53:20,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-03-01 18:53:20,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-03-01 18:53:20,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-03-01 18:53:20,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-03-01 18:53:20,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-03-01 18:53:20,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-03-01 18:53:20,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-03-01 18:53:20,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-03-01 18:53:20,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-03-01 18:53:20,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-03-01 18:53:20,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-03-01 18:53:20,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-03-01 18:53:20,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-03-01 18:53:20,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-03-01 18:53:20,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-03-01 18:53:20,799 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021639958790070846); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.034873508801977704, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021639958790070846); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.014666666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04625, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-01 18:53:20,799 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-03-01 18:53:20,799 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.01762903930625011, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021639958790070846); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.034873508801977704, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021639958790070846); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.014666666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04625, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-03-01 18:53:21,228 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 566 ms to try 5000 different iterations.  Found a solution that moves 1043 regions; Going from a computed imbalance of 0.01762903930625011 to a new imbalance of 8.822993452661503E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00610013298189536); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007856742013183862); MoveCostFunction : (multiplier=7.0, imbalance=0.11588888888888889, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.00610013298189536); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005666666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-01 18:53:21,230 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv981521990:80 , srv1649233505:81 , srv1692481288:81 , srv85851768:81 , srv1489220091:82 , srv295967958:82 , srv79497470:82 , srv1496678414:83 , srv1886108625:83 , srv301746290:83 , srv419882147:83 , srv816725810:83 , srv1073143213:84 , srv132537820:84 , srv1403641949:84 , srv1429254028:84 , srv1437200318:84 , srv1578197234:84 , srv1697664455:84 , srv1704770587:84 , srv1885616195:84 , srv2025734516:84 , srv2096057271:84 , srv569120017:84 , srv868095678:84 , srv932226618:84 , srv1084439693:85 , srv1471954890:85 , srv1570632207:85 , srv1622728513:85 , srv1710721463:85 , srv1784914789:85 , srv1877138106:85 , srv1917343811:85 , srv1936348659:85 , srv2068806920:85 , srv2130783396:85 , srv248383462:85 , srv267813962:85 , srv320135483:85 , srv346610794:85 , srv41857349:85 , srv461297520:85 , srv574521716:85 , srv598060195:85 , srv872891794:85 , srv886382793:85 , srv920479163:85 , srv932087280:85 , srv935858046:85 , srv1033590213:86 , srv1151052315:86 , srv1177205705:86 , srv14035263:86 , srv1411117789:86 , srv1429707920:86 , srv1550470386:86 , srv1552768859:86 , srv1644218081:86 , srv1753430617:86 , srv1759683478:86 , srv1827180776:86 , srv1844071846:86 , srv1883212251:86 , srv2029270370:86 , srv2125368666:86 , srv257248820:86 , srv436748096:86 , srv531884078:86 , srv580413253:86 , srv646488862:86 , srv654676229:86 , srv701289072:86 , srv708677690:86 , srv734987619:86 , srv1059104371:87 , srv1204208:87 , srv1333602721:87 , srv1468300190:87 , srv1528028341:87 , srv1551773678:87 , srv1733298636:87 , srv1781313756:87 , srv1844885528:87 , srv18805151:87 , srv2009608428:87 , srv223188701:87 , srv453263206:87 , srv597861642:87 , srv856572929:87 , srv1245216962:88 , srv1598364732:88 , srv1813978467:88 , srv2013774898:88 , srv2048894320:88 , srv166693771:89 , srv1861197586:89 , srv1782884744:90 , srv321178672:91 , srv1295433308:546 }
2024-03-01 18:53:21,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-03-01 18:53:21,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1782884744=40, srv223188701=63, srv2048894320=58, srv920479163=95, srv2125368666=61, srv1598364732=27, srv1733298636=36, srv1429254028=14, srv1644218081=29, srv1784914789=41, srv531884078=77, srv1403641949=12, srv1883212251=49, srv2130783396=62, srv436748096=74, srv1917343811=52, srv1578197234=26, srv1827180776=43, srv1333602721=10, srv2013774898=55, srv320135483=69, srv267813962=66, srv1704770587=34, srv1813978467=42, srv1551773678=23, srv1552768859=24, srv701289072=85, srv935858046=98, srv574521716=79, srv816725810=89, srv419882147=73, srv1496678414=20, srv646488862=83, srv856572929=90, srv2068806920=59, srv248383462=64, srv79497470=88, srv2025734516=56, srv1622728513=28, srv166693771=31, srv2009608428=54, srv654676229=84, srv868095678=92, srv1033590213=0, srv453263206=75, srv85851768=91, srv2029270370=57, srv1844885528=45, srv2096057271=60, srv1753430617=37, srv872891794=93, srv1697664455=33, srv1528028341=21, srv132537820=9, srv321178672=70, srv1429707920=15, srv1471954890=18, srv461297520=76, srv1073143213=2, srv257248820=65, srv1861197586=46, srv569120017=78, srv1411117789=13, srv708677690=86, srv1936348659=53, srv1759683478=38, srv1468300190=17, srv1885616195=50, srv1886108625=51, srv1710721463=35, srv1781313756=39, srv18805151=48, srv1059104371=1, srv301746290=68, srv1084439693=3, srv1151052315=4, srv1204208=6, srv1844071846=44, srv598060195=82, srv1245216962=7, srv1550470386=22, srv1570632207=25, srv41857349=72, srv580413253=80, srv1649233505=30, srv1437200318=16, srv932226618=97, srv295967958=67, srv1877138106=47, srv14035263=11, srv886382793=94, srv981521990=99, srv734987619=87, srv1295433308=8, srv346610794=71, srv1177205705=5, srv1489220091=19, srv1692481288=32, srv932087280=96, srv597861642=81} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-03-01 18:53:21,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-03-01 18:53:21,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-03-01 18:53:21,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-03-01 18:53:21,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-03-01 18:53:21,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-03-01 18:53:21,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-03-01 18:53:21,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-03-01 18:53:21,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-03-01 18:53:21,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-03-01 18:53:21,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-03-01 18:53:21,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-03-01 18:53:21,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-03-01 18:53:21,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-03-01 18:53:21,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-03-01 18:53:21,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-03-01 18:53:21,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-03-01 18:53:21,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-03-01 18:53:21,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-03-01 18:53:21,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-03-01 18:53:21,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-03-01 18:53:21,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-03-01 18:53:21,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-03-01 18:53:21,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-03-01 18:53:21,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-03-01 18:53:21,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-03-01 18:53:21,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-03-01 18:53:21,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-03-01 18:53:21,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-03-01 18:53:21,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-03-01 18:53:21,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-03-01 18:53:21,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-03-01 18:53:21,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-03-01 18:53:21,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-03-01 18:53:21,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-03-01 18:53:21,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-03-01 18:53:21,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-03-01 18:53:21,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-03-01 18:53:21,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-03-01 18:53:21,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-03-01 18:53:21,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-03-01 18:53:21,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-03-01 18:53:21,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-03-01 18:53:21,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-03-01 18:53:21,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-03-01 18:53:21,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-03-01 18:53:21,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-03-01 18:53:21,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-03-01 18:53:21,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-03-01 18:53:21,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-03-01 18:53:21,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-03-01 18:53:21,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-03-01 18:53:21,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-03-01 18:53:21,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-03-01 18:53:21,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-03-01 18:53:21,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-03-01 18:53:21,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-03-01 18:53:21,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-03-01 18:53:21,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-03-01 18:53:21,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-03-01 18:53:21,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-03-01 18:53:21,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-03-01 18:53:21,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-03-01 18:53:21,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-03-01 18:53:21,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-03-01 18:53:21,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-03-01 18:53:21,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-03-01 18:53:21,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-03-01 18:53:21,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-03-01 18:53:21,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-03-01 18:53:21,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-03-01 18:53:21,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-03-01 18:53:21,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-03-01 18:53:21,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-03-01 18:53:21,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-03-01 18:53:21,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-03-01 18:53:21,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-03-01 18:53:21,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-03-01 18:53:21,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-03-01 18:53:21,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-03-01 18:53:21,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-03-01 18:53:21,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-03-01 18:53:21,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-03-01 18:53:21,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-03-01 18:53:21,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-03-01 18:53:21,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-03-01 18:53:21,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-03-01 18:53:21,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-03-01 18:53:21,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-03-01 18:53:21,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-03-01 18:53:21,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-03-01 18:53:21,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-03-01 18:53:21,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-03-01 18:53:21,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-03-01 18:53:21,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-03-01 18:53:21,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-03-01 18:53:21,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-03-01 18:53:21,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-03-01 18:53:21,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-03-01 18:53:21,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-03-01 18:53:21,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-03-01 18:53:21,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-03-01 18:53:21,399 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00610013298189536); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007856742013183862); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.00610013298189536); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005666666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-01 18:53:21,400 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-03-01 18:53:21,400 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=8.74996103170827E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00610013298189536); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007856742013183862); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.00610013298189536); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005666666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-03-01 18:53:21,725 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 438 ms to try 5000 different iterations.  Found a solution that moves 290 regions; Going from a computed imbalance of 8.74996103170827E-4 to a new imbalance of 5.883512119560934E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.694119368783758E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002010075630518424); MoveCostFunction : (multiplier=7.0, imbalance=0.03222222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.694119368783758E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=5.0E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-01 18:53:21,726 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv18805151:82 , srv1151052315:83 , srv1844885528:83 , srv1861197586:83 , srv321178672:83 , srv1333602721:84 , srv1411117789:84 , srv1429254028:84 , srv1437200318:84 , srv1468300190:84 , srv1528028341:84 , srv1598364732:84 , srv1649233505:84 , srv166693771:84 , srv1753430617:84 , srv1782884744:84 , srv1784914789:84 , srv1813978467:84 , srv1877138106:84 , srv1883212251:84 , srv1885616195:84 , srv1917343811:84 , srv2068806920:84 , srv223188701:84 , srv248383462:84 , srv257248820:84 , srv267813962:84 , srv301746290:84 , srv41857349:84 , srv419882147:84 , srv453263206:84 , srv461297520:84 , srv569120017:84 , srv580413253:84 , srv701289072:84 , srv816725810:84 , srv856572929:84 , srv85851768:84 , srv868095678:84 , srv872891794:84 , srv886382793:84 , srv932226618:84 , srv981521990:84 , srv1033590213:85 , srv1059104371:85 , srv1084439693:85 , srv1177205705:85 , srv1245216962:85 , srv14035263:85 , srv1403641949:85 , srv1429707920:85 , srv1471954890:85 , srv1489220091:85 , srv1496678414:85 , srv1550470386:85 , srv1551773678:85 , srv1552768859:85 , srv1570632207:85 , srv1578197234:85 , srv1622728513:85 , srv1644218081:85 , srv1692481288:85 , srv1697664455:85 , srv1704770587:85 , srv1733298636:85 , srv1759683478:85 , srv1781313756:85 , srv1827180776:85 , srv1844071846:85 , srv1886108625:85 , srv1936348659:85 , srv2009608428:85 , srv2013774898:85 , srv2025734516:85 , srv2029270370:85 , srv2048894320:85 , srv2096057271:85 , srv2125368666:85 , srv2130783396:85 , srv295967958:85 , srv320135483:85 , srv346610794:85 , srv436748096:85 , srv531884078:85 , srv574521716:85 , srv597861642:85 , srv598060195:85 , srv646488862:85 , srv654676229:85 , srv708677690:85 , srv734987619:85 , srv79497470:85 , srv920479163:85 , srv932087280:85 , srv935858046:85 , srv1073143213:86 , srv1204208:86 , srv132537820:86 , srv1710721463:86 , srv1295433308:630 }
2024-03-01 18:53:21,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-03-01 18:53:21,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1782884744=40, srv223188701=63, srv2048894320=58, srv920479163=95, srv2125368666=61, srv1598364732=27, srv1733298636=36, srv1429254028=14, srv1644218081=29, srv1784914789=41, srv531884078=77, srv1403641949=12, srv1883212251=49, srv2130783396=62, srv436748096=74, srv1917343811=52, srv1578197234=26, srv1827180776=43, srv1333602721=10, srv2013774898=55, srv320135483=69, srv267813962=66, srv1704770587=34, srv1813978467=42, srv1551773678=23, srv1552768859=24, srv701289072=85, srv935858046=98, srv574521716=79, srv816725810=89, srv419882147=73, srv1496678414=20, srv646488862=83, srv856572929=90, srv2068806920=59, srv248383462=64, srv79497470=88, srv2025734516=56, srv1622728513=28, srv166693771=31, srv2009608428=54, srv654676229=84, srv868095678=92, srv1033590213=0, srv453263206=75, srv85851768=91, srv2029270370=57, srv1844885528=45, srv2096057271=60, srv1753430617=37, srv872891794=93, srv1697664455=33, srv1528028341=21, srv132537820=9, srv321178672=70, srv1429707920=15, srv1471954890=18, srv461297520=76, srv1073143213=2, srv257248820=65, srv1861197586=46, srv569120017=78, srv1411117789=13, srv708677690=86, srv1936348659=53, srv1759683478=38, srv1468300190=17, srv1885616195=50, srv1886108625=51, srv1710721463=35, srv1781313756=39, srv18805151=48, srv1059104371=1, srv301746290=68, srv1084439693=3, srv1151052315=4, srv1204208=6, srv1844071846=44, srv598060195=82, srv1245216962=7, srv1550470386=22, srv1570632207=25, srv41857349=72, srv580413253=80, srv1649233505=30, srv1437200318=16, srv932226618=97, srv295967958=67, srv1877138106=47, srv14035263=11, srv886382793=94, srv981521990=99, srv734987619=87, srv1295433308=8, srv346610794=71, srv1177205705=5, srv1489220091=19, srv1692481288=32, srv932087280=96, srv597861642=81} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-03-01 18:53:21,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-03-01 18:53:21,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-03-01 18:53:21,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-03-01 18:53:21,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-03-01 18:53:21,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-03-01 18:53:21,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-03-01 18:53:21,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-03-01 18:53:21,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-03-01 18:53:21,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-03-01 18:53:21,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-03-01 18:53:21,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-03-01 18:53:21,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-03-01 18:53:21,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-03-01 18:53:21,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-03-01 18:53:21,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-03-01 18:53:21,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-03-01 18:53:21,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-03-01 18:53:21,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-03-01 18:53:21,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-03-01 18:53:21,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-03-01 18:53:21,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-03-01 18:53:21,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-03-01 18:53:21,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-03-01 18:53:21,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-03-01 18:53:21,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-03-01 18:53:21,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-03-01 18:53:21,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-03-01 18:53:21,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-03-01 18:53:21,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-03-01 18:53:21,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-03-01 18:53:21,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-03-01 18:53:21,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-03-01 18:53:21,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-03-01 18:53:21,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-03-01 18:53:21,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-03-01 18:53:21,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-03-01 18:53:21,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-03-01 18:53:21,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-03-01 18:53:21,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-03-01 18:53:21,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-03-01 18:53:21,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-03-01 18:53:21,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-03-01 18:53:21,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-03-01 18:53:21,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-03-01 18:53:21,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-03-01 18:53:21,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-03-01 18:53:21,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-03-01 18:53:21,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-03-01 18:53:21,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-03-01 18:53:21,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-03-01 18:53:21,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-03-01 18:53:21,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-03-01 18:53:21,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-03-01 18:53:21,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-03-01 18:53:21,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-03-01 18:53:21,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-03-01 18:53:21,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-03-01 18:53:21,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-03-01 18:53:21,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-03-01 18:53:21,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-03-01 18:53:21,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-03-01 18:53:21,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-03-01 18:53:21,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-03-01 18:53:21,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-03-01 18:53:21,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-03-01 18:53:21,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-03-01 18:53:21,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-03-01 18:53:21,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-03-01 18:53:21,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-03-01 18:53:21,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-03-01 18:53:21,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-03-01 18:53:21,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-03-01 18:53:21,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-03-01 18:53:21,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-03-01 18:53:21,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-03-01 18:53:21,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-03-01 18:53:21,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-03-01 18:53:21,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-03-01 18:53:21,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-03-01 18:53:21,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-03-01 18:53:21,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-03-01 18:53:21,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-03-01 18:53:21,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-03-01 18:53:21,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-03-01 18:53:21,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-03-01 18:53:21,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-03-01 18:53:21,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-03-01 18:53:21,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-03-01 18:53:21,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-03-01 18:53:21,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-03-01 18:53:21,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-03-01 18:53:21,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-03-01 18:53:21,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-03-01 18:53:21,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-03-01 18:53:21,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-03-01 18:53:21,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-03-01 18:53:21,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-03-01 18:53:21,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-03-01 18:53:21,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-03-01 18:53:21,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-03-01 18:53:21,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-03-01 18:53:21,848 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.694119368783758E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002010075630518424); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.694119368783758E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=5.0E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-01 18:53:21,848 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-03-01 18:53:21,848 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=5.680449779422512E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.694119368783758E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002010075630518424); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.694119368783758E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=5.0E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-03-01 18:53:22,082 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 328 ms to try 5000 different iterations.  Found a solution that moves 42 regions; Going from a computed imbalance of 5.680449779422512E-5 to a new imbalance of 6.692075957987414E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014213381090374027); MoveCostFunction : (multiplier=7.0, imbalance=0.004666666666666667); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-01 18:53:22,083 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1073143213:83 , srv1204208:83 , srv1550470386:83 , srv1578197234:83 , srv1759683478:83 , srv1827180776:83 , srv1883212251:83 , srv2013774898:83 , srv2029270370:83 , srv2130783396:83 , srv597861642:83 , srv734987619:83 , srv1033590213:84 , srv1059104371:84 , srv1084439693:84 , srv1177205705:84 , srv1245216962:84 , srv132537820:84 , srv1333602721:84 , srv14035263:84 , srv1403641949:84 , srv1411117789:84 , srv1429254028:84 , srv1429707920:84 , srv1468300190:84 , srv1471954890:84 , srv1489220091:84 , srv1496678414:84 , srv1528028341:84 , srv1551773678:84 , srv1552768859:84 , srv1570632207:84 , srv1598364732:84 , srv1622728513:84 , srv1644218081:84 , srv1649233505:84 , srv166693771:84 , srv1692481288:84 , srv1697664455:84 , srv1704770587:84 , srv1710721463:84 , srv1733298636:84 , srv1753430617:84 , srv1781313756:84 , srv1782884744:84 , srv1784914789:84 , srv1813978467:84 , srv1844071846:84 , srv1844885528:84 , srv1861197586:84 , srv1885616195:84 , srv1886108625:84 , srv1936348659:84 , srv2009608428:84 , srv2025734516:84 , srv2048894320:84 , srv2068806920:84 , srv2096057271:84 , srv2125368666:84 , srv223188701:84 , srv257248820:84 , srv267813962:84 , srv295967958:84 , srv301746290:84 , srv320135483:84 , srv321178672:84 , srv346610794:84 , srv419882147:84 , srv436748096:84 , srv453263206:84 , srv531884078:84 , srv569120017:84 , srv574521716:84 , srv598060195:84 , srv646488862:84 , srv654676229:84 , srv701289072:84 , srv708677690:84 , srv816725810:84 , srv856572929:84 , srv85851768:84 , srv868095678:84 , srv872891794:84 , srv886382793:84 , srv920479163:84 , srv932087280:84 , srv935858046:84 , srv981521990:84 , srv1151052315:85 , srv1437200318:85 , srv1877138106:85 , srv1917343811:85 , srv248383462:85 , srv41857349:85 , srv461297520:85 , srv580413253:85 , srv79497470:85 , srv932226618:85 , srv18805151:86 , srv1295433308:684 }
2024-03-01 18:53:22,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-03-01 18:53:22,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1782884744=40, srv223188701=63, srv2048894320=58, srv920479163=95, srv2125368666=61, srv1598364732=27, srv1733298636=36, srv1429254028=14, srv1644218081=29, srv1784914789=41, srv531884078=77, srv1403641949=12, srv1883212251=49, srv2130783396=62, srv436748096=74, srv1917343811=52, srv1578197234=26, srv1827180776=43, srv1333602721=10, srv2013774898=55, srv320135483=69, srv267813962=66, srv1704770587=34, srv1813978467=42, srv1551773678=23, srv1552768859=24, srv701289072=85, srv935858046=98, srv574521716=79, srv816725810=89, srv419882147=73, srv1496678414=20, srv646488862=83, srv856572929=90, srv2068806920=59, srv248383462=64, srv79497470=88, srv2025734516=56, srv1622728513=28, srv166693771=31, srv2009608428=54, srv654676229=84, srv868095678=92, srv1033590213=0, srv453263206=75, srv85851768=91, srv2029270370=57, srv1844885528=45, srv2096057271=60, srv1753430617=37, srv872891794=93, srv1697664455=33, srv1528028341=21, srv132537820=9, srv321178672=70, srv1429707920=15, srv1471954890=18, srv461297520=76, srv1073143213=2, srv257248820=65, srv1861197586=46, srv569120017=78, srv1411117789=13, srv708677690=86, srv1936348659=53, srv1759683478=38, srv1468300190=17, srv1885616195=50, srv1886108625=51, srv1710721463=35, srv1781313756=39, srv18805151=48, srv1059104371=1, srv301746290=68, srv1084439693=3, srv1151052315=4, srv1204208=6, srv1844071846=44, srv598060195=82, srv1245216962=7, srv1550470386=22, srv1570632207=25, srv41857349=72, srv580413253=80, srv1649233505=30, srv1437200318=16, srv932226618=97, srv295967958=67, srv1877138106=47, srv14035263=11, srv886382793=94, srv981521990=99, srv734987619=87, srv1295433308=8, srv346610794=71, srv1177205705=5, srv1489220091=19, srv1692481288=32, srv932087280=96, srv597861642=81} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-03-01 18:53:22,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-03-01 18:53:22,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-03-01 18:53:22,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-03-01 18:53:22,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-03-01 18:53:22,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-03-01 18:53:22,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-03-01 18:53:22,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-03-01 18:53:22,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-03-01 18:53:22,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-03-01 18:53:22,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-03-01 18:53:22,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-03-01 18:53:22,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-03-01 18:53:22,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-03-01 18:53:22,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-03-01 18:53:22,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-03-01 18:53:22,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-03-01 18:53:22,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-03-01 18:53:22,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-03-01 18:53:22,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-03-01 18:53:22,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-03-01 18:53:22,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-03-01 18:53:22,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-03-01 18:53:22,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-03-01 18:53:22,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-03-01 18:53:22,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-03-01 18:53:22,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-03-01 18:53:22,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-03-01 18:53:22,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-03-01 18:53:22,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-03-01 18:53:22,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-03-01 18:53:22,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-03-01 18:53:22,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-03-01 18:53:22,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-03-01 18:53:22,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-03-01 18:53:22,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-03-01 18:53:22,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-03-01 18:53:22,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-03-01 18:53:22,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-03-01 18:53:22,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-03-01 18:53:22,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-03-01 18:53:22,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-03-01 18:53:22,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-03-01 18:53:22,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-03-01 18:53:22,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-03-01 18:53:22,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-03-01 18:53:22,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-03-01 18:53:22,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-03-01 18:53:22,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-03-01 18:53:22,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-03-01 18:53:22,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-03-01 18:53:22,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-03-01 18:53:22,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-03-01 18:53:22,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-03-01 18:53:22,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-03-01 18:53:22,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-03-01 18:53:22,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-03-01 18:53:22,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-03-01 18:53:22,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-03-01 18:53:22,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-03-01 18:53:22,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-03-01 18:53:22,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-03-01 18:53:22,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-03-01 18:53:22,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-03-01 18:53:22,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-03-01 18:53:22,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-03-01 18:53:22,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-03-01 18:53:22,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-03-01 18:53:22,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-03-01 18:53:22,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-03-01 18:53:22,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-03-01 18:53:22,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-03-01 18:53:22,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-03-01 18:53:22,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-03-01 18:53:22,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-03-01 18:53:22,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-03-01 18:53:22,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-03-01 18:53:22,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-03-01 18:53:22,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-03-01 18:53:22,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-03-01 18:53:22,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-03-01 18:53:22,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-03-01 18:53:22,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-03-01 18:53:22,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-03-01 18:53:22,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-03-01 18:53:22,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-03-01 18:53:22,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-03-01 18:53:22,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-03-01 18:53:22,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-03-01 18:53:22,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-03-01 18:53:22,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-03-01 18:53:22,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-03-01 18:53:22,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-03-01 18:53:22,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-03-01 18:53:22,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-03-01 18:53:22,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-03-01 18:53:22,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-03-01 18:53:22,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-03-01 18:53:22,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-03-01 18:53:22,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-03-01 18:53:22,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-03-01 18:53:22,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-03-01 18:53:22,219 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=6.397985672269699E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014213381090374027); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-01 18:53:22,219 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1073143213:83 , srv1204208:83 , srv1550470386:83 , srv1578197234:83 , srv1759683478:83 , srv1827180776:83 , srv1883212251:83 , srv2013774898:83 , srv2029270370:83 , srv2130783396:83 , srv597861642:83 , srv734987619:83 , srv1033590213:84 , srv1059104371:84 , srv1084439693:84 , srv1177205705:84 , srv1245216962:84 , srv132537820:84 , srv1333602721:84 , srv14035263:84 , srv1403641949:84 , srv1411117789:84 , srv1429254028:84 , srv1429707920:84 , srv1468300190:84 , srv1471954890:84 , srv1489220091:84 , srv1496678414:84 , srv1528028341:84 , srv1551773678:84 , srv1552768859:84 , srv1570632207:84 , srv1598364732:84 , srv1622728513:84 , srv1644218081:84 , srv1649233505:84 , srv166693771:84 , srv1692481288:84 , srv1697664455:84 , srv1704770587:84 , srv1710721463:84 , srv1733298636:84 , srv1753430617:84 , srv1781313756:84 , srv1782884744:84 , srv1784914789:84 , srv1813978467:84 , srv1844071846:84 , srv1844885528:84 , srv1861197586:84 , srv1885616195:84 , srv1886108625:84 , srv1936348659:84 , srv2009608428:84 , srv2025734516:84 , srv2048894320:84 , srv2068806920:84 , srv2096057271:84 , srv2125368666:84 , srv223188701:84 , srv257248820:84 , srv267813962:84 , srv295967958:84 , srv301746290:84 , srv320135483:84 , srv321178672:84 , srv346610794:84 , srv419882147:84 , srv436748096:84 , srv453263206:84 , srv531884078:84 , srv569120017:84 , srv574521716:84 , srv598060195:84 , srv646488862:84 , srv654676229:84 , srv701289072:84 , srv708677690:84 , srv816725810:84 , srv856572929:84 , srv85851768:84 , srv868095678:84 , srv872891794:84 , srv886382793:84 , srv920479163:84 , srv932087280:84 , srv935858046:84 , srv981521990:84 , srv1151052315:85 , srv1437200318:85 , srv1877138106:85 , srv1917343811:85 , srv248383462:85 , srv41857349:85 , srv461297520:85 , srv580413253:85 , srv79497470:85 , srv932226618:85 , srv18805151:86 , srv1295433308:684 }
2024-03-01 18:53:22,250 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=287 (was 287), ProcessCount=172 (was 170) - ProcessCount LEAK? -, AvailableMemoryMB=9538 (was 10343)
2024-03-01 18:53:22,259 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=287, ProcessCount=172, AvailableMemoryMB=9537
2024-03-01 18:53:22,259 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-03-01 18:53:22,259 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2024-03-01 18:53:22,269 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1054196734:84 , srv1317977083:84 , srv1374910016:84 , srv1413212284:84 , srv1420318514:84 , srv1439661377:84 , srv1454462457:84 , srv1560933347:84 , srv1561573401:84 , srv1635343293:84 , srv1648308563:84 , srv1679677671:84 , srv1741732836:84 , srv176327739:84 , srv1784525888:84 , srv1877135453:84 , srv1930952917:84 , srv2003955432:84 , srv2061342254:84 , srv391565458:84 , srv414280239:84 , srv54526554:84 , srv568333346:84 , srv569491106:84 , srv676282169:84 , srv793047172:84 , srv919462460:84 , srv938368575:84 , srv987415117:84 , srv745792872:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2024-03-01 18:53:22,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-03-01 18:53:22,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1420318514=4, srv1648308563=10, srv938368575=28, srv745792872=25, srv391565458=19, srv568333346=22, srv1877135453=15, srv676282169=24, srv1454462457=6, srv987415117=29, srv1413212284=3, srv793047172=26, srv1560933347=7, srv1561573401=8, srv1439661377=5, srv2061342254=18, srv1741732836=12, srv1784525888=14, srv919462460=27, srv569491106=23, srv414280239=20, srv1679677671=11, srv176327739=13, srv1374910016=2, srv1317977083=1, srv54526554=21, srv1635343293=9, srv1054196734=0, srv1930952917=16, srv2003955432=17} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-03-01 18:53:22,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-03-01 18:53:22,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-03-01 18:53:22,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-03-01 18:53:22,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-03-01 18:53:22,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-03-01 18:53:22,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-03-01 18:53:22,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-03-01 18:53:22,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-03-01 18:53:22,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-03-01 18:53:22,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-03-01 18:53:22,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-03-01 18:53:22,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-03-01 18:53:22,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-03-01 18:53:22,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-03-01 18:53:22,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-03-01 18:53:22,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-03-01 18:53:22,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-03-01 18:53:22,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-03-01 18:53:22,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-03-01 18:53:22,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-03-01 18:53:22,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-03-01 18:53:22,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-03-01 18:53:22,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-03-01 18:53:22,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-03-01 18:53:22,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-03-01 18:53:22,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-03-01 18:53:22,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-03-01 18:53:22,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-03-01 18:53:22,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-03-01 18:53:22,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-03-01 18:53:22,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-03-01 18:53:22,299 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1765156700226487, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-01 18:53:22,299 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912749238376753, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1765156700226487, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2024-03-01 18:55:22,287 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5730859 different iterations.  Found a solution that moves 1869 regions; Going from a computed imbalance of 0.9912749238376753 to a new imbalance of 4.362339238146111E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6922222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-01 18:55:22,294 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1054196734:90 , srv1317977083:90 , srv1374910016:90 , srv1413212284:90 , srv1420318514:90 , srv1439661377:90 , srv1454462457:90 , srv1560933347:90 , srv1561573401:90 , srv1635343293:90 , srv1648308563:90 , srv1679677671:90 , srv1741732836:90 , srv176327739:90 , srv1784525888:90 , srv1877135453:90 , srv1930952917:90 , srv2003955432:90 , srv2061342254:90 , srv391565458:90 , srv414280239:90 , srv54526554:90 , srv568333346:90 , srv569491106:90 , srv676282169:90 , srv745792872:90 , srv793047172:90 , srv919462460:90 , srv938368575:90 , srv987415117:90 }
2024-03-01 18:55:22,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-03-01 18:55:22,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1420318514=4, srv1648308563=10, srv938368575=28, srv745792872=25, srv391565458=19, srv568333346=22, srv1877135453=15, srv676282169=24, srv1454462457=6, srv987415117=29, srv1413212284=3, srv793047172=26, srv1560933347=7, srv1561573401=8, srv1439661377=5, srv2061342254=18, srv1741732836=12, srv1784525888=14, srv919462460=27, srv569491106=23, srv414280239=20, srv1679677671=11, srv176327739=13, srv1374910016=2, srv1317977083=1, srv54526554=21, srv1635343293=9, srv1054196734=0, srv1930952917=16, srv2003955432=17} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-03-01 18:55:22,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-03-01 18:55:22,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-03-01 18:55:22,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-03-01 18:55:22,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-03-01 18:55:22,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-03-01 18:55:22,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-03-01 18:55:22,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-03-01 18:55:22,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-03-01 18:55:22,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-03-01 18:55:22,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-03-01 18:55:22,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-03-01 18:55:22,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-03-01 18:55:22,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-03-01 18:55:22,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-03-01 18:55:22,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-03-01 18:55:22,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-03-01 18:55:22,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-03-01 18:55:22,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-03-01 18:55:22,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-03-01 18:55:22,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-03-01 18:55:22,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-03-01 18:55:22,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-03-01 18:55:22,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-03-01 18:55:22,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-03-01 18:55:22,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-03-01 18:55:22,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-03-01 18:55:22,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-03-01 18:55:22,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-03-01 18:55:22,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-03-01 18:55:22,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-03-01 18:55:22,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-03-01 18:55:22,312 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-01 18:55:22,312 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1054196734:90 , srv1317977083:90 , srv1374910016:90 , srv1413212284:90 , srv1420318514:90 , srv1439661377:90 , srv1454462457:90 , srv1560933347:90 , srv1561573401:90 , srv1635343293:90 , srv1648308563:90 , srv1679677671:90 , srv1741732836:90 , srv176327739:90 , srv1784525888:90 , srv1877135453:90 , srv1930952917:90 , srv2003955432:90 , srv2061342254:90 , srv391565458:90 , srv414280239:90 , srv54526554:90 , srv568333346:90 , srv569491106:90 , srv676282169:90 , srv745792872:90 , srv793047172:90 , srv919462460:90 , srv938368575:90 , srv987415117:90 }
2024-03-01 18:55:22,326 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=244 (was 287), ProcessCount=168 (was 172), AvailableMemoryMB=8857 (was 9537)