2024-03-11 17:53:16,363 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2024-03-11 17:53:16,692 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2024-03-11 17:53:16,806 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2024-03-11 17:53:16,875 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-03-11 17:53:16,886 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-03-11 17:53:16,903 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=289, ProcessCount=172, AvailableMemoryMB=14018
2024-03-11 17:53:16,905 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-03-11 17:53:16,905 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-03-11 17:53:17,033 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1013835796:84 , srv10350951:84 , srv1038357665:84 , srv1085632136:84 , srv1100510795:84 , srv1131177288:84 , srv1140611758:84 , srv1158447803:84 , srv1158528386:84 , srv119295441:84 , srv1200291777:84 , srv1210111712:84 , srv1212333839:84 , srv1212875340:84 , srv1227149350:84 , srv1252263375:84 , srv1257608522:84 , srv1302359297:84 , srv1307533235:84 , srv1325861327:84 , srv1345250085:84 , srv1396631180:84 , srv1401997417:84 , srv140901925:84 , srv1427884247:84 , srv1473698436:84 , srv1478481144:84 , srv148224216:84 , srv1487094005:84 , srv1560716622:84 , srv1581622123:84 , srv1609049071:84 , srv163820158:84 , srv1640132679:84 , srv1671308283:84 , srv1681500274:84 , srv1697247357:84 , srv1754308113:84 , srv1762574754:84 , srv1764451574:84 , srv1776551161:84 , srv180036421:84 , srv1810017024:84 , srv1815703350:84 , srv1819259122:84 , srv1825183728:84 , srv1831345541:84 , srv1845167189:84 , srv1845572486:84 , srv1845863537:84 , srv1850592001:84 , srv1852556139:84 , srv187446955:84 , srv1904122357:84 , srv1921562921:84 , srv1950581229:84 , srv195264486:84 , srv1968158255:84 , srv1969620163:84 , srv1976541987:84 , srv2009531706:84 , srv2012604508:84 , srv2043691811:84 , srv2048290723:84 , srv208652443:84 , srv2094472386:84 , srv2100130330:84 , srv213509365:84 , srv2139439622:84 , srv231189808:84 , srv301696584:84 , srv310790546:84 , srv38268264:84 , srv407739702:84 , srv427951280:84 , srv455142767:84 , srv461157311:84 , srv502888074:84 , srv504786541:84 , srv534482170:84 , srv538869391:84 , srv560476646:84 , srv590681305:84 , srv606432804:84 , srv61216009:84 , srv647275297:84 , srv67152942:84 , srv711964387:84 , srv712796647:84 , srv779546984:84 , srv785097758:84 , srv785583674:84 , srv789351498:84 , srv800689905:84 , srv837067175:84 , srv882624466:84 , srv900276344:84 , srv923859474:84 , srv989869023:84 , srv1705672346:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2024-03-11 17:53:17,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-03-11 17:53:17,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1013835796=0, srv2094472386=66, srv837067175=95, srv1487094005=28, srv1845863537=50, srv1815703350=44, srv1325861327=19, srv1950581229=56, srv1345250085=20, srv590681305=83, srv140901925=23, srv455142767=76, srv989869023=99, srv1200291777=10, srv1671308283=34, srv1473698436=25, srv461157311=77, srv711964387=88, srv163820158=32, srv1705672346=37, srv785097758=91, srv195264486=57, srv213509365=68, srv1140611758=6, srv1762574754=39, srv647275297=86, srv606432804=84, srv1754308113=38, srv800689905=94, srv882624466=96, srv208652443=65, srv1131177288=5, srv1976541987=60, srv1852556139=52, srv1681500274=35, srv504786541=79, srv301696584=71, srv2012604508=62, srv1212875340=13, srv1401997417=22, srv310790546=72, srv1227149350=14, srv1478481144=26, srv1210111712=11, srv1831345541=47, srv1212333839=12, srv2009531706=61, srv1825183728=46, srv1640132679=33, srv1252263375=15, srv1969620163=59, srv1100510795=4, srv923859474=98, srv900276344=97, srv1697247357=36, srv1302359297=17, srv2048290723=64, srv1921562921=55, srv2100130330=67, srv38268264=73, srv1560716622=29, srv789351498=93, srv427951280=75, srv1085632136=3, srv231189808=70, srv779546984=90, srv1845167189=48, srv1307533235=18, srv534482170=80, srv560476646=82, srv67152942=87, srv1038357665=2, srv1764451574=40, srv1904122357=54, srv407739702=74, srv1819259122=45, srv785583674=92, srv1158528386=8, srv1850592001=51, srv180036421=42, srv10350951=1, srv1396631180=21, srv148224216=27, srv1845572486=49, srv61216009=85, srv1609049071=31, srv1427884247=24, srv119295441=9, srv1158447803=7, srv502888074=78, srv2139439622=69, srv1968158255=58, srv1257608522=16, srv538869391=81, srv2043691811=63, srv1810017024=43, srv1581622123=30, srv712796647=89, srv1776551161=41, srv187446955=53} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-03-11 17:53:17,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-03-11 17:53:17,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-03-11 17:53:17,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-03-11 17:53:17,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-03-11 17:53:17,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-03-11 17:53:17,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-03-11 17:53:17,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-03-11 17:53:17,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-03-11 17:53:17,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-03-11 17:53:17,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-03-11 17:53:17,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-03-11 17:53:17,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-03-11 17:53:17,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-03-11 17:53:17,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-03-11 17:53:17,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-03-11 17:53:17,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-03-11 17:53:17,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-03-11 17:53:17,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-03-11 17:53:17,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-03-11 17:53:17,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-03-11 17:53:17,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-03-11 17:53:17,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-03-11 17:53:17,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-03-11 17:53:17,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-03-11 17:53:17,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-03-11 17:53:17,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-03-11 17:53:17,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-03-11 17:53:17,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-03-11 17:53:17,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-03-11 17:53:17,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-03-11 17:53:17,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-03-11 17:53:17,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-03-11 17:53:17,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-03-11 17:53:17,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-03-11 17:53:17,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-03-11 17:53:17,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-03-11 17:53:17,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-03-11 17:53:17,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-03-11 17:53:17,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-03-11 17:53:17,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-03-11 17:53:17,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-03-11 17:53:17,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-03-11 17:53:17,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-03-11 17:53:17,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-03-11 17:53:17,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-03-11 17:53:17,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-03-11 17:53:17,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-03-11 17:53:17,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-03-11 17:53:17,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-03-11 17:53:17,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-03-11 17:53:17,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-03-11 17:53:17,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-03-11 17:53:17,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-03-11 17:53:17,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-03-11 17:53:17,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-03-11 17:53:17,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-03-11 17:53:17,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-03-11 17:53:17,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-03-11 17:53:17,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-03-11 17:53:17,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-03-11 17:53:17,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-03-11 17:53:17,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-03-11 17:53:17,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-03-11 17:53:17,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-03-11 17:53:17,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-03-11 17:53:17,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-03-11 17:53:17,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-03-11 17:53:17,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-03-11 17:53:17,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-03-11 17:53:17,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-03-11 17:53:17,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-03-11 17:53:17,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-03-11 17:53:17,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-03-11 17:53:17,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-03-11 17:53:17,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-03-11 17:53:17,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-03-11 17:53:17,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-03-11 17:53:17,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-03-11 17:53:17,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-03-11 17:53:17,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-03-11 17:53:17,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-03-11 17:53:17,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-03-11 17:53:17,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-03-11 17:53:17,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-03-11 17:53:17,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-03-11 17:53:17,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-03-11 17:53:17,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-03-11 17:53:17,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-03-11 17:53:17,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-03-11 17:53:17,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-03-11 17:53:17,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-03-11 17:53:17,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-03-11 17:53:17,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-03-11 17:53:17,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-03-11 17:53:17,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-03-11 17:53:17,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-03-11 17:53:17,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-03-11 17:53:17,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-03-11 17:53:17,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-03-11 17:53:17,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-03-11 17:53:17,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-03-11 17:53:17,371 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-11 17:53:17,372 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-03-11 17:53:17,372 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-03-11 17:53:17,895 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 718 ms to try 5000 different iterations.  Found a solution that moves 4699 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17778726115016844. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.038909886907629074, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05554141234113951, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5221111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.038909886907629074, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17275, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24208333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-11 17:53:17,911 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1487094005:82 , srv180036421:82 , srv1845167189:82 , srv1345250085:83 , srv1427884247:83 , srv1671308283:83 , srv1815703350:83 , srv2094472386:83 , srv1013835796:84 , srv1131177288:84 , srv1210111712:84 , srv140901925:84 , srv1478481144:84 , srv1640132679:84 , srv1762574754:84 , srv1969620163:84 , srv208652443:84 , srv427951280:84 , srv461157311:84 , srv67152942:84 , srv711964387:84 , srv712796647:84 , srv779546984:84 , srv882624466:84 , srv1158447803:85 , srv148224216:85 , srv1581622123:85 , srv1776551161:85 , srv2139439622:85 , srv38268264:85 , srv560476646:85 , srv789351498:85 , srv10350951:86 , srv119295441:86 , srv1396631180:86 , srv163820158:86 , srv1697247357:86 , srv1831345541:86 , srv1852556139:86 , srv195264486:86 , srv1968158255:86 , srv455142767:86 , srv534482170:86 , srv785097758:86 , srv837067175:86 , srv1038357665:87 , srv1085632136:87 , srv1140611758:87 , srv1212875340:87 , srv1227149350:87 , srv1252263375:87 , srv1473698436:87 , srv1609049071:87 , srv1764451574:87 , srv1810017024:87 , srv1819259122:87 , srv1850592001:87 , srv1921562921:87 , srv2012604508:87 , srv2048290723:87 , srv310790546:87 , srv502888074:87 , srv538869391:87 , srv590681305:87 , srv606432804:87 , srv1100510795:88 , srv1257608522:88 , srv1307533235:88 , srv1401997417:88 , srv1560716622:88 , srv1825183728:88 , srv1845863537:88 , srv1904122357:88 , srv1976541987:88 , srv2009531706:88 , srv2100130330:88 , srv213509365:88 , srv301696584:88 , srv61216009:88 , srv647275297:88 , srv900276344:88 , srv923859474:88 , srv1158528386:89 , srv1200291777:89 , srv1325861327:89 , srv1681500274:89 , srv1754308113:89 , srv1845572486:89 , srv1950581229:89 , srv2043691811:89 , srv231189808:89 , srv504786541:89 , srv989869023:89 , srv407739702:90 , srv800689905:90 , srv1212333839:91 , srv785583674:91 , srv1302359297:92 , srv187446955:92 , srv1705672346:436 }
2024-03-11 17:53:17,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-03-11 17:53:17,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1013835796=0, srv2094472386=66, srv837067175=95, srv1487094005=28, srv1845863537=50, srv1815703350=44, srv1325861327=19, srv1950581229=56, srv1345250085=20, srv590681305=83, srv140901925=23, srv455142767=76, srv989869023=99, srv1200291777=10, srv1671308283=34, srv1473698436=25, srv461157311=77, srv711964387=88, srv163820158=32, srv1705672346=37, srv785097758=91, srv195264486=57, srv213509365=68, srv1140611758=6, srv1762574754=39, srv647275297=86, srv606432804=84, srv1754308113=38, srv800689905=94, srv882624466=96, srv208652443=65, srv1131177288=5, srv1976541987=60, srv1852556139=52, srv1681500274=35, srv504786541=79, srv301696584=71, srv2012604508=62, srv1212875340=13, srv1401997417=22, srv310790546=72, srv1227149350=14, srv1478481144=26, srv1210111712=11, srv1831345541=47, srv1212333839=12, srv2009531706=61, srv1825183728=46, srv1640132679=33, srv1252263375=15, srv1969620163=59, srv1100510795=4, srv923859474=98, srv900276344=97, srv1697247357=36, srv1302359297=17, srv2048290723=64, srv1921562921=55, srv2100130330=67, srv38268264=73, srv1560716622=29, srv789351498=93, srv427951280=75, srv1085632136=3, srv231189808=70, srv779546984=90, srv1845167189=48, srv1307533235=18, srv534482170=80, srv560476646=82, srv67152942=87, srv1038357665=2, srv1764451574=40, srv1904122357=54, srv407739702=74, srv1819259122=45, srv785583674=92, srv1158528386=8, srv1850592001=51, srv180036421=42, srv10350951=1, srv1396631180=21, srv148224216=27, srv1845572486=49, srv61216009=85, srv1609049071=31, srv1427884247=24, srv119295441=9, srv1158447803=7, srv502888074=78, srv2139439622=69, srv1968158255=58, srv1257608522=16, srv538869391=81, srv2043691811=63, srv1810017024=43, srv1581622123=30, srv712796647=89, srv1776551161=41, srv187446955=53} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-03-11 17:53:17,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-03-11 17:53:17,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-03-11 17:53:17,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-03-11 17:53:17,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-03-11 17:53:17,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-03-11 17:53:17,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-03-11 17:53:17,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-03-11 17:53:17,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-03-11 17:53:17,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-03-11 17:53:17,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-03-11 17:53:17,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-03-11 17:53:17,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-03-11 17:53:17,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-03-11 17:53:17,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-03-11 17:53:17,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-03-11 17:53:17,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-03-11 17:53:17,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-03-11 17:53:17,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-03-11 17:53:17,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-03-11 17:53:17,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-03-11 17:53:17,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-03-11 17:53:17,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-03-11 17:53:17,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-03-11 17:53:17,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-03-11 17:53:17,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-03-11 17:53:17,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-03-11 17:53:17,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-03-11 17:53:17,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-03-11 17:53:17,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-03-11 17:53:17,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-03-11 17:53:17,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-03-11 17:53:17,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-03-11 17:53:17,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-03-11 17:53:17,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-03-11 17:53:17,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-03-11 17:53:17,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-03-11 17:53:17,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-03-11 17:53:17,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-03-11 17:53:17,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-03-11 17:53:17,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-03-11 17:53:17,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-03-11 17:53:17,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-03-11 17:53:17,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-03-11 17:53:17,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-03-11 17:53:17,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-03-11 17:53:17,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-03-11 17:53:17,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-03-11 17:53:17,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-03-11 17:53:17,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-03-11 17:53:17,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-03-11 17:53:17,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-03-11 17:53:17,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-03-11 17:53:17,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-03-11 17:53:17,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-03-11 17:53:17,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-03-11 17:53:17,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-03-11 17:53:17,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-03-11 17:53:17,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-03-11 17:53:17,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-03-11 17:53:17,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-03-11 17:53:17,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-03-11 17:53:17,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-03-11 17:53:17,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-03-11 17:53:17,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-03-11 17:53:17,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-03-11 17:53:17,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-03-11 17:53:17,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-03-11 17:53:17,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-03-11 17:53:17,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-03-11 17:53:17,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-03-11 17:53:17,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-03-11 17:53:17,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-03-11 17:53:17,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-03-11 17:53:17,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-03-11 17:53:17,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-03-11 17:53:17,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-03-11 17:53:17,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-03-11 17:53:17,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-03-11 17:53:17,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-03-11 17:53:17,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-03-11 17:53:17,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-03-11 17:53:17,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-03-11 17:53:17,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-03-11 17:53:17,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-03-11 17:53:17,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-03-11 17:53:17,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-03-11 17:53:17,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-03-11 17:53:17,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-03-11 17:53:17,958 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-03-11 17:53:17,958 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-03-11 17:53:17,958 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-03-11 17:53:17,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-03-11 17:53:17,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-03-11 17:53:17,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-03-11 17:53:17,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-03-11 17:53:17,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-03-11 17:53:17,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-03-11 17:53:17,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-03-11 17:53:17,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-03-11 17:53:17,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-03-11 17:53:17,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-03-11 17:53:18,187 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.038909886907629074, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05554141234113951, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.038909886907629074, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17275, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24208333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-11 17:53:18,187 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-03-11 17:53:18,188 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17775435804891634, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.038909886907629074, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05554141234113951, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.038909886907629074, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17275, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24208333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-03-11 17:53:18,538 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 548 ms to try 5000 different iterations.  Found a solution that moves 2618 regions; Going from a computed imbalance of 0.17775435804891634 to a new imbalance of 0.012892407918573502. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020910798739602714); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03265298964695881, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29088888888888886, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020910798739602714); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.009583333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04441666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-11 17:53:18,551 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv187446955:79 , srv1302359297:81 , srv1325861327:82 , srv2043691811:82 , srv231189808:82 , srv407739702:82 , srv785583674:82 , srv800689905:82 , srv1038357665:83 , srv1212333839:83 , srv1401997417:83 , srv1810017024:83 , srv1845572486:83 , srv1950581229:83 , srv1976541987:83 , srv301696584:83 , srv647275297:83 , srv1200291777:84 , srv1257608522:84 , srv1307533235:84 , srv1560716622:84 , srv1681500274:84 , srv1819259122:84 , srv1825183728:84 , srv1850592001:84 , srv1904122357:84 , srv2012604508:84 , srv2100130330:84 , srv504786541:84 , srv590681305:84 , srv61216009:84 , srv900276344:84 , srv923859474:84 , srv989869023:84 , srv10350951:85 , srv1085632136:85 , srv1140611758:85 , srv1158447803:85 , srv1158528386:85 , srv119295441:85 , srv1227149350:85 , srv1252263375:85 , srv1396631180:85 , srv1754308113:85 , srv1831345541:85 , srv1845863537:85 , srv1852556139:85 , srv1921562921:85 , srv1968158255:85 , srv213509365:85 , srv538869391:85 , srv1100510795:86 , srv1212875340:86 , srv1581622123:86 , srv1609049071:86 , srv1764451574:86 , srv195264486:86 , srv2009531706:86 , srv2048290723:86 , srv455142767:86 , srv502888074:86 , srv606432804:86 , srv785097758:86 , srv837067175:86 , srv1131177288:87 , srv1210111712:87 , srv1345250085:87 , srv140901925:87 , srv1473698436:87 , srv1478481144:87 , srv148224216:87 , srv163820158:87 , srv1697247357:87 , srv1762574754:87 , srv1776551161:87 , srv310790546:87 , srv38268264:87 , srv427951280:87 , srv560476646:87 , srv711964387:87 , srv1013835796:88 , srv1671308283:88 , srv1815703350:88 , srv208652443:88 , srv2139439622:88 , srv534482170:88 , srv712796647:88 , srv779546984:88 , srv1640132679:89 , srv1969620163:89 , srv2094472386:89 , srv461157311:89 , srv67152942:89 , srv789351498:89 , srv882624466:89 , srv1427884247:91 , srv1487094005:91 , srv1845167189:92 , srv180036421:93 , srv1705672346:524 }
2024-03-11 17:53:18,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-03-11 17:53:18,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1013835796=0, srv2094472386=66, srv837067175=95, srv1487094005=28, srv1845863537=50, srv1815703350=44, srv1325861327=19, srv1950581229=56, srv1345250085=20, srv590681305=83, srv140901925=23, srv455142767=76, srv989869023=99, srv1200291777=10, srv1671308283=34, srv1473698436=25, srv461157311=77, srv711964387=88, srv163820158=32, srv1705672346=37, srv785097758=91, srv195264486=57, srv213509365=68, srv1140611758=6, srv1762574754=39, srv647275297=86, srv606432804=84, srv1754308113=38, srv800689905=94, srv882624466=96, srv208652443=65, srv1131177288=5, srv1976541987=60, srv1852556139=52, srv1681500274=35, srv504786541=79, srv301696584=71, srv2012604508=62, srv1212875340=13, srv1401997417=22, srv310790546=72, srv1227149350=14, srv1478481144=26, srv1210111712=11, srv1831345541=47, srv1212333839=12, srv2009531706=61, srv1825183728=46, srv1640132679=33, srv1252263375=15, srv1969620163=59, srv1100510795=4, srv923859474=98, srv900276344=97, srv1697247357=36, srv1302359297=17, srv2048290723=64, srv1921562921=55, srv2100130330=67, srv38268264=73, srv1560716622=29, srv789351498=93, srv427951280=75, srv1085632136=3, srv231189808=70, srv779546984=90, srv1845167189=48, srv1307533235=18, srv534482170=80, srv560476646=82, srv67152942=87, srv1038357665=2, srv1764451574=40, srv1904122357=54, srv407739702=74, srv1819259122=45, srv785583674=92, srv1158528386=8, srv1850592001=51, srv180036421=42, srv10350951=1, srv1396631180=21, srv148224216=27, srv1845572486=49, srv61216009=85, srv1609049071=31, srv1427884247=24, srv119295441=9, srv1158447803=7, srv502888074=78, srv2139439622=69, srv1968158255=58, srv1257608522=16, srv538869391=81, srv2043691811=63, srv1810017024=43, srv1581622123=30, srv712796647=89, srv1776551161=41, srv187446955=53} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-03-11 17:53:18,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-03-11 17:53:18,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-03-11 17:53:18,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-03-11 17:53:18,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-03-11 17:53:18,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-03-11 17:53:18,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-03-11 17:53:18,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-03-11 17:53:18,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-03-11 17:53:18,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-03-11 17:53:18,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-03-11 17:53:18,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-03-11 17:53:18,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-03-11 17:53:18,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-03-11 17:53:18,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-03-11 17:53:18,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-03-11 17:53:18,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-03-11 17:53:18,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-03-11 17:53:18,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-03-11 17:53:18,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-03-11 17:53:18,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-03-11 17:53:18,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-03-11 17:53:18,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-03-11 17:53:18,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-03-11 17:53:18,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-03-11 17:53:18,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-03-11 17:53:18,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-03-11 17:53:18,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-03-11 17:53:18,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-03-11 17:53:18,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-03-11 17:53:18,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-03-11 17:53:18,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-03-11 17:53:18,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-03-11 17:53:18,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-03-11 17:53:18,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-03-11 17:53:18,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-03-11 17:53:18,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-03-11 17:53:18,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-03-11 17:53:18,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-03-11 17:53:18,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-03-11 17:53:18,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-03-11 17:53:18,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-03-11 17:53:18,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-03-11 17:53:18,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-03-11 17:53:18,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-03-11 17:53:18,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-03-11 17:53:18,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-03-11 17:53:18,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-03-11 17:53:18,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-03-11 17:53:18,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-03-11 17:53:18,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-03-11 17:53:18,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-03-11 17:53:18,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-03-11 17:53:18,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-03-11 17:53:18,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-03-11 17:53:18,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-03-11 17:53:18,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-03-11 17:53:18,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-03-11 17:53:18,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-03-11 17:53:18,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-03-11 17:53:18,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-03-11 17:53:18,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-03-11 17:53:18,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-03-11 17:53:18,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-03-11 17:53:18,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-03-11 17:53:18,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-03-11 17:53:18,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-03-11 17:53:18,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-03-11 17:53:18,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-03-11 17:53:18,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-03-11 17:53:18,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-03-11 17:53:18,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-03-11 17:53:18,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-03-11 17:53:18,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-03-11 17:53:18,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-03-11 17:53:18,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-03-11 17:53:18,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-03-11 17:53:18,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-03-11 17:53:18,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-03-11 17:53:18,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-03-11 17:53:18,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-03-11 17:53:18,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-03-11 17:53:18,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-03-11 17:53:18,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-03-11 17:53:18,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-03-11 17:53:18,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-03-11 17:53:18,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-03-11 17:53:18,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-03-11 17:53:18,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-03-11 17:53:18,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-03-11 17:53:18,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-03-11 17:53:18,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-03-11 17:53:18,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-03-11 17:53:18,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-03-11 17:53:18,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-03-11 17:53:18,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-03-11 17:53:18,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-03-11 17:53:18,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-03-11 17:53:18,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-03-11 17:53:18,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-03-11 17:53:18,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-03-11 17:53:18,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-03-11 17:53:18,740 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020910798739602714); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03265298964695881, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020910798739602714); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.009583333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04441666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-11 17:53:18,741 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-03-11 17:53:18,741 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.012874076290763765, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020910798739602714); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03265298964695881, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020910798739602714); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.009583333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04441666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-03-11 17:53:19,038 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 420 ms to try 5000 different iterations.  Found a solution that moves 955 regions; Going from a computed imbalance of 0.012874076290763765 to a new imbalance of 5.893139185948018E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005763774795025093); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006598983018610534); MoveCostFunction : (multiplier=7.0, imbalance=0.10611111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005763774795025093); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004166666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-11 17:53:19,042 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1845167189:82 , srv1100510795:83 , srv1158528386:83 , srv1212333839:83 , srv1427884247:83 , srv1473698436:83 , srv1754308113:83 , srv180036421:83 , srv2009531706:83 , srv310790546:83 , srv534482170:83 , srv1200291777:84 , srv1212875340:84 , srv1487094005:84 , srv1609049071:84 , srv163820158:84 , srv1764451574:84 , srv2100130330:84 , srv213509365:84 , srv2139439622:84 , srv461157311:84 , srv502888074:84 , srv504786541:84 , srv882624466:84 , srv1257608522:85 , srv1307533235:85 , srv1560716622:85 , srv1640132679:85 , srv1681500274:85 , srv1697247357:85 , srv1776551161:85 , srv1845572486:85 , srv1845863537:85 , srv1921562921:85 , srv1950581229:85 , srv2048290723:85 , srv208652443:85 , srv538869391:85 , srv560476646:85 , srv606432804:85 , srv61216009:85 , srv67152942:85 , srv785583674:85 , srv789351498:85 , srv800689905:85 , srv837067175:85 , srv989869023:85 , srv1013835796:86 , srv10350951:86 , srv1085632136:86 , srv1131177288:86 , srv1140611758:86 , srv119295441:86 , srv1210111712:86 , srv1227149350:86 , srv1252263375:86 , srv1302359297:86 , srv148224216:86 , srv1581622123:86 , srv1762574754:86 , srv1815703350:86 , srv1819259122:86 , srv1825183728:86 , srv1831345541:86 , srv1852556139:86 , srv1904122357:86 , srv195264486:86 , srv1968158255:86 , srv1969620163:86 , srv2094472386:86 , srv301696584:86 , srv38268264:86 , srv407739702:86 , srv455142767:86 , srv590681305:86 , srv647275297:86 , srv711964387:86 , srv712796647:86 , srv779546984:86 , srv785097758:86 , srv900276344:86 , srv923859474:86 , srv1325861327:87 , srv1345250085:87 , srv1401997417:87 , srv140901925:87 , srv1478481144:87 , srv1671308283:87 , srv1810017024:87 , srv1850592001:87 , srv187446955:87 , srv1976541987:87 , srv2012604508:87 , srv2043691811:87 , srv231189808:87 , srv427951280:87 , srv1038357665:88 , srv1158447803:88 , srv1396631180:88 , srv1705672346:549 }
2024-03-11 17:53:19,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-03-11 17:53:19,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1013835796=0, srv2094472386=66, srv837067175=95, srv1487094005=28, srv1845863537=50, srv1815703350=44, srv1325861327=19, srv1950581229=56, srv1345250085=20, srv590681305=83, srv140901925=23, srv455142767=76, srv989869023=99, srv1200291777=10, srv1671308283=34, srv1473698436=25, srv461157311=77, srv711964387=88, srv163820158=32, srv1705672346=37, srv785097758=91, srv195264486=57, srv213509365=68, srv1140611758=6, srv1762574754=39, srv647275297=86, srv606432804=84, srv1754308113=38, srv800689905=94, srv882624466=96, srv208652443=65, srv1131177288=5, srv1976541987=60, srv1852556139=52, srv1681500274=35, srv504786541=79, srv301696584=71, srv2012604508=62, srv1212875340=13, srv1401997417=22, srv310790546=72, srv1227149350=14, srv1478481144=26, srv1210111712=11, srv1831345541=47, srv1212333839=12, srv2009531706=61, srv1825183728=46, srv1640132679=33, srv1252263375=15, srv1969620163=59, srv1100510795=4, srv923859474=98, srv900276344=97, srv1697247357=36, srv1302359297=17, srv2048290723=64, srv1921562921=55, srv2100130330=67, srv38268264=73, srv1560716622=29, srv789351498=93, srv427951280=75, srv1085632136=3, srv231189808=70, srv779546984=90, srv1845167189=48, srv1307533235=18, srv534482170=80, srv560476646=82, srv67152942=87, srv1038357665=2, srv1764451574=40, srv1904122357=54, srv407739702=74, srv1819259122=45, srv785583674=92, srv1158528386=8, srv1850592001=51, srv180036421=42, srv10350951=1, srv1396631180=21, srv148224216=27, srv1845572486=49, srv61216009=85, srv1609049071=31, srv1427884247=24, srv119295441=9, srv1158447803=7, srv502888074=78, srv2139439622=69, srv1968158255=58, srv1257608522=16, srv538869391=81, srv2043691811=63, srv1810017024=43, srv1581622123=30, srv712796647=89, srv1776551161=41, srv187446955=53} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-03-11 17:53:19,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-03-11 17:53:19,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-03-11 17:53:19,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-03-11 17:53:19,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-03-11 17:53:19,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-03-11 17:53:19,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-03-11 17:53:19,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-03-11 17:53:19,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-03-11 17:53:19,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-03-11 17:53:19,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-03-11 17:53:19,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-03-11 17:53:19,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-03-11 17:53:19,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-03-11 17:53:19,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-03-11 17:53:19,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-03-11 17:53:19,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-03-11 17:53:19,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-03-11 17:53:19,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-03-11 17:53:19,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-03-11 17:53:19,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-03-11 17:53:19,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-03-11 17:53:19,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-03-11 17:53:19,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-03-11 17:53:19,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-03-11 17:53:19,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-03-11 17:53:19,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-03-11 17:53:19,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-03-11 17:53:19,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-03-11 17:53:19,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-03-11 17:53:19,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-03-11 17:53:19,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-03-11 17:53:19,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-03-11 17:53:19,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-03-11 17:53:19,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-03-11 17:53:19,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-03-11 17:53:19,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-03-11 17:53:19,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-03-11 17:53:19,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-03-11 17:53:19,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-03-11 17:53:19,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-03-11 17:53:19,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-03-11 17:53:19,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-03-11 17:53:19,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-03-11 17:53:19,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-03-11 17:53:19,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-03-11 17:53:19,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-03-11 17:53:19,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-03-11 17:53:19,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-03-11 17:53:19,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-03-11 17:53:19,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-03-11 17:53:19,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-03-11 17:53:19,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-03-11 17:53:19,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-03-11 17:53:19,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-03-11 17:53:19,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-03-11 17:53:19,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-03-11 17:53:19,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-03-11 17:53:19,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-03-11 17:53:19,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-03-11 17:53:19,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-03-11 17:53:19,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-03-11 17:53:19,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-03-11 17:53:19,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-03-11 17:53:19,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-03-11 17:53:19,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-03-11 17:53:19,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-03-11 17:53:19,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-03-11 17:53:19,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-03-11 17:53:19,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-03-11 17:53:19,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-03-11 17:53:19,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-03-11 17:53:19,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-03-11 17:53:19,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-03-11 17:53:19,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-03-11 17:53:19,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-03-11 17:53:19,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-03-11 17:53:19,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-03-11 17:53:19,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-03-11 17:53:19,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-03-11 17:53:19,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-03-11 17:53:19,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-03-11 17:53:19,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-03-11 17:53:19,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-03-11 17:53:19,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-03-11 17:53:19,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-03-11 17:53:19,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-03-11 17:53:19,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-03-11 17:53:19,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-03-11 17:53:19,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-03-11 17:53:19,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-03-11 17:53:19,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-03-11 17:53:19,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-03-11 17:53:19,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-03-11 17:53:19,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-03-11 17:53:19,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-03-11 17:53:19,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-03-11 17:53:19,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-03-11 17:53:19,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-03-11 17:53:19,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-03-11 17:53:19,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-03-11 17:53:19,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-03-11 17:53:19,210 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005763774795025093); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006598983018610534); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005763774795025093); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004166666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-11 17:53:19,210 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-03-11 17:53:19,210 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=5.826268656695538E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005763774795025093); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006598983018610534); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005763774795025093); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004166666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-03-11 17:53:19,628 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 547 ms to try 5000 different iterations.  Found a solution that moves 237 regions; Going from a computed imbalance of 5.826268656695538E-4 to a new imbalance of 3.524155755308916E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0019534423844256277); MoveCostFunction : (multiplier=7.0, imbalance=0.026333333333333334, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-11 17:53:19,629 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1302359297:82 , srv1038357665:83 , srv1396631180:83 , srv1640132679:83 , srv1969620163:83 , srv2048290723:83 , srv712796647:83 , srv1013835796:84 , srv1085632136:84 , srv1140611758:84 , srv1158447803:84 , srv1227149350:84 , srv1252263375:84 , srv1325861327:84 , srv1401997417:84 , srv140901925:84 , srv1427884247:84 , srv1478481144:84 , srv148224216:84 , srv1671308283:84 , srv1681500274:84 , srv1697247357:84 , srv1776551161:84 , srv180036421:84 , srv1815703350:84 , srv1845863537:84 , srv1850592001:84 , srv187446955:84 , srv195264486:84 , srv1976541987:84 , srv2012604508:84 , srv2043691811:84 , srv2094472386:84 , srv231189808:84 , srv38268264:84 , srv407739702:84 , srv455142767:84 , srv606432804:84 , srv67152942:84 , srv779546984:84 , srv785583674:84 , srv789351498:84 , srv900276344:84 , srv923859474:84 , srv989869023:84 , srv1100510795:85 , srv1131177288:85 , srv1158528386:85 , srv119295441:85 , srv1200291777:85 , srv1210111712:85 , srv1212333839:85 , srv1212875340:85 , srv1307533235:85 , srv1345250085:85 , srv1487094005:85 , srv1560716622:85 , srv1581622123:85 , srv1609049071:85 , srv163820158:85 , srv1754308113:85 , srv1762574754:85 , srv1764451574:85 , srv1810017024:85 , srv1819259122:85 , srv1825183728:85 , srv1831345541:85 , srv1845167189:85 , srv1845572486:85 , srv1852556139:85 , srv1904122357:85 , srv1921562921:85 , srv1950581229:85 , srv1968158255:85 , srv2009531706:85 , srv208652443:85 , srv2139439622:85 , srv301696584:85 , srv310790546:85 , srv427951280:85 , srv461157311:85 , srv502888074:85 , srv504786541:85 , srv534482170:85 , srv538869391:85 , srv560476646:85 , srv590681305:85 , srv61216009:85 , srv647275297:85 , srv711964387:85 , srv785097758:85 , srv800689905:85 , srv837067175:85 , srv882624466:85 , srv10350951:86 , srv1257608522:86 , srv1473698436:86 , srv2100130330:86 , srv213509365:86 , srv1705672346:633 }
2024-03-11 17:53:19,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-03-11 17:53:19,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1013835796=0, srv2094472386=66, srv837067175=95, srv1487094005=28, srv1845863537=50, srv1815703350=44, srv1325861327=19, srv1950581229=56, srv1345250085=20, srv590681305=83, srv140901925=23, srv455142767=76, srv989869023=99, srv1200291777=10, srv1671308283=34, srv1473698436=25, srv461157311=77, srv711964387=88, srv163820158=32, srv1705672346=37, srv785097758=91, srv195264486=57, srv213509365=68, srv1140611758=6, srv1762574754=39, srv647275297=86, srv606432804=84, srv1754308113=38, srv800689905=94, srv882624466=96, srv208652443=65, srv1131177288=5, srv1976541987=60, srv1852556139=52, srv1681500274=35, srv504786541=79, srv301696584=71, srv2012604508=62, srv1212875340=13, srv1401997417=22, srv310790546=72, srv1227149350=14, srv1478481144=26, srv1210111712=11, srv1831345541=47, srv1212333839=12, srv2009531706=61, srv1825183728=46, srv1640132679=33, srv1252263375=15, srv1969620163=59, srv1100510795=4, srv923859474=98, srv900276344=97, srv1697247357=36, srv1302359297=17, srv2048290723=64, srv1921562921=55, srv2100130330=67, srv38268264=73, srv1560716622=29, srv789351498=93, srv427951280=75, srv1085632136=3, srv231189808=70, srv779546984=90, srv1845167189=48, srv1307533235=18, srv534482170=80, srv560476646=82, srv67152942=87, srv1038357665=2, srv1764451574=40, srv1904122357=54, srv407739702=74, srv1819259122=45, srv785583674=92, srv1158528386=8, srv1850592001=51, srv180036421=42, srv10350951=1, srv1396631180=21, srv148224216=27, srv1845572486=49, srv61216009=85, srv1609049071=31, srv1427884247=24, srv119295441=9, srv1158447803=7, srv502888074=78, srv2139439622=69, srv1968158255=58, srv1257608522=16, srv538869391=81, srv2043691811=63, srv1810017024=43, srv1581622123=30, srv712796647=89, srv1776551161=41, srv187446955=53} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-03-11 17:53:19,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-03-11 17:53:19,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-03-11 17:53:19,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-03-11 17:53:19,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-03-11 17:53:19,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-03-11 17:53:19,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-03-11 17:53:19,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-03-11 17:53:19,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-03-11 17:53:19,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-03-11 17:53:19,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-03-11 17:53:19,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-03-11 17:53:19,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-03-11 17:53:19,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-03-11 17:53:19,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-03-11 17:53:19,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-03-11 17:53:19,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-03-11 17:53:19,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-03-11 17:53:19,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-03-11 17:53:19,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-03-11 17:53:19,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-03-11 17:53:19,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-03-11 17:53:19,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-03-11 17:53:19,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-03-11 17:53:19,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-03-11 17:53:19,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-03-11 17:53:19,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-03-11 17:53:19,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-03-11 17:53:19,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-03-11 17:53:19,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-03-11 17:53:19,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-03-11 17:53:19,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-03-11 17:53:19,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-03-11 17:53:19,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-03-11 17:53:19,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-03-11 17:53:19,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-03-11 17:53:19,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-03-11 17:53:19,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-03-11 17:53:19,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-03-11 17:53:19,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-03-11 17:53:19,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-03-11 17:53:19,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-03-11 17:53:19,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-03-11 17:53:19,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-03-11 17:53:19,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-03-11 17:53:19,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-03-11 17:53:19,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-03-11 17:53:19,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-03-11 17:53:19,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-03-11 17:53:19,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-03-11 17:53:19,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-03-11 17:53:19,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-03-11 17:53:19,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-03-11 17:53:19,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-03-11 17:53:19,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-03-11 17:53:19,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-03-11 17:53:19,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-03-11 17:53:19,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-03-11 17:53:19,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-03-11 17:53:19,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-03-11 17:53:19,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-03-11 17:53:19,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-03-11 17:53:19,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-03-11 17:53:19,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-03-11 17:53:19,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-03-11 17:53:19,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-03-11 17:53:19,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-03-11 17:53:19,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-03-11 17:53:19,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-03-11 17:53:19,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-03-11 17:53:19,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-03-11 17:53:19,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-03-11 17:53:19,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-03-11 17:53:19,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-03-11 17:53:19,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-03-11 17:53:19,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-03-11 17:53:19,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-03-11 17:53:19,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-03-11 17:53:19,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-03-11 17:53:19,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-03-11 17:53:19,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-03-11 17:53:19,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-03-11 17:53:19,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-03-11 17:53:19,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-03-11 17:53:19,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-03-11 17:53:19,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-03-11 17:53:19,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-03-11 17:53:19,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-03-11 17:53:19,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-03-11 17:53:19,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-03-11 17:53:19,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-03-11 17:53:19,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-03-11 17:53:19,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-03-11 17:53:19,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-03-11 17:53:19,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-03-11 17:53:19,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-03-11 17:53:19,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-03-11 17:53:19,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-03-11 17:53:19,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-03-11 17:53:19,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-03-11 17:53:19,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-03-11 17:53:19,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-03-11 17:53:19,752 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0019534423844256277); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-11 17:53:19,752 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-03-11 17:53:19,752 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=3.358204808368205E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0019534423844256277); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-03-11 17:53:19,993 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 336 ms to try 5000 different iterations.  Found a solution that moves 27 regions; Going from a computed imbalance of 3.358204808368205E-5 to a new imbalance of 7.262297337147979E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.003); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-11 17:53:19,994 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv10350951:83 , srv1257608522:83 , srv1473698436:83 , srv1825183728:83 , srv1904122357:83 , srv213509365:83 , srv427951280:83 , srv785097758:83 , srv789351498:83 , srv1013835796:84 , srv1085632136:84 , srv1100510795:84 , srv1131177288:84 , srv1140611758:84 , srv1158447803:84 , srv1158528386:84 , srv119295441:84 , srv1200291777:84 , srv1210111712:84 , srv1212333839:84 , srv1212875340:84 , srv1227149350:84 , srv1252263375:84 , srv1307533235:84 , srv1325861327:84 , srv1345250085:84 , srv1396631180:84 , srv1401997417:84 , srv140901925:84 , srv1478481144:84 , srv148224216:84 , srv1487094005:84 , srv1560716622:84 , srv1581622123:84 , srv1609049071:84 , srv163820158:84 , srv1671308283:84 , srv1681500274:84 , srv1697247357:84 , srv1754308113:84 , srv1762574754:84 , srv1764451574:84 , srv180036421:84 , srv1810017024:84 , srv1819259122:84 , srv1831345541:84 , srv1845572486:84 , srv1845863537:84 , srv1850592001:84 , srv1852556139:84 , srv187446955:84 , srv1921562921:84 , srv1950581229:84 , srv195264486:84 , srv1968158255:84 , srv1969620163:84 , srv1976541987:84 , srv2009531706:84 , srv2012604508:84 , srv2043691811:84 , srv208652443:84 , srv2094472386:84 , srv2100130330:84 , srv2139439622:84 , srv231189808:84 , srv301696584:84 , srv310790546:84 , srv38268264:84 , srv407739702:84 , srv455142767:84 , srv461157311:84 , srv502888074:84 , srv504786541:84 , srv534482170:84 , srv538869391:84 , srv560476646:84 , srv590681305:84 , srv606432804:84 , srv61216009:84 , srv647275297:84 , srv67152942:84 , srv711964387:84 , srv779546984:84 , srv785583674:84 , srv800689905:84 , srv837067175:84 , srv882624466:84 , srv900276344:84 , srv923859474:84 , srv989869023:84 , srv1038357665:85 , srv1302359297:85 , srv1427884247:85 , srv1640132679:85 , srv1776551161:85 , srv1815703350:85 , srv1845167189:85 , srv2048290723:85 , srv712796647:85 , srv1705672346:684 }
2024-03-11 17:53:20,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-03-11 17:53:20,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1013835796=0, srv2094472386=66, srv837067175=95, srv1487094005=28, srv1845863537=50, srv1815703350=44, srv1325861327=19, srv1950581229=56, srv1345250085=20, srv590681305=83, srv140901925=23, srv455142767=76, srv989869023=99, srv1200291777=10, srv1671308283=34, srv1473698436=25, srv461157311=77, srv711964387=88, srv163820158=32, srv1705672346=37, srv785097758=91, srv195264486=57, srv213509365=68, srv1140611758=6, srv1762574754=39, srv647275297=86, srv606432804=84, srv1754308113=38, srv800689905=94, srv882624466=96, srv208652443=65, srv1131177288=5, srv1976541987=60, srv1852556139=52, srv1681500274=35, srv504786541=79, srv301696584=71, srv2012604508=62, srv1212875340=13, srv1401997417=22, srv310790546=72, srv1227149350=14, srv1478481144=26, srv1210111712=11, srv1831345541=47, srv1212333839=12, srv2009531706=61, srv1825183728=46, srv1640132679=33, srv1252263375=15, srv1969620163=59, srv1100510795=4, srv923859474=98, srv900276344=97, srv1697247357=36, srv1302359297=17, srv2048290723=64, srv1921562921=55, srv2100130330=67, srv38268264=73, srv1560716622=29, srv789351498=93, srv427951280=75, srv1085632136=3, srv231189808=70, srv779546984=90, srv1845167189=48, srv1307533235=18, srv534482170=80, srv560476646=82, srv67152942=87, srv1038357665=2, srv1764451574=40, srv1904122357=54, srv407739702=74, srv1819259122=45, srv785583674=92, srv1158528386=8, srv1850592001=51, srv180036421=42, srv10350951=1, srv1396631180=21, srv148224216=27, srv1845572486=49, srv61216009=85, srv1609049071=31, srv1427884247=24, srv119295441=9, srv1158447803=7, srv502888074=78, srv2139439622=69, srv1968158255=58, srv1257608522=16, srv538869391=81, srv2043691811=63, srv1810017024=43, srv1581622123=30, srv712796647=89, srv1776551161=41, srv187446955=53} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-03-11 17:53:20,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-03-11 17:53:20,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-03-11 17:53:20,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-03-11 17:53:20,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-03-11 17:53:20,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-03-11 17:53:20,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-03-11 17:53:20,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-03-11 17:53:20,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-03-11 17:53:20,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-03-11 17:53:20,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-03-11 17:53:20,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-03-11 17:53:20,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-03-11 17:53:20,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-03-11 17:53:20,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-03-11 17:53:20,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-03-11 17:53:20,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-03-11 17:53:20,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-03-11 17:53:20,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-03-11 17:53:20,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-03-11 17:53:20,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-03-11 17:53:20,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-03-11 17:53:20,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-03-11 17:53:20,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-03-11 17:53:20,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-03-11 17:53:20,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-03-11 17:53:20,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-03-11 17:53:20,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-03-11 17:53:20,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-03-11 17:53:20,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-03-11 17:53:20,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-03-11 17:53:20,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-03-11 17:53:20,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-03-11 17:53:20,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-03-11 17:53:20,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-03-11 17:53:20,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-03-11 17:53:20,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-03-11 17:53:20,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-03-11 17:53:20,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-03-11 17:53:20,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-03-11 17:53:20,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-03-11 17:53:20,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-03-11 17:53:20,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-03-11 17:53:20,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-03-11 17:53:20,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-03-11 17:53:20,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-03-11 17:53:20,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-03-11 17:53:20,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-03-11 17:53:20,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-03-11 17:53:20,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-03-11 17:53:20,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-03-11 17:53:20,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-03-11 17:53:20,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-03-11 17:53:20,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-03-11 17:53:20,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-03-11 17:53:20,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-03-11 17:53:20,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-03-11 17:53:20,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-03-11 17:53:20,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-03-11 17:53:20,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-03-11 17:53:20,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-03-11 17:53:20,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-03-11 17:53:20,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-03-11 17:53:20,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-03-11 17:53:20,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-03-11 17:53:20,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-03-11 17:53:20,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-03-11 17:53:20,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-03-11 17:53:20,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-03-11 17:53:20,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-03-11 17:53:20,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-03-11 17:53:20,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-03-11 17:53:20,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-03-11 17:53:20,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-03-11 17:53:20,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-03-11 17:53:20,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-03-11 17:53:20,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-03-11 17:53:20,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-03-11 17:53:20,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-03-11 17:53:20,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-03-11 17:53:20,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-03-11 17:53:20,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-03-11 17:53:20,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-03-11 17:53:20,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-03-11 17:53:20,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-03-11 17:53:20,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-03-11 17:53:20,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-03-11 17:53:20,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-03-11 17:53:20,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-03-11 17:53:20,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-03-11 17:53:20,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-03-11 17:53:20,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-03-11 17:53:20,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-03-11 17:53:20,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-03-11 17:53:20,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-03-11 17:53:20,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-03-11 17:53:20,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-03-11 17:53:20,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-03-11 17:53:20,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-03-11 17:53:20,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-03-11 17:53:20,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-03-11 17:53:20,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-03-11 17:53:20,135 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.073239296329447E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-11 17:53:20,135 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv10350951:83 , srv1257608522:83 , srv1473698436:83 , srv1825183728:83 , srv1904122357:83 , srv213509365:83 , srv427951280:83 , srv785097758:83 , srv789351498:83 , srv1013835796:84 , srv1085632136:84 , srv1100510795:84 , srv1131177288:84 , srv1140611758:84 , srv1158447803:84 , srv1158528386:84 , srv119295441:84 , srv1200291777:84 , srv1210111712:84 , srv1212333839:84 , srv1212875340:84 , srv1227149350:84 , srv1252263375:84 , srv1307533235:84 , srv1325861327:84 , srv1345250085:84 , srv1396631180:84 , srv1401997417:84 , srv140901925:84 , srv1478481144:84 , srv148224216:84 , srv1487094005:84 , srv1560716622:84 , srv1581622123:84 , srv1609049071:84 , srv163820158:84 , srv1671308283:84 , srv1681500274:84 , srv1697247357:84 , srv1754308113:84 , srv1762574754:84 , srv1764451574:84 , srv180036421:84 , srv1810017024:84 , srv1819259122:84 , srv1831345541:84 , srv1845572486:84 , srv1845863537:84 , srv1850592001:84 , srv1852556139:84 , srv187446955:84 , srv1921562921:84 , srv1950581229:84 , srv195264486:84 , srv1968158255:84 , srv1969620163:84 , srv1976541987:84 , srv2009531706:84 , srv2012604508:84 , srv2043691811:84 , srv208652443:84 , srv2094472386:84 , srv2100130330:84 , srv2139439622:84 , srv231189808:84 , srv301696584:84 , srv310790546:84 , srv38268264:84 , srv407739702:84 , srv455142767:84 , srv461157311:84 , srv502888074:84 , srv504786541:84 , srv534482170:84 , srv538869391:84 , srv560476646:84 , srv590681305:84 , srv606432804:84 , srv61216009:84 , srv647275297:84 , srv67152942:84 , srv711964387:84 , srv779546984:84 , srv785583674:84 , srv800689905:84 , srv837067175:84 , srv882624466:84 , srv900276344:84 , srv923859474:84 , srv989869023:84 , srv1038357665:85 , srv1302359297:85 , srv1427884247:85 , srv1640132679:85 , srv1776551161:85 , srv1815703350:85 , srv1845167189:85 , srv2048290723:85 , srv712796647:85 , srv1705672346:684 }
2024-03-11 17:53:20,160 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=289 (was 289), ProcessCount=172 (was 172), AvailableMemoryMB=13283 (was 14018)
2024-03-11 17:53:20,169 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=289, ProcessCount=172, AvailableMemoryMB=13282
2024-03-11 17:53:20,169 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-03-11 17:53:20,170 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2024-03-11 17:53:20,179 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1080763497:84 , srv1178940046:84 , srv1194535297:84 , srv1302393848:84 , srv1343727366:84 , srv143641905:84 , srv1465328279:84 , srv1867706305:84 , srv1924097005:84 , srv201978969:84 , srv2092292692:84 , srv2132977883:84 , srv232824448:84 , srv289133461:84 , srv314540788:84 , srv324306682:84 , srv414229087:84 , srv452006092:84 , srv452597334:84 , srv485469478:84 , srv534665686:84 , srv596218256:84 , srv739031519:84 , srv741722469:84 , srv753855640:84 , srv761048600:84 , srv787520732:84 , srv79754685:84 , srv987013846:84 , srv1408643560:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2024-03-11 17:53:20,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-03-11 17:53:20,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1194535297=2, srv2092292692=11, srv2132977883=12, srv314540788=15, srv143641905=6, srv79754685=28, srv1867706305=8, srv741722469=24, srv324306682=16, srv787520732=27, srv1924097005=9, srv753855640=25, srv534665686=21, srv232824448=13, srv414229087=17, srv596218256=22, srv1178940046=1, srv452006092=18, srv1343727366=4, srv987013846=29, srv1302393848=3, srv1080763497=0, srv201978969=10, srv452597334=19, srv739031519=23, srv1465328279=7, srv485469478=20, srv1408643560=5, srv761048600=26, srv289133461=14} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-03-11 17:53:20,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-03-11 17:53:20,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-03-11 17:53:20,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-03-11 17:53:20,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-03-11 17:53:20,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-03-11 17:53:20,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-03-11 17:53:20,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-03-11 17:53:20,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-03-11 17:53:20,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-03-11 17:53:20,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-03-11 17:53:20,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-03-11 17:53:20,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-03-11 17:53:20,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-03-11 17:53:20,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-03-11 17:53:20,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-03-11 17:53:20,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-03-11 17:53:20,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-03-11 17:53:20,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-03-11 17:53:20,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-03-11 17:53:20,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-03-11 17:53:20,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-03-11 17:53:20,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-03-11 17:53:20,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-03-11 17:53:20,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-03-11 17:53:20,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-03-11 17:53:20,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-03-11 17:53:20,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-03-11 17:53:20,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-03-11 17:53:20,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-03-11 17:53:20,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-03-11 17:53:20,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-03-11 17:53:20,205 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1103326371502262, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-11 17:53:20,206 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912540697801249, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1103326371502262, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2024-03-11 17:55:20,194 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5428518 different iterations.  Found a solution that moves 1870 regions; Going from a computed imbalance of 0.9912540697801249 to a new imbalance of 4.3646732880327594E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6925925925925925, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-11 17:55:20,200 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1080763497:90 , srv1178940046:90 , srv1194535297:90 , srv1302393848:90 , srv1343727366:90 , srv1408643560:90 , srv143641905:90 , srv1465328279:90 , srv1867706305:90 , srv1924097005:90 , srv201978969:90 , srv2092292692:90 , srv2132977883:90 , srv232824448:90 , srv289133461:90 , srv314540788:90 , srv324306682:90 , srv414229087:90 , srv452006092:90 , srv452597334:90 , srv485469478:90 , srv534665686:90 , srv596218256:90 , srv739031519:90 , srv741722469:90 , srv753855640:90 , srv761048600:90 , srv787520732:90 , srv79754685:90 , srv987013846:90 }
2024-03-11 17:55:20,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-03-11 17:55:20,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1194535297=2, srv2092292692=11, srv2132977883=12, srv314540788=15, srv143641905=6, srv79754685=28, srv1867706305=8, srv741722469=24, srv324306682=16, srv787520732=27, srv1924097005=9, srv753855640=25, srv534665686=21, srv232824448=13, srv414229087=17, srv596218256=22, srv1178940046=1, srv452006092=18, srv1343727366=4, srv987013846=29, srv1302393848=3, srv1080763497=0, srv201978969=10, srv452597334=19, srv739031519=23, srv1465328279=7, srv485469478=20, srv1408643560=5, srv761048600=26, srv289133461=14} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-03-11 17:55:20,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-03-11 17:55:20,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-03-11 17:55:20,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-03-11 17:55:20,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-03-11 17:55:20,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-03-11 17:55:20,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-03-11 17:55:20,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-03-11 17:55:20,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-03-11 17:55:20,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-03-11 17:55:20,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-03-11 17:55:20,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-03-11 17:55:20,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-03-11 17:55:20,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-03-11 17:55:20,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-03-11 17:55:20,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-03-11 17:55:20,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-03-11 17:55:20,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-03-11 17:55:20,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-03-11 17:55:20,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-03-11 17:55:20,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-03-11 17:55:20,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-03-11 17:55:20,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-03-11 17:55:20,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-03-11 17:55:20,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-03-11 17:55:20,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-03-11 17:55:20,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-03-11 17:55:20,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-03-11 17:55:20,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-03-11 17:55:20,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-03-11 17:55:20,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-03-11 17:55:20,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-03-11 17:55:20,218 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-11 17:55:20,219 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1080763497:90 , srv1178940046:90 , srv1194535297:90 , srv1302393848:90 , srv1343727366:90 , srv1408643560:90 , srv143641905:90 , srv1465328279:90 , srv1867706305:90 , srv1924097005:90 , srv201978969:90 , srv2092292692:90 , srv2132977883:90 , srv232824448:90 , srv289133461:90 , srv314540788:90 , srv324306682:90 , srv414229087:90 , srv452006092:90 , srv452597334:90 , srv485469478:90 , srv534665686:90 , srv596218256:90 , srv739031519:90 , srv741722469:90 , srv753855640:90 , srv761048600:90 , srv787520732:90 , srv79754685:90 , srv987013846:90 }
2024-03-11 17:55:20,236 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=172 (was 289), ProcessCount=168 (was 172), AvailableMemoryMB=12511 (was 13282)