2023-12-25 14:53:23,773 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-12-25 14:53:24,115 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-12-25 14:53:24,231 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-12-25 14:53:24,305 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-12-25 14:53:24,315 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-12-25 14:53:24,332 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=329, ProcessCount=176, AvailableMemoryMB=11608
2023-12-25 14:53:24,334 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-12-25 14:53:24,335 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-12-25 14:53:24,476 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1012712061:84 , srv1058008709:84 , srv106492844:84 , srv1092024068:84 , srv1115542577:84 , srv1115700176:84 , srv1124685875:84 , srv1128046992:84 , srv1213108853:84 , srv123318978:84 , srv1252160850:84 , srv1312594218:84 , srv1322099845:84 , srv134398413:84 , srv1344713265:84 , srv1346141305:84 , srv1352026485:84 , srv1403137531:84 , srv1410228751:84 , srv1428333954:84 , srv1442890905:84 , srv1509034888:84 , srv1542169832:84 , srv1545784504:84 , srv1561590027:84 , srv1586897674:84 , srv1611750578:84 , srv1631794841:84 , srv1639204007:84 , srv1685174649:84 , srv1686598985:84 , srv1701795271:84 , srv1702568053:84 , srv1706708659:84 , srv1711691732:84 , srv1721147137:84 , srv1728088298:84 , srv1735614761:84 , srv1743882021:84 , srv1748456160:84 , srv1756890719:84 , srv1761396971:84 , srv1766649394:84 , srv1807777603:84 , srv1821832377:84 , srv1823793955:84 , srv1828990937:84 , srv183578228:84 , srv1845143767:84 , srv1847305240:84 , srv1923350864:84 , srv192346964:84 , srv1961788750:84 , srv1969704154:84 , srv1973469375:84 , srv1977681413:84 , srv2006411619:84 , srv2009889864:84 , srv2037617371:84 , srv2074710601:84 , srv2080978302:84 , srv2088880776:84 , srv2091989504:84 , srv2099297852:84 , srv2106310686:84 , srv2135599929:84 , srv222209447:84 , srv242219510:84 , srv278880732:84 , srv300389714:84 , srv302398251:84 , srv374364056:84 , srv395883313:84 , srv397656773:84 , srv42429874:84 , srv449116583:84 , srv477266940:84 , srv484873888:84 , srv547222999:84 , srv585605733:84 , srv592131674:84 , srv644451375:84 , srv660616207:84 , srv697026306:84 , srv724758179:84 , srv740293401:84 , srv786461890:84 , srv787208898:84 , srv810817658:84 , srv844123109:84 , srv84432486:84 , srv846337424:84 , srv862973712:84 , srv868306068:84 , srv888524850:84 , srv92048021:84 , srv952562287:84 , srv986663349:84 , srv996152264:84 , srv1951367358:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-12-25 14:53:24,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-25 14:53:24,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1124685875=6, srv1403137531=17, srv697026306=84, srv1639204007=28, srv644451375=82, srv1823793955=45, srv1969704154=54, srv395883313=73, srv84432486=91, srv2009889864=58, srv1213108853=8, srv1352026485=16, srv2037617371=59, srv592131674=81, srv2099297852=64, srv868306068=94, srv1322099845=12, srv1344713265=14, srv1951367358=52, srv810817658=89, srv740293401=86, srv1756890719=40, srv1701795271=31, srv449116583=76, srv1807777603=43, srv1847305240=49, srv888524850=95, srv547222999=79, srv134398413=13, srv844123109=90, srv1509034888=21, srv1702568053=32, srv1115542577=4, srv1828990937=46, srv786461890=87, srv1728088298=36, srv1977681413=56, srv1312594218=11, srv1821832377=44, srv1346141305=15, srv1686598985=30, srv1961788750=53, srv477266940=77, srv1735614761=37, srv374364056=72, srv1561590027=24, srv1748456160=39, srv1711691732=34, srv2135599929=66, srv1252160850=10, srv1586897674=25, srv1442890905=20, srv2088880776=62, srv1721147137=35, srv300389714=70, srv2091989504=63, srv183578228=47, srv92048021=96, srv986663349=98, srv1845143767=48, srv1923350864=50, srv724758179=85, srv952562287=97, srv1973469375=55, srv302398251=71, srv1115700176=5, srv222209447=67, srv1428333954=19, srv1410228751=18, srv242219510=68, srv2074710601=60, srv484873888=78, srv192346964=51, srv2080978302=61, srv996152264=99, srv2106310686=65, srv397656773=74, srv278880732=69, srv106492844=2, srv1542169832=22, srv787208898=88, srv1766649394=42, srv1545784504=23, srv1092024068=3, srv1685174649=29, srv862973712=93, srv846337424=92, srv1706708659=33, srv2006411619=57, srv660616207=83, srv123318978=9, srv1743882021=38, srv1761396971=41, srv1058008709=1, srv1611750578=26, srv42429874=75, srv585605733=80, srv1012712061=0, srv1128046992=7, srv1631794841=27} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-25 14:53:24,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-25 14:53:24,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-25 14:53:24,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-25 14:53:24,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-25 14:53:24,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-25 14:53:24,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-25 14:53:24,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-25 14:53:24,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-25 14:53:24,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-25 14:53:24,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-25 14:53:24,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-25 14:53:24,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-25 14:53:24,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-25 14:53:24,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-25 14:53:24,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-25 14:53:24,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-25 14:53:24,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-25 14:53:24,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-25 14:53:24,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-25 14:53:24,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-25 14:53:24,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-25 14:53:24,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-25 14:53:24,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-25 14:53:24,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-25 14:53:24,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-25 14:53:24,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-25 14:53:24,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-25 14:53:24,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-25 14:53:24,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-25 14:53:24,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-25 14:53:24,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-25 14:53:24,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-25 14:53:24,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-25 14:53:24,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-25 14:53:24,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-25 14:53:24,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-25 14:53:24,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-25 14:53:24,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-25 14:53:24,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-25 14:53:24,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-25 14:53:24,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-25 14:53:24,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-25 14:53:24,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-25 14:53:24,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-25 14:53:24,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-25 14:53:24,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-25 14:53:24,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-25 14:53:24,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-25 14:53:24,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-25 14:53:24,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-25 14:53:24,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-25 14:53:24,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-25 14:53:24,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-25 14:53:24,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-25 14:53:24,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-25 14:53:24,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-25 14:53:24,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-25 14:53:24,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-25 14:53:24,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-25 14:53:24,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-25 14:53:24,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-25 14:53:24,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-25 14:53:24,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-25 14:53:24,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-25 14:53:24,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-25 14:53:24,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-25 14:53:24,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-25 14:53:24,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-25 14:53:24,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-25 14:53:24,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-25 14:53:24,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-25 14:53:24,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-25 14:53:24,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-25 14:53:24,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-25 14:53:24,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-25 14:53:24,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-25 14:53:24,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-25 14:53:24,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-25 14:53:24,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-25 14:53:24,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-25 14:53:24,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-25 14:53:24,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-25 14:53:24,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-25 14:53:24,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-25 14:53:24,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-25 14:53:24,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-25 14:53:24,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-25 14:53:24,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-25 14:53:24,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-25 14:53:24,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-25 14:53:24,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-25 14:53:24,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-25 14:53:24,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-25 14:53:24,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-25 14:53:24,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-25 14:53:24,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-25 14:53:24,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-25 14:53:24,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-25 14:53:24,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-25 14:53:24,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-25 14:53:24,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-25 14:53:24,908 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-25 14:53:24,909 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-25 14:53:24,909 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-25 14:53:25,356 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 689 ms to try 5000 different iterations.  Found a solution that moves 4723 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17681612193007562. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04179773623604706, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05667161792589783, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5247777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04179773623604706, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17208333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23775, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-25 14:53:25,371 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1611750578:81 , srv1807777603:81 , srv952562287:81 , srv1058008709:82 , srv1586897674:82 , srv1923350864:82 , srv2006411619:82 , srv1115700176:83 , srv1410228751:83 , srv1847305240:83 , srv192346964:83 , srv2009889864:83 , srv2080978302:83 , srv2106310686:83 , srv810817658:83 , srv986663349:83 , srv1092024068:84 , srv1252160850:84 , srv1542169832:84 , srv1545784504:84 , srv1631794841:84 , srv1721147137:84 , srv1728088298:84 , srv2091989504:84 , srv395883313:84 , srv477266940:84 , srv547222999:84 , srv660616207:84 , srv862973712:84 , srv888524850:84 , srv1124685875:85 , srv1322099845:85 , srv1352026485:85 , srv1403137531:85 , srv1428333954:85 , srv1685174649:85 , srv1706708659:85 , srv1743882021:85 , srv1748456160:85 , srv1821832377:85 , srv1845143767:85 , srv2088880776:85 , srv222209447:85 , srv300389714:85 , srv374364056:85 , srv592131674:85 , srv786461890:85 , srv106492844:86 , srv134398413:86 , srv1344713265:86 , srv1509034888:86 , srv1686598985:86 , srv1711691732:86 , srv1756890719:86 , srv1973469375:86 , srv2037617371:86 , srv278880732:86 , srv302398251:86 , srv397656773:86 , srv644451375:86 , srv92048021:86 , srv1128046992:87 , srv1639204007:87 , srv1701795271:87 , srv1766649394:87 , srv1823793955:87 , srv1969704154:87 , srv2135599929:87 , srv242219510:87 , srv697026306:87 , srv84432486:87 , srv868306068:87 , srv123318978:88 , srv1312594218:88 , srv1346141305:88 , srv183578228:88 , srv2074710601:88 , srv449116583:88 , srv585605733:88 , srv724758179:88 , srv787208898:88 , srv844123109:88 , srv1012712061:89 , srv1213108853:89 , srv1761396971:89 , srv1828990937:89 , srv1961788750:89 , srv484873888:89 , srv740293401:89 , srv1977681413:90 , srv42429874:90 , srv1735614761:91 , srv846337424:92 , srv1442890905:93 , srv996152264:94 , srv1702568053:95 , srv2099297852:95 , srv1561590027:96 , srv1115542577:100 , srv1951367358:461 }
2023-12-25 14:53:25,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-25 14:53:25,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1124685875=6, srv1403137531=17, srv697026306=84, srv1639204007=28, srv644451375=82, srv1823793955=45, srv1969704154=54, srv395883313=73, srv84432486=91, srv2009889864=58, srv1213108853=8, srv1352026485=16, srv2037617371=59, srv592131674=81, srv2099297852=64, srv868306068=94, srv1322099845=12, srv1344713265=14, srv1951367358=52, srv810817658=89, srv740293401=86, srv1756890719=40, srv1701795271=31, srv449116583=76, srv1807777603=43, srv1847305240=49, srv888524850=95, srv547222999=79, srv134398413=13, srv844123109=90, srv1509034888=21, srv1702568053=32, srv1115542577=4, srv1828990937=46, srv786461890=87, srv1728088298=36, srv1977681413=56, srv1312594218=11, srv1821832377=44, srv1346141305=15, srv1686598985=30, srv1961788750=53, srv477266940=77, srv1735614761=37, srv374364056=72, srv1561590027=24, srv1748456160=39, srv1711691732=34, srv2135599929=66, srv1252160850=10, srv1586897674=25, srv1442890905=20, srv2088880776=62, srv1721147137=35, srv300389714=70, srv2091989504=63, srv183578228=47, srv92048021=96, srv986663349=98, srv1845143767=48, srv1923350864=50, srv724758179=85, srv952562287=97, srv1973469375=55, srv302398251=71, srv1115700176=5, srv222209447=67, srv1428333954=19, srv1410228751=18, srv242219510=68, srv2074710601=60, srv484873888=78, srv192346964=51, srv2080978302=61, srv996152264=99, srv2106310686=65, srv397656773=74, srv278880732=69, srv106492844=2, srv1542169832=22, srv787208898=88, srv1766649394=42, srv1545784504=23, srv1092024068=3, srv1685174649=29, srv862973712=93, srv846337424=92, srv1706708659=33, srv2006411619=57, srv660616207=83, srv123318978=9, srv1743882021=38, srv1761396971=41, srv1058008709=1, srv1611750578=26, srv42429874=75, srv585605733=80, srv1012712061=0, srv1128046992=7, srv1631794841=27} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-25 14:53:25,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-25 14:53:25,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-25 14:53:25,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-25 14:53:25,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-25 14:53:25,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-25 14:53:25,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-25 14:53:25,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-25 14:53:25,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-25 14:53:25,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-25 14:53:25,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-25 14:53:25,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-25 14:53:25,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-25 14:53:25,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-25 14:53:25,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-25 14:53:25,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-25 14:53:25,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-25 14:53:25,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-25 14:53:25,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-25 14:53:25,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-25 14:53:25,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-25 14:53:25,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-25 14:53:25,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-25 14:53:25,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-25 14:53:25,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-25 14:53:25,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-25 14:53:25,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-25 14:53:25,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-25 14:53:25,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-25 14:53:25,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-25 14:53:25,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-25 14:53:25,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-25 14:53:25,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-25 14:53:25,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-25 14:53:25,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-25 14:53:25,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-25 14:53:25,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-25 14:53:25,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-25 14:53:25,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-25 14:53:25,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-25 14:53:25,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-25 14:53:25,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-25 14:53:25,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-25 14:53:25,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-25 14:53:25,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-25 14:53:25,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-25 14:53:25,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-25 14:53:25,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-25 14:53:25,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-25 14:53:25,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-25 14:53:25,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-25 14:53:25,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-25 14:53:25,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-25 14:53:25,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-25 14:53:25,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-25 14:53:25,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-25 14:53:25,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-25 14:53:25,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-25 14:53:25,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-25 14:53:25,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-25 14:53:25,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-25 14:53:25,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-25 14:53:25,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-25 14:53:25,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-25 14:53:25,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-25 14:53:25,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-25 14:53:25,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-25 14:53:25,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-25 14:53:25,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-25 14:53:25,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-25 14:53:25,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-25 14:53:25,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-25 14:53:25,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-25 14:53:25,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-25 14:53:25,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-25 14:53:25,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-25 14:53:25,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-25 14:53:25,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-25 14:53:25,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-25 14:53:25,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-25 14:53:25,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-25 14:53:25,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-25 14:53:25,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-25 14:53:25,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-25 14:53:25,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-25 14:53:25,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-25 14:53:25,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-25 14:53:25,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-25 14:53:25,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-25 14:53:25,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-25 14:53:25,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-25 14:53:25,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-25 14:53:25,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-25 14:53:25,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-25 14:53:25,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-25 14:53:25,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-25 14:53:25,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-25 14:53:25,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-25 14:53:25,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-25 14:53:25,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-25 14:53:25,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-25 14:53:25,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-25 14:53:25,581 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04179773623604706, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05667161792589783, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04179773623604706, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17208333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23775, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-25 14:53:25,581 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-25 14:53:25,582 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.1767830507772317, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04179773623604706, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05667161792589783, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04179773623604706, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17208333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23775, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-25 14:53:25,839 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 390 ms to try 5000 different iterations.  Found a solution that moves 2570 regions; Going from a computed imbalance of 0.1767830507772317 to a new imbalance of 0.01678414825269524. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02362360203037182); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03439063897898258, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.28555555555555556, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02362360203037182); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013583333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04741666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-25 14:53:25,851 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1115542577:71 , srv1561590027:75 , srv1702568053:76 , srv996152264:78 , srv1442890905:80 , srv1735614761:80 , srv2099297852:80 , srv846337424:80 , srv42429874:81 , srv123318978:82 , srv1312594218:82 , srv1828990937:82 , srv2074710601:82 , srv1012712061:83 , srv1128046992:83 , srv1346141305:83 , srv1761396971:83 , srv1766649394:83 , srv1823793955:83 , srv242219510:83 , srv484873888:83 , srv724758179:83 , srv84432486:83 , srv1701795271:84 , srv183578228:84 , srv1961788750:84 , srv2135599929:84 , srv302398251:84 , srv585605733:84 , srv92048021:84 , srv1322099845:85 , srv1403137531:85 , srv1509034888:85 , srv1706708659:85 , srv1748456160:85 , srv1821832377:85 , srv1977681413:85 , srv449116583:85 , srv644451375:85 , srv740293401:85 , srv844123109:85 , srv868306068:85 , srv1213108853:86 , srv1545784504:86 , srv1639204007:86 , srv1686598985:86 , srv1711691732:86 , srv1743882021:86 , srv1756890719:86 , srv1973469375:86 , srv2037617371:86 , srv278880732:86 , srv374364056:86 , srv395883313:86 , srv592131674:86 , srv697026306:86 , srv786461890:86 , srv787208898:86 , srv1092024068:87 , srv134398413:87 , srv1344713265:87 , srv1352026485:87 , srv1685174649:87 , srv1721147137:87 , srv1728088298:87 , srv1969704154:87 , srv2080978302:87 , srv2088880776:87 , srv2106310686:87 , srv222209447:87 , srv397656773:87 , srv477266940:87 , srv1124685875:88 , srv1252160850:88 , srv1631794841:88 , srv1845143767:88 , srv192346964:88 , srv2091989504:88 , srv862973712:88 , srv1058008709:89 , srv1410228751:89 , srv1923350864:89 , srv300389714:89 , srv660616207:89 , srv810817658:89 , srv888524850:89 , srv986663349:89 , srv1115700176:90 , srv1428333954:90 , srv1542169832:90 , srv1611750578:90 , srv1847305240:90 , srv547222999:90 , srv106492844:91 , srv1586897674:91 , srv2006411619:91 , srv2009889864:91 , srv1807777603:92 , srv952562287:92 , srv1951367358:523 }
2023-12-25 14:53:25,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-25 14:53:25,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1124685875=6, srv1403137531=17, srv697026306=84, srv1639204007=28, srv644451375=82, srv1823793955=45, srv1969704154=54, srv395883313=73, srv84432486=91, srv2009889864=58, srv1213108853=8, srv1352026485=16, srv2037617371=59, srv592131674=81, srv2099297852=64, srv868306068=94, srv1322099845=12, srv1344713265=14, srv1951367358=52, srv810817658=89, srv740293401=86, srv1756890719=40, srv1701795271=31, srv449116583=76, srv1807777603=43, srv1847305240=49, srv888524850=95, srv547222999=79, srv134398413=13, srv844123109=90, srv1509034888=21, srv1702568053=32, srv1115542577=4, srv1828990937=46, srv786461890=87, srv1728088298=36, srv1977681413=56, srv1312594218=11, srv1821832377=44, srv1346141305=15, srv1686598985=30, srv1961788750=53, srv477266940=77, srv1735614761=37, srv374364056=72, srv1561590027=24, srv1748456160=39, srv1711691732=34, srv2135599929=66, srv1252160850=10, srv1586897674=25, srv1442890905=20, srv2088880776=62, srv1721147137=35, srv300389714=70, srv2091989504=63, srv183578228=47, srv92048021=96, srv986663349=98, srv1845143767=48, srv1923350864=50, srv724758179=85, srv952562287=97, srv1973469375=55, srv302398251=71, srv1115700176=5, srv222209447=67, srv1428333954=19, srv1410228751=18, srv242219510=68, srv2074710601=60, srv484873888=78, srv192346964=51, srv2080978302=61, srv996152264=99, srv2106310686=65, srv397656773=74, srv278880732=69, srv106492844=2, srv1542169832=22, srv787208898=88, srv1766649394=42, srv1545784504=23, srv1092024068=3, srv1685174649=29, srv862973712=93, srv846337424=92, srv1706708659=33, srv2006411619=57, srv660616207=83, srv123318978=9, srv1743882021=38, srv1761396971=41, srv1058008709=1, srv1611750578=26, srv42429874=75, srv585605733=80, srv1012712061=0, srv1128046992=7, srv1631794841=27} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-25 14:53:25,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-25 14:53:25,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-25 14:53:25,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-25 14:53:25,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-25 14:53:25,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-25 14:53:25,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-25 14:53:25,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-25 14:53:25,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-25 14:53:25,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-25 14:53:25,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-25 14:53:25,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-25 14:53:25,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-25 14:53:25,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-25 14:53:25,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-25 14:53:25,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-25 14:53:25,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-25 14:53:25,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-25 14:53:25,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-25 14:53:25,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-25 14:53:25,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-25 14:53:25,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-25 14:53:25,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-25 14:53:25,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-25 14:53:25,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-25 14:53:25,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-25 14:53:25,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-25 14:53:25,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-25 14:53:25,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-25 14:53:25,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-25 14:53:25,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-25 14:53:25,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-25 14:53:25,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-25 14:53:25,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-25 14:53:25,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-25 14:53:25,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-25 14:53:25,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-25 14:53:25,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-25 14:53:25,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-25 14:53:25,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-25 14:53:25,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-25 14:53:25,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-25 14:53:25,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-25 14:53:25,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-25 14:53:25,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-25 14:53:25,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-25 14:53:25,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-25 14:53:25,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-25 14:53:25,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-25 14:53:25,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-25 14:53:25,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-25 14:53:25,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-25 14:53:25,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-25 14:53:25,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-25 14:53:25,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-25 14:53:25,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-25 14:53:25,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-25 14:53:25,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-25 14:53:25,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-25 14:53:25,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-25 14:53:25,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-25 14:53:25,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-25 14:53:25,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-25 14:53:25,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-25 14:53:25,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-25 14:53:25,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-25 14:53:25,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-25 14:53:25,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-25 14:53:25,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-25 14:53:25,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-25 14:53:25,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-25 14:53:25,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-25 14:53:25,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-25 14:53:25,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-25 14:53:25,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-25 14:53:25,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-25 14:53:25,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-25 14:53:25,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-25 14:53:25,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-25 14:53:25,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-25 14:53:25,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-25 14:53:25,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-25 14:53:25,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-25 14:53:25,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-25 14:53:25,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-25 14:53:25,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-25 14:53:25,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-25 14:53:25,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-25 14:53:25,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-25 14:53:25,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-25 14:53:25,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-25 14:53:25,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-25 14:53:25,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-25 14:53:25,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-25 14:53:25,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-25 14:53:25,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-25 14:53:25,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-25 14:53:25,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-25 14:53:25,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-25 14:53:25,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-25 14:53:25,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-25 14:53:25,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-25 14:53:26,009 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02362360203037182); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03439063897898258, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02362360203037182); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013583333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04741666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-25 14:53:26,010 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-25 14:53:26,010 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.016766152728069177, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02362360203037182); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03439063897898258, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02362360203037182); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013583333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04741666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-25 14:53:26,271 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 370 ms to try 5000 different iterations.  Found a solution that moves 1020 regions; Going from a computed imbalance of 0.016766152728069177 to a new imbalance of 0.0013984265034971428. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008355190191882916); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010139321285922914); MoveCostFunction : (multiplier=7.0, imbalance=0.11333333333333333, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.008355190191882916); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=9.166666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005333333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-25 14:53:26,273 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv106492844:82 , srv1213108853:82 , srv1977681413:82 , srv1124685875:83 , srv1442890905:83 , srv1639204007:83 , srv2009889864:83 , srv2099297852:83 , srv300389714:83 , srv449116583:83 , srv952562287:83 , srv1115700176:84 , srv134398413:84 , srv1344713265:84 , srv1428333954:84 , srv1542169832:84 , srv1756890719:84 , srv1807777603:84 , srv183578228:84 , srv1969704154:84 , srv2006411619:84 , srv222209447:84 , srv547222999:84 , srv660616207:84 , srv697026306:84 , srv740293401:84 , srv787208898:84 , srv844123109:84 , srv888524850:84 , srv996152264:84 , srv1012712061:85 , srv1252160850:85 , srv1352026485:85 , srv1410228751:85 , srv1561590027:85 , srv1586897674:85 , srv1685174649:85 , srv1711691732:85 , srv1735614761:85 , srv1845143767:85 , srv1847305240:85 , srv2088880776:85 , srv397656773:85 , srv585605733:85 , srv644451375:85 , srv810817658:85 , srv862973712:85 , srv1092024068:86 , srv1115542577:86 , srv1128046992:86 , srv1611750578:86 , srv1631794841:86 , srv1686598985:86 , srv1701795271:86 , srv1706708659:86 , srv1728088298:86 , srv1743882021:86 , srv1761396971:86 , srv1828990937:86 , srv1923350864:86 , srv1961788750:86 , srv1973469375:86 , srv2074710601:86 , srv2091989504:86 , srv2135599929:86 , srv278880732:86 , srv374364056:86 , srv395883313:86 , srv42429874:86 , srv484873888:86 , srv592131674:86 , srv786461890:86 , srv846337424:86 , srv868306068:86 , srv92048021:86 , srv986663349:86 , srv1058008709:87 , srv123318978:87 , srv1322099845:87 , srv1346141305:87 , srv1403137531:87 , srv1545784504:87 , srv1702568053:87 , srv1721147137:87 , srv1766649394:87 , srv1821832377:87 , srv192346964:87 , srv2106310686:87 , srv242219510:87 , srv302398251:87 , srv477266940:87 , srv724758179:87 , srv84432486:87 , srv1312594218:88 , srv1509034888:88 , srv1748456160:88 , srv1823793955:88 , srv2037617371:88 , srv2080978302:88 , srv1951367358:548 }
2023-12-25 14:53:26,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-25 14:53:26,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1124685875=6, srv1403137531=17, srv697026306=84, srv1639204007=28, srv644451375=82, srv1823793955=45, srv1969704154=54, srv395883313=73, srv84432486=91, srv2009889864=58, srv1213108853=8, srv1352026485=16, srv2037617371=59, srv592131674=81, srv2099297852=64, srv868306068=94, srv1322099845=12, srv1344713265=14, srv1951367358=52, srv810817658=89, srv740293401=86, srv1756890719=40, srv1701795271=31, srv449116583=76, srv1807777603=43, srv1847305240=49, srv888524850=95, srv547222999=79, srv134398413=13, srv844123109=90, srv1509034888=21, srv1702568053=32, srv1115542577=4, srv1828990937=46, srv786461890=87, srv1728088298=36, srv1977681413=56, srv1312594218=11, srv1821832377=44, srv1346141305=15, srv1686598985=30, srv1961788750=53, srv477266940=77, srv1735614761=37, srv374364056=72, srv1561590027=24, srv1748456160=39, srv1711691732=34, srv2135599929=66, srv1252160850=10, srv1586897674=25, srv1442890905=20, srv2088880776=62, srv1721147137=35, srv300389714=70, srv2091989504=63, srv183578228=47, srv92048021=96, srv986663349=98, srv1845143767=48, srv1923350864=50, srv724758179=85, srv952562287=97, srv1973469375=55, srv302398251=71, srv1115700176=5, srv222209447=67, srv1428333954=19, srv1410228751=18, srv242219510=68, srv2074710601=60, srv484873888=78, srv192346964=51, srv2080978302=61, srv996152264=99, srv2106310686=65, srv397656773=74, srv278880732=69, srv106492844=2, srv1542169832=22, srv787208898=88, srv1766649394=42, srv1545784504=23, srv1092024068=3, srv1685174649=29, srv862973712=93, srv846337424=92, srv1706708659=33, srv2006411619=57, srv660616207=83, srv123318978=9, srv1743882021=38, srv1761396971=41, srv1058008709=1, srv1611750578=26, srv42429874=75, srv585605733=80, srv1012712061=0, srv1128046992=7, srv1631794841=27} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-25 14:53:26,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-25 14:53:26,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-25 14:53:26,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-25 14:53:26,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-25 14:53:26,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-25 14:53:26,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-25 14:53:26,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-25 14:53:26,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-25 14:53:26,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-25 14:53:26,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-25 14:53:26,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-25 14:53:26,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-25 14:53:26,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-25 14:53:26,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-25 14:53:26,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-25 14:53:26,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-25 14:53:26,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-25 14:53:26,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-25 14:53:26,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-25 14:53:26,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-25 14:53:26,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-25 14:53:26,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-25 14:53:26,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-25 14:53:26,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-25 14:53:26,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-25 14:53:26,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-25 14:53:26,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-25 14:53:26,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-25 14:53:26,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-25 14:53:26,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-25 14:53:26,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-25 14:53:26,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-25 14:53:26,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-25 14:53:26,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-25 14:53:26,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-25 14:53:26,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-25 14:53:26,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-25 14:53:26,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-25 14:53:26,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-25 14:53:26,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-25 14:53:26,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-25 14:53:26,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-25 14:53:26,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-25 14:53:26,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-25 14:53:26,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-25 14:53:26,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-25 14:53:26,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-25 14:53:26,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-25 14:53:26,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-25 14:53:26,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-25 14:53:26,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-25 14:53:26,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-25 14:53:26,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-25 14:53:26,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-25 14:53:26,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-25 14:53:26,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-25 14:53:26,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-25 14:53:26,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-25 14:53:26,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-25 14:53:26,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-25 14:53:26,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-25 14:53:26,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-25 14:53:26,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-25 14:53:26,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-25 14:53:26,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-25 14:53:26,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-25 14:53:26,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-25 14:53:26,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-25 14:53:26,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-25 14:53:26,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-25 14:53:26,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-25 14:53:26,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-25 14:53:26,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-25 14:53:26,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-25 14:53:26,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-25 14:53:26,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-25 14:53:26,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-25 14:53:26,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-25 14:53:26,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-25 14:53:26,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-25 14:53:26,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-25 14:53:26,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-25 14:53:26,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-25 14:53:26,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-25 14:53:26,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-25 14:53:26,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-25 14:53:26,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-25 14:53:26,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-25 14:53:26,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-25 14:53:26,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-25 14:53:26,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-25 14:53:26,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-25 14:53:26,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-25 14:53:26,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-25 14:53:26,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-25 14:53:26,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-25 14:53:26,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-25 14:53:26,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-25 14:53:26,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-25 14:53:26,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-25 14:53:26,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-25 14:53:26,418 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008355190191882916); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010139321285922914); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.008355190191882916); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=9.166666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005333333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-25 14:53:26,419 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-25 14:53:26,419 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.0013912843108439983, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008355190191882916); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010139321285922914); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.008355190191882916); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=9.166666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005333333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-25 14:53:26,773 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 468 ms to try 5000 different iterations.  Found a solution that moves 337 regions; Going from a computed imbalance of 0.0013912843108439983 to a new imbalance of 5.2151354834459486E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.694119368783758E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002118805753879094); MoveCostFunction : (multiplier=7.0, imbalance=0.03744444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.694119368783758E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=4.166666666666667E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-25 14:53:26,773 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv2037617371:82 , srv106492844:83 , srv1428333954:83 , srv1702568053:83 , srv787208898:83 , srv1058008709:84 , srv1115542577:84 , srv1346141305:84 , srv1352026485:84 , srv1410228751:84 , srv1509034888:84 , srv1542169832:84 , srv1586897674:84 , srv1631794841:84 , srv1721147137:84 , srv1728088298:84 , srv1761396971:84 , srv1823793955:84 , srv1845143767:84 , srv1847305240:84 , srv192346964:84 , srv1961788750:84 , srv1969704154:84 , srv1973469375:84 , srv2091989504:84 , srv2099297852:84 , srv242219510:84 , srv278880732:84 , srv302398251:84 , srv374364056:84 , srv397656773:84 , srv42429874:84 , srv484873888:84 , srv547222999:84 , srv740293401:84 , srv846337424:84 , srv868306068:84 , srv986663349:84 , srv1012712061:85 , srv1092024068:85 , srv1115700176:85 , srv1213108853:85 , srv123318978:85 , srv1312594218:85 , srv1322099845:85 , srv134398413:85 , srv1403137531:85 , srv1545784504:85 , srv1561590027:85 , srv1611750578:85 , srv1685174649:85 , srv1686598985:85 , srv1701795271:85 , srv1711691732:85 , srv1743882021:85 , srv1748456160:85 , srv1766649394:85 , srv1807777603:85 , srv1821832377:85 , srv1828990937:85 , srv1923350864:85 , srv1977681413:85 , srv2006411619:85 , srv2009889864:85 , srv2080978302:85 , srv2088880776:85 , srv2106310686:85 , srv2135599929:85 , srv300389714:85 , srv477266940:85 , srv585605733:85 , srv592131674:85 , srv644451375:85 , srv697026306:85 , srv724758179:85 , srv786461890:85 , srv844123109:85 , srv84432486:85 , srv862973712:85 , srv888524850:85 , srv996152264:85 , srv1124685875:86 , srv1128046992:86 , srv1252160850:86 , srv1344713265:86 , srv1442890905:86 , srv1706708659:86 , srv1735614761:86 , srv1756890719:86 , srv183578228:86 , srv2074710601:86 , srv222209447:86 , srv395883313:86 , srv449116583:86 , srv660616207:86 , srv810817658:86 , srv92048021:86 , srv952562287:86 , srv1639204007:87 , srv1951367358:610 }
2023-12-25 14:53:26,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-25 14:53:26,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1124685875=6, srv1403137531=17, srv697026306=84, srv1639204007=28, srv644451375=82, srv1823793955=45, srv1969704154=54, srv395883313=73, srv84432486=91, srv2009889864=58, srv1213108853=8, srv1352026485=16, srv2037617371=59, srv592131674=81, srv2099297852=64, srv868306068=94, srv1322099845=12, srv1344713265=14, srv1951367358=52, srv810817658=89, srv740293401=86, srv1756890719=40, srv1701795271=31, srv449116583=76, srv1807777603=43, srv1847305240=49, srv888524850=95, srv547222999=79, srv134398413=13, srv844123109=90, srv1509034888=21, srv1702568053=32, srv1115542577=4, srv1828990937=46, srv786461890=87, srv1728088298=36, srv1977681413=56, srv1312594218=11, srv1821832377=44, srv1346141305=15, srv1686598985=30, srv1961788750=53, srv477266940=77, srv1735614761=37, srv374364056=72, srv1561590027=24, srv1748456160=39, srv1711691732=34, srv2135599929=66, srv1252160850=10, srv1586897674=25, srv1442890905=20, srv2088880776=62, srv1721147137=35, srv300389714=70, srv2091989504=63, srv183578228=47, srv92048021=96, srv986663349=98, srv1845143767=48, srv1923350864=50, srv724758179=85, srv952562287=97, srv1973469375=55, srv302398251=71, srv1115700176=5, srv222209447=67, srv1428333954=19, srv1410228751=18, srv242219510=68, srv2074710601=60, srv484873888=78, srv192346964=51, srv2080978302=61, srv996152264=99, srv2106310686=65, srv397656773=74, srv278880732=69, srv106492844=2, srv1542169832=22, srv787208898=88, srv1766649394=42, srv1545784504=23, srv1092024068=3, srv1685174649=29, srv862973712=93, srv846337424=92, srv1706708659=33, srv2006411619=57, srv660616207=83, srv123318978=9, srv1743882021=38, srv1761396971=41, srv1058008709=1, srv1611750578=26, srv42429874=75, srv585605733=80, srv1012712061=0, srv1128046992=7, srv1631794841=27} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-25 14:53:26,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-25 14:53:26,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-25 14:53:26,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-25 14:53:26,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-25 14:53:26,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-25 14:53:26,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-25 14:53:26,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-25 14:53:26,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-25 14:53:26,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-25 14:53:26,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-25 14:53:26,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-25 14:53:26,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-25 14:53:26,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-25 14:53:26,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-25 14:53:26,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-25 14:53:26,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-25 14:53:26,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-25 14:53:26,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-25 14:53:26,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-25 14:53:26,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-25 14:53:26,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-25 14:53:26,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-25 14:53:26,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-25 14:53:26,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-25 14:53:26,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-25 14:53:26,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-25 14:53:26,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-25 14:53:26,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-25 14:53:26,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-25 14:53:26,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-25 14:53:26,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-25 14:53:26,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-25 14:53:26,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-25 14:53:26,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-25 14:53:26,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-25 14:53:26,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-25 14:53:26,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-25 14:53:26,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-25 14:53:26,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-25 14:53:26,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-25 14:53:26,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-25 14:53:26,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-25 14:53:26,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-25 14:53:26,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-25 14:53:26,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-25 14:53:26,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-25 14:53:26,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-25 14:53:26,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-25 14:53:26,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-25 14:53:26,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-25 14:53:26,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-25 14:53:26,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-25 14:53:26,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-25 14:53:26,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-25 14:53:26,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-25 14:53:26,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-25 14:53:26,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-25 14:53:26,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-25 14:53:26,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-25 14:53:26,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-25 14:53:26,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-25 14:53:26,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-25 14:53:26,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-25 14:53:26,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-25 14:53:26,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-25 14:53:26,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-25 14:53:26,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-25 14:53:26,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-25 14:53:26,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-25 14:53:26,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-25 14:53:26,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-25 14:53:26,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-25 14:53:26,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-25 14:53:26,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-25 14:53:26,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-25 14:53:26,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-25 14:53:26,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-25 14:53:26,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-25 14:53:26,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-25 14:53:26,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-25 14:53:26,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-25 14:53:26,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-25 14:53:26,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-25 14:53:26,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-25 14:53:26,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-25 14:53:26,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-25 14:53:26,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-25 14:53:26,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-25 14:53:26,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-25 14:53:26,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-25 14:53:26,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-25 14:53:26,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-25 14:53:26,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-25 14:53:26,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-25 14:53:26,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-25 14:53:26,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-25 14:53:26,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-25 14:53:26,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-25 14:53:26,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-25 14:53:26,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-25 14:53:26,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-25 14:53:26,918 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.694119368783758E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002118805753879094); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.694119368783758E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=4.166666666666667E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-25 14:53:26,919 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-25 14:53:26,919 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=4.9791630399057816E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.694119368783758E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002118805753879094); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.694119368783758E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=4.166666666666667E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-25 14:53:27,162 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 356 ms to try 5000 different iterations.  Found a solution that moves 40 regions; Going from a computed imbalance of 4.9791630399057816E-5 to a new imbalance of 7.353325282727271E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0044444444444444444); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-25 14:53:27,163 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1252160850:83 , srv1312594218:83 , srv1344713265:83 , srv1509034888:83 , srv1639204007:83 , srv1686598985:83 , srv1748456160:83 , srv1961788750:83 , srv2080978302:83 , srv477266940:83 , srv660616207:83 , srv724758179:83 , srv810817658:83 , srv1012712061:84 , srv1058008709:84 , srv106492844:84 , srv1092024068:84 , srv1115700176:84 , srv1124685875:84 , srv1128046992:84 , srv1213108853:84 , srv123318978:84 , srv1322099845:84 , srv134398413:84 , srv1346141305:84 , srv1403137531:84 , srv1428333954:84 , srv1442890905:84 , srv1542169832:84 , srv1545784504:84 , srv1586897674:84 , srv1611750578:84 , srv1631794841:84 , srv1685174649:84 , srv1701795271:84 , srv1706708659:84 , srv1711691732:84 , srv1721147137:84 , srv1735614761:84 , srv1743882021:84 , srv1756890719:84 , srv1761396971:84 , srv1766649394:84 , srv1807777603:84 , srv1821832377:84 , srv1823793955:84 , srv1828990937:84 , srv183578228:84 , srv1845143767:84 , srv1847305240:84 , srv1923350864:84 , srv192346964:84 , srv1969704154:84 , srv1973469375:84 , srv1977681413:84 , srv2006411619:84 , srv2009889864:84 , srv2037617371:84 , srv2074710601:84 , srv2088880776:84 , srv2091989504:84 , srv2099297852:84 , srv2106310686:84 , srv2135599929:84 , srv222209447:84 , srv278880732:84 , srv300389714:84 , srv395883313:84 , srv397656773:84 , srv449116583:84 , srv484873888:84 , srv547222999:84 , srv585605733:84 , srv592131674:84 , srv697026306:84 , srv740293401:84 , srv786461890:84 , srv844123109:84 , srv84432486:84 , srv846337424:84 , srv862973712:84 , srv868306068:84 , srv888524850:84 , srv92048021:84 , srv952562287:84 , srv986663349:84 , srv1115542577:85 , srv1352026485:85 , srv1410228751:85 , srv1561590027:85 , srv1702568053:85 , srv1728088298:85 , srv242219510:85 , srv302398251:85 , srv374364056:85 , srv42429874:85 , srv644451375:85 , srv787208898:85 , srv996152264:85 , srv1951367358:684 }
2023-12-25 14:53:27,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-25 14:53:27,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1124685875=6, srv1403137531=17, srv697026306=84, srv1639204007=28, srv644451375=82, srv1823793955=45, srv1969704154=54, srv395883313=73, srv84432486=91, srv2009889864=58, srv1213108853=8, srv1352026485=16, srv2037617371=59, srv592131674=81, srv2099297852=64, srv868306068=94, srv1322099845=12, srv1344713265=14, srv1951367358=52, srv810817658=89, srv740293401=86, srv1756890719=40, srv1701795271=31, srv449116583=76, srv1807777603=43, srv1847305240=49, srv888524850=95, srv547222999=79, srv134398413=13, srv844123109=90, srv1509034888=21, srv1702568053=32, srv1115542577=4, srv1828990937=46, srv786461890=87, srv1728088298=36, srv1977681413=56, srv1312594218=11, srv1821832377=44, srv1346141305=15, srv1686598985=30, srv1961788750=53, srv477266940=77, srv1735614761=37, srv374364056=72, srv1561590027=24, srv1748456160=39, srv1711691732=34, srv2135599929=66, srv1252160850=10, srv1586897674=25, srv1442890905=20, srv2088880776=62, srv1721147137=35, srv300389714=70, srv2091989504=63, srv183578228=47, srv92048021=96, srv986663349=98, srv1845143767=48, srv1923350864=50, srv724758179=85, srv952562287=97, srv1973469375=55, srv302398251=71, srv1115700176=5, srv222209447=67, srv1428333954=19, srv1410228751=18, srv242219510=68, srv2074710601=60, srv484873888=78, srv192346964=51, srv2080978302=61, srv996152264=99, srv2106310686=65, srv397656773=74, srv278880732=69, srv106492844=2, srv1542169832=22, srv787208898=88, srv1766649394=42, srv1545784504=23, srv1092024068=3, srv1685174649=29, srv862973712=93, srv846337424=92, srv1706708659=33, srv2006411619=57, srv660616207=83, srv123318978=9, srv1743882021=38, srv1761396971=41, srv1058008709=1, srv1611750578=26, srv42429874=75, srv585605733=80, srv1012712061=0, srv1128046992=7, srv1631794841=27} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-25 14:53:27,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-25 14:53:27,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-25 14:53:27,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-25 14:53:27,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-25 14:53:27,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-25 14:53:27,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-25 14:53:27,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-25 14:53:27,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-25 14:53:27,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-25 14:53:27,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-25 14:53:27,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-25 14:53:27,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-25 14:53:27,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-25 14:53:27,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-25 14:53:27,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-25 14:53:27,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-25 14:53:27,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-25 14:53:27,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-25 14:53:27,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-25 14:53:27,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-25 14:53:27,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-25 14:53:27,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-25 14:53:27,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-25 14:53:27,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-25 14:53:27,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-25 14:53:27,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-25 14:53:27,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-25 14:53:27,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-25 14:53:27,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-25 14:53:27,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-25 14:53:27,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-25 14:53:27,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-25 14:53:27,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-25 14:53:27,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-25 14:53:27,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-25 14:53:27,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-25 14:53:27,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-25 14:53:27,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-25 14:53:27,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-25 14:53:27,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-25 14:53:27,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-25 14:53:27,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-25 14:53:27,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-25 14:53:27,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-25 14:53:27,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-25 14:53:27,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-25 14:53:27,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-25 14:53:27,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-25 14:53:27,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-25 14:53:27,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-25 14:53:27,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-25 14:53:27,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-25 14:53:27,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-25 14:53:27,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-25 14:53:27,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-25 14:53:27,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-25 14:53:27,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-25 14:53:27,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-25 14:53:27,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-25 14:53:27,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-25 14:53:27,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-25 14:53:27,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-25 14:53:27,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-25 14:53:27,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-25 14:53:27,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-25 14:53:27,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-25 14:53:27,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-25 14:53:27,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-25 14:53:27,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-25 14:53:27,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-25 14:53:27,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-25 14:53:27,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-25 14:53:27,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-25 14:53:27,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-25 14:53:27,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-25 14:53:27,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-25 14:53:27,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-25 14:53:27,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-25 14:53:27,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-25 14:53:27,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-25 14:53:27,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-25 14:53:27,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-25 14:53:27,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-25 14:53:27,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-25 14:53:27,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-25 14:53:27,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-25 14:53:27,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-25 14:53:27,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-25 14:53:27,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-25 14:53:27,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-25 14:53:27,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-25 14:53:27,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-25 14:53:27,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-25 14:53:27,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-25 14:53:27,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-25 14:53:27,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-25 14:53:27,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-25 14:53:27,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-25 14:53:27,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-25 14:53:27,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-25 14:53:27,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-25 14:53:27,301 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.073239296329447E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-25 14:53:27,302 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1252160850:83 , srv1312594218:83 , srv1344713265:83 , srv1509034888:83 , srv1639204007:83 , srv1686598985:83 , srv1748456160:83 , srv1961788750:83 , srv2080978302:83 , srv477266940:83 , srv660616207:83 , srv724758179:83 , srv810817658:83 , srv1012712061:84 , srv1058008709:84 , srv106492844:84 , srv1092024068:84 , srv1115700176:84 , srv1124685875:84 , srv1128046992:84 , srv1213108853:84 , srv123318978:84 , srv1322099845:84 , srv134398413:84 , srv1346141305:84 , srv1403137531:84 , srv1428333954:84 , srv1442890905:84 , srv1542169832:84 , srv1545784504:84 , srv1586897674:84 , srv1611750578:84 , srv1631794841:84 , srv1685174649:84 , srv1701795271:84 , srv1706708659:84 , srv1711691732:84 , srv1721147137:84 , srv1735614761:84 , srv1743882021:84 , srv1756890719:84 , srv1761396971:84 , srv1766649394:84 , srv1807777603:84 , srv1821832377:84 , srv1823793955:84 , srv1828990937:84 , srv183578228:84 , srv1845143767:84 , srv1847305240:84 , srv1923350864:84 , srv192346964:84 , srv1969704154:84 , srv1973469375:84 , srv1977681413:84 , srv2006411619:84 , srv2009889864:84 , srv2037617371:84 , srv2074710601:84 , srv2088880776:84 , srv2091989504:84 , srv2099297852:84 , srv2106310686:84 , srv2135599929:84 , srv222209447:84 , srv278880732:84 , srv300389714:84 , srv395883313:84 , srv397656773:84 , srv449116583:84 , srv484873888:84 , srv547222999:84 , srv585605733:84 , srv592131674:84 , srv697026306:84 , srv740293401:84 , srv786461890:84 , srv844123109:84 , srv84432486:84 , srv846337424:84 , srv862973712:84 , srv868306068:84 , srv888524850:84 , srv92048021:84 , srv952562287:84 , srv986663349:84 , srv1115542577:85 , srv1352026485:85 , srv1410228751:85 , srv1561590027:85 , srv1702568053:85 , srv1728088298:85 , srv242219510:85 , srv302398251:85 , srv374364056:85 , srv42429874:85 , srv644451375:85 , srv787208898:85 , srv996152264:85 , srv1951367358:684 }
2023-12-25 14:53:27,326 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=390 (was 329) - SystemLoadAverage LEAK? -, ProcessCount=173 (was 176), AvailableMemoryMB=11018 (was 11608)
2023-12-25 14:53:27,333 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=390, ProcessCount=174, AvailableMemoryMB=11018
2023-12-25 14:53:27,334 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-12-25 14:53:27,334 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-12-25 14:53:27,346 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1125807180:84 , srv1133074206:84 , srv1163043642:84 , srv1268801272:84 , srv1288233846:84 , srv1308413955:84 , srv1317168513:84 , srv1363980518:84 , srv149012927:84 , srv1576310153:84 , srv159952242:84 , srv1605687424:84 , srv1651871064:84 , srv1762686958:84 , srv1976708297:84 , srv2026238831:84 , srv2046481975:84 , srv2088235602:84 , srv2122818073:84 , srv288636388:84 , srv298338244:84 , srv332944499:84 , srv401861701:84 , srv514549560:84 , srv615406638:84 , srv649925644:84 , srv750525886:84 , srv858283614:84 , srv968035310:84 , srv945469163:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-12-25 14:53:27,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-25 14:53:27,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2046481975=16, srv615406638=24, srv945469163=28, srv1133074206=1, srv1308413955=5, srv968035310=29, srv2026238831=15, srv401861701=22, srv1317168513=6, srv649925644=25, srv1605687424=11, srv1125807180=0, srv159952242=10, srv1976708297=14, srv298338244=20, srv332944499=21, srv514549560=23, srv288636388=19, srv2122818073=18, srv858283614=27, srv1288233846=4, srv149012927=8, srv1651871064=12, srv1576310153=9, srv1762686958=13, srv1268801272=3, srv1163043642=2, srv1363980518=7, srv2088235602=17, srv750525886=26} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-25 14:53:27,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-25 14:53:27,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-25 14:53:27,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-25 14:53:27,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-25 14:53:27,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-25 14:53:27,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-25 14:53:27,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-25 14:53:27,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-25 14:53:27,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-25 14:53:27,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-25 14:53:27,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-25 14:53:27,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-25 14:53:27,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-25 14:53:27,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-25 14:53:27,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-25 14:53:27,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-25 14:53:27,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-25 14:53:27,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-25 14:53:27,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-25 14:53:27,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-25 14:53:27,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-25 14:53:27,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-25 14:53:27,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-25 14:53:27,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-25 14:53:27,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-25 14:53:27,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-25 14:53:27,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-25 14:53:27,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-25 14:53:27,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-25 14:53:27,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-25 14:53:27,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-12-25 14:53:27,376 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0947814809881518, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-25 14:53:27,376 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912491696615975, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0947814809881518, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-12-25 14:55:27,362 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5994644 different iterations.  Found a solution that moves 1853 regions; Going from a computed imbalance of 0.9912491696615975 to a new imbalance of 4.324994439959734E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6862962962962963, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-25 14:55:27,370 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1125807180:90 , srv1133074206:90 , srv1163043642:90 , srv1268801272:90 , srv1288233846:90 , srv1308413955:90 , srv1317168513:90 , srv1363980518:90 , srv149012927:90 , srv1576310153:90 , srv159952242:90 , srv1605687424:90 , srv1651871064:90 , srv1762686958:90 , srv1976708297:90 , srv2026238831:90 , srv2046481975:90 , srv2088235602:90 , srv2122818073:90 , srv288636388:90 , srv298338244:90 , srv332944499:90 , srv401861701:90 , srv514549560:90 , srv615406638:90 , srv649925644:90 , srv750525886:90 , srv858283614:90 , srv945469163:90 , srv968035310:90 }
2023-12-25 14:55:27,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-25 14:55:27,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2046481975=16, srv615406638=24, srv945469163=28, srv1133074206=1, srv1308413955=5, srv968035310=29, srv2026238831=15, srv401861701=22, srv1317168513=6, srv649925644=25, srv1605687424=11, srv1125807180=0, srv159952242=10, srv1976708297=14, srv298338244=20, srv332944499=21, srv514549560=23, srv288636388=19, srv2122818073=18, srv858283614=27, srv1288233846=4, srv149012927=8, srv1651871064=12, srv1576310153=9, srv1762686958=13, srv1268801272=3, srv1163043642=2, srv1363980518=7, srv2088235602=17, srv750525886=26} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-25 14:55:27,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-25 14:55:27,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-25 14:55:27,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-25 14:55:27,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-25 14:55:27,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-25 14:55:27,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-25 14:55:27,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-25 14:55:27,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-25 14:55:27,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-25 14:55:27,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-25 14:55:27,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-25 14:55:27,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-25 14:55:27,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-25 14:55:27,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-25 14:55:27,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-25 14:55:27,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-25 14:55:27,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-25 14:55:27,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-25 14:55:27,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-25 14:55:27,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-25 14:55:27,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-25 14:55:27,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-25 14:55:27,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-25 14:55:27,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-25 14:55:27,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-25 14:55:27,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-25 14:55:27,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-25 14:55:27,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-25 14:55:27,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-25 14:55:27,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-25 14:55:27,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-12-25 14:55:27,395 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-25 14:55:27,395 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1125807180:90 , srv1133074206:90 , srv1163043642:90 , srv1268801272:90 , srv1288233846:90 , srv1308413955:90 , srv1317168513:90 , srv1363980518:90 , srv149012927:90 , srv1576310153:90 , srv159952242:90 , srv1605687424:90 , srv1651871064:90 , srv1762686958:90 , srv1976708297:90 , srv2026238831:90 , srv2046481975:90 , srv2088235602:90 , srv2122818073:90 , srv288636388:90 , srv298338244:90 , srv332944499:90 , srv401861701:90 , srv514549560:90 , srv615406638:90 , srv649925644:90 , srv750525886:90 , srv858283614:90 , srv945469163:90 , srv968035310:90 }
2023-12-25 14:55:27,411 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=248 (was 390), ProcessCount=175 (was 174) - ProcessCount LEAK? -, AvailableMemoryMB=10646 (was 11018)