2024-04-21 12:53:34,327 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2024-04-21 12:53:34,641 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2024-04-21 12:53:34,756 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2024-04-21 12:53:34,816 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-04-21 12:53:34,824 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-04-21 12:53:34,839 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=289, MaxFileDescriptor=60000, SystemLoadAverage=297, ProcessCount=170, AvailableMemoryMB=7699
2024-04-21 12:53:34,841 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-04-21 12:53:34,841 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-04-21 12:53:34,975 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv100333911:84 , srv1017997641:84 , srv1052775551:84 , srv1082942642:84 , srv1108497942:84 , srv1129691132:84 , srv1158577463:84 , srv1198815983:84 , srv1221754877:84 , srv122714139:84 , srv1229489051:84 , srv1241056453:84 , srv1256042274:84 , srv1277217136:84 , srv1342985683:84 , srv1352512516:84 , srv1355187816:84 , srv1374499075:84 , srv1414387688:84 , srv1445156515:84 , srv1450794586:84 , srv1467505087:84 , srv147428933:84 , srv1488332470:84 , srv1496186708:84 , srv151658331:84 , srv1523751884:84 , srv1574729808:84 , srv1694178787:84 , srv1706458119:84 , srv1714928948:84 , srv1738188989:84 , srv1748555488:84 , srv1802331491:84 , srv182795437:84 , srv1857119079:84 , srv1862965203:84 , srv186658604:84 , srv1876407462:84 , srv1910563025:84 , srv1921542853:84 , srv1924911667:84 , srv1940297223:84 , srv1961227550:84 , srv1977418287:84 , srv2004943756:84 , srv2011163523:84 , srv2034898274:84 , srv2060957646:84 , srv2108476013:84 , srv2115923998:84 , srv212741930:84 , srv212847868:84 , srv214706315:84 , srv230200499:84 , srv233082396:84 , srv239137015:84 , srv243448036:84 , srv260517597:84 , srv269825303:84 , srv274772634:84 , srv277443826:84 , srv284864885:84 , srv28703826:84 , srv322410182:84 , srv348007800:84 , srv37206681:84 , srv391002211:84 , srv441470780:84 , srv444925593:84 , srv457200299:84 , srv4636076:84 , srv491303186:84 , srv496476213:84 , srv51742292:84 , srv521173175:84 , srv527890381:84 , srv574975051:84 , srv585981175:84 , srv591253928:84 , srv620848169:84 , srv667860538:84 , srv679478512:84 , srv710902008:84 , srv733873280:84 , srv748104038:84 , srv816676725:84 , srv820891309:84 , srv841080980:84 , srv853605779:84 , srv874555299:84 , srv878243376:84 , srv888464926:84 , srv894352334:84 , srv904059624:84 , srv943345322:84 , srv954914260:84 , srv958724914:84 , srv999276486:84 , srv706375859:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2024-04-21 12:53:34,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-21 12:53:34,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1445156515=19, srv1876407462=38, srv1129691132=5, srv233082396=55, srv37206681=66, srv679478512=82, srv733873280=85, srv441470780=68, srv2034898274=47, srv284864885=62, srv591253928=79, srv1694178787=28, srv243448036=57, srv1221754877=8, srv1862965203=36, srv958724914=98, srv1198815983=7, srv1414387688=18, srv1467505087=21, srv710902008=84, srv853605779=90, srv1229489051=10, srv1496186708=24, srv1857119079=35, srv51742292=74, srv2011163523=46, srv1802331491=33, srv1714928948=30, srv1355187816=16, srv1738188989=31, srv274772634=60, srv874555299=91, srv1574729808=27, srv1523751884=26, srv182795437=34, srv1108497942=4, srv239137015=56, srv100333911=0, srv1342985683=14, srv1706458119=29, srv904059624=95, srv391002211=67, srv820891309=88, srv1277217136=13, srv1961227550=43, srv954914260=97, srv277443826=61, srv1374499075=17, srv1256042274=12, srv748104038=86, srv527890381=76, srv2115923998=50, srv322410182=64, srv521173175=75, srv28703826=63, srv457200299=70, srv1352512516=15, srv2108476013=49, srv1052775551=2, srv1082942642=3, srv147428933=22, srv1158577463=6, srv4636076=71, srv348007800=65, srv1924911667=41, srv894352334=94, srv212847868=52, srv260517597=58, srv214706315=53, srv496476213=73, srv269825303=59, srv491303186=72, srv706375859=83, srv1488332470=23, srv1977418287=44, srv878243376=92, srv667860538=81, srv186658604=37, srv1910563025=39, srv620848169=80, srv888464926=93, srv1748555488=32, srv999276486=99, srv1940297223=42, srv2004943756=45, srv1450794586=20, srv212741930=51, srv574975051=77, srv122714139=9, srv230200499=54, srv816676725=87, srv2060957646=48, srv1017997641=1, srv943345322=96, srv444925593=69, srv151658331=25, srv841080980=89, srv585981175=78, srv1241056453=11, srv1921542853=40} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-21 12:53:35,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-21 12:53:35,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-21 12:53:35,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-21 12:53:35,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-21 12:53:35,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-21 12:53:35,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-21 12:53:35,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-21 12:53:35,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-21 12:53:35,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-21 12:53:35,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-21 12:53:35,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-21 12:53:35,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-21 12:53:35,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-21 12:53:35,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-21 12:53:35,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-21 12:53:35,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-21 12:53:35,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-21 12:53:35,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-21 12:53:35,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-21 12:53:35,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-21 12:53:35,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-21 12:53:35,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-21 12:53:35,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-21 12:53:35,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-21 12:53:35,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-21 12:53:35,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-21 12:53:35,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-21 12:53:35,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-21 12:53:35,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-21 12:53:35,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-21 12:53:35,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-21 12:53:35,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-21 12:53:35,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-21 12:53:35,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-21 12:53:35,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-21 12:53:35,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-21 12:53:35,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-21 12:53:35,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-21 12:53:35,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-21 12:53:35,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-21 12:53:35,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-21 12:53:35,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-21 12:53:35,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-21 12:53:35,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-21 12:53:35,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-21 12:53:35,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-21 12:53:35,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-21 12:53:35,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-21 12:53:35,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-21 12:53:35,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-21 12:53:35,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-21 12:53:35,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-21 12:53:35,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-21 12:53:35,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-21 12:53:35,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-21 12:53:35,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-21 12:53:35,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-21 12:53:35,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-21 12:53:35,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-21 12:53:35,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-21 12:53:35,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-21 12:53:35,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-21 12:53:35,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-21 12:53:35,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-21 12:53:35,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-21 12:53:35,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-21 12:53:35,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-21 12:53:35,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-21 12:53:35,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-21 12:53:35,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-21 12:53:35,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-21 12:53:35,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-21 12:53:35,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-21 12:53:35,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-21 12:53:35,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-21 12:53:35,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-21 12:53:35,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-21 12:53:35,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-21 12:53:35,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-21 12:53:35,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-21 12:53:35,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-21 12:53:35,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-21 12:53:35,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-21 12:53:35,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-21 12:53:35,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-21 12:53:35,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-21 12:53:35,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-21 12:53:35,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-21 12:53:35,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-21 12:53:35,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-21 12:53:35,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-21 12:53:35,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-21 12:53:35,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-21 12:53:35,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-21 12:53:35,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-21 12:53:35,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-21 12:53:35,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-21 12:53:35,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-21 12:53:35,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-21 12:53:35,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-21 12:53:35,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-21 12:53:35,239 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-21 12:53:35,239 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-04-21 12:53:35,240 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-04-21 12:53:35,614 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 513 ms to try 5000 different iterations.  Found a solution that moves 4659 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18058091447904623. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03826744121299005, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05357897974679128, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5176666666666667, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03826744121299005, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17633333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23741666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-21 12:53:35,630 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1129691132:82 , srv1714928948:82 , srv1445156515:83 , srv1467505087:83 , srv733873280:83 , srv954914260:83 , srv958724914:83 , srv1158577463:84 , srv1241056453:84 , srv1342985683:84 , srv1748555488:84 , srv2011163523:84 , srv2034898274:84 , srv2108476013:84 , srv2115923998:84 , srv585981175:84 , srv620848169:84 , srv748104038:84 , srv841080980:84 , srv1052775551:85 , srv1198815983:85 , srv1277217136:85 , srv1352512516:85 , srv1488332470:85 , srv1738188989:85 , srv1802331491:85 , srv182795437:85 , srv1876407462:85 , srv1910563025:85 , srv1921542853:85 , srv1961227550:85 , srv212847868:85 , srv214706315:85 , srv277443826:85 , srv322410182:85 , srv37206681:85 , srv457200299:85 , srv491303186:85 , srv521173175:85 , srv527890381:85 , srv667860538:85 , srv894352334:85 , srv1017997641:86 , srv1229489051:86 , srv1414387688:86 , srv1857119079:86 , srv1862965203:86 , srv1940297223:86 , srv2004943756:86 , srv230200499:86 , srv284864885:86 , srv391002211:86 , srv679478512:86 , srv710902008:86 , srv853605779:86 , srv888464926:86 , srv943345322:86 , srv999276486:86 , srv100333911:87 , srv1082942642:87 , srv1523751884:87 , srv1574729808:87 , srv186658604:87 , srv1924911667:87 , srv1977418287:87 , srv239137015:87 , srv274772634:87 , srv816676725:87 , srv878243376:87 , srv904059624:87 , srv243448036:88 , srv260517597:88 , srv269825303:88 , srv348007800:88 , srv441470780:88 , srv51742292:88 , srv1256042274:89 , srv1496186708:89 , srv151658331:89 , srv1706458119:89 , srv444925593:89 , srv4636076:89 , srv496476213:89 , srv574975051:89 , srv874555299:89 , srv122714139:90 , srv1355187816:90 , srv147428933:90 , srv1694178787:90 , srv591253928:90 , srv1374499075:91 , srv1450794586:91 , srv212741930:91 , srv28703826:91 , srv1221754877:92 , srv233082396:92 , srv2060957646:93 , srv1108497942:94 , srv820891309:94 , srv706375859:430 }
2024-04-21 12:53:35,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-21 12:53:35,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1445156515=19, srv1876407462=38, srv1129691132=5, srv233082396=55, srv37206681=66, srv679478512=82, srv733873280=85, srv441470780=68, srv2034898274=47, srv284864885=62, srv591253928=79, srv1694178787=28, srv243448036=57, srv1221754877=8, srv1862965203=36, srv958724914=98, srv1198815983=7, srv1414387688=18, srv1467505087=21, srv710902008=84, srv853605779=90, srv1229489051=10, srv1496186708=24, srv1857119079=35, srv51742292=74, srv2011163523=46, srv1802331491=33, srv1714928948=30, srv1355187816=16, srv1738188989=31, srv274772634=60, srv874555299=91, srv1574729808=27, srv1523751884=26, srv182795437=34, srv1108497942=4, srv239137015=56, srv100333911=0, srv1342985683=14, srv1706458119=29, srv904059624=95, srv391002211=67, srv820891309=88, srv1277217136=13, srv1961227550=43, srv954914260=97, srv277443826=61, srv1374499075=17, srv1256042274=12, srv748104038=86, srv527890381=76, srv2115923998=50, srv322410182=64, srv521173175=75, srv28703826=63, srv457200299=70, srv1352512516=15, srv2108476013=49, srv1052775551=2, srv1082942642=3, srv147428933=22, srv1158577463=6, srv4636076=71, srv348007800=65, srv1924911667=41, srv894352334=94, srv212847868=52, srv260517597=58, srv214706315=53, srv496476213=73, srv269825303=59, srv491303186=72, srv706375859=83, srv1488332470=23, srv1977418287=44, srv878243376=92, srv667860538=81, srv186658604=37, srv1910563025=39, srv620848169=80, srv888464926=93, srv1748555488=32, srv999276486=99, srv1940297223=42, srv2004943756=45, srv1450794586=20, srv212741930=51, srv574975051=77, srv122714139=9, srv230200499=54, srv816676725=87, srv2060957646=48, srv1017997641=1, srv943345322=96, srv444925593=69, srv151658331=25, srv841080980=89, srv585981175=78, srv1241056453=11, srv1921542853=40} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-21 12:53:35,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-21 12:53:35,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-21 12:53:35,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-21 12:53:35,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-21 12:53:35,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-21 12:53:35,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-21 12:53:35,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-21 12:53:35,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-21 12:53:35,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-21 12:53:35,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-21 12:53:35,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-21 12:53:35,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-21 12:53:35,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-21 12:53:35,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-21 12:53:35,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-21 12:53:35,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-21 12:53:35,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-21 12:53:35,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-21 12:53:35,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-21 12:53:35,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-21 12:53:35,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-21 12:53:35,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-21 12:53:35,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-21 12:53:35,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-21 12:53:35,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-21 12:53:35,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-21 12:53:35,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-21 12:53:35,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-21 12:53:35,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-21 12:53:35,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-21 12:53:35,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-21 12:53:35,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-21 12:53:35,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-21 12:53:35,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-21 12:53:35,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-21 12:53:35,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-21 12:53:35,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-21 12:53:35,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-21 12:53:35,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-21 12:53:35,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-21 12:53:35,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-21 12:53:35,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-21 12:53:35,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-21 12:53:35,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-21 12:53:35,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-21 12:53:35,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-21 12:53:35,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-21 12:53:35,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-21 12:53:35,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-21 12:53:35,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-21 12:53:35,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-21 12:53:35,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-21 12:53:35,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-21 12:53:35,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-21 12:53:35,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-21 12:53:35,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-21 12:53:35,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-21 12:53:35,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-21 12:53:35,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-21 12:53:35,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-21 12:53:35,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-21 12:53:35,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-21 12:53:35,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-21 12:53:35,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-21 12:53:35,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-21 12:53:35,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-21 12:53:35,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-21 12:53:35,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-21 12:53:35,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-21 12:53:35,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-21 12:53:35,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-21 12:53:35,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-21 12:53:35,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-21 12:53:35,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-21 12:53:35,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-21 12:53:35,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-21 12:53:35,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-21 12:53:35,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-21 12:53:35,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-21 12:53:35,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-21 12:53:35,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-21 12:53:35,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-21 12:53:35,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-21 12:53:35,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-21 12:53:35,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-21 12:53:35,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-21 12:53:35,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-21 12:53:35,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-21 12:53:35,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-21 12:53:35,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-21 12:53:35,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-21 12:53:35,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-21 12:53:35,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-21 12:53:35,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-21 12:53:35,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-21 12:53:35,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-21 12:53:35,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-21 12:53:35,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-21 12:53:35,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-21 12:53:35,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-21 12:53:35,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-21 12:53:35,802 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03826744121299005, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05357897974679128, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03826744121299005, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17633333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23741666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-21 12:53:35,802 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-04-21 12:53:35,802 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18054829146378054, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03826744121299005, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05357897974679128, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03826744121299005, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17633333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23741666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-04-21 12:53:36,082 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 393 ms to try 5000 different iterations.  Found a solution that moves 2616 regions; Going from a computed imbalance of 0.18054829146378054 to a new imbalance of 0.015187282092252612. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02309077063978689); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03680567467104796, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2906666666666667, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02309077063978689); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04541666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-21 12:53:36,094 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv820891309:78 , srv1108497942:79 , srv1221754877:79 , srv147428933:79 , srv1355187816:81 , srv1374499075:81 , srv1496186708:81 , srv1694178787:81 , srv574975051:81 , srv122714139:82 , srv1256042274:82 , srv2060957646:82 , srv212741930:82 , srv269825303:82 , srv233082396:83 , srv28703826:83 , srv444925593:83 , srv4636076:83 , srv496476213:83 , srv591253928:83 , srv874555299:83 , srv1352512516:84 , srv1450794586:84 , srv1523751884:84 , srv1706458119:84 , srv1924911667:84 , srv1940297223:84 , srv214706315:84 , srv239137015:84 , srv260517597:84 , srv277443826:84 , srv348007800:84 , srv441470780:84 , srv679478512:84 , srv1017997641:85 , srv1052775551:85 , srv1082942642:85 , srv1198815983:85 , srv1229489051:85 , srv1277217136:85 , srv1857119079:85 , srv2004943756:85 , srv37206681:85 , srv391002211:85 , srv491303186:85 , srv521173175:85 , srv816676725:85 , srv841080980:85 , srv888464926:85 , srv943345322:85 , srv100333911:86 , srv1241056453:86 , srv1488332470:86 , srv151658331:86 , srv1574729808:86 , srv1748555488:86 , srv1862965203:86 , srv186658604:86 , srv1876407462:86 , srv1961227550:86 , srv1977418287:86 , srv2034898274:86 , srv2108476013:86 , srv2115923998:86 , srv230200499:86 , srv243448036:86 , srv274772634:86 , srv51742292:86 , srv527890381:86 , srv894352334:86 , srv1342985683:87 , srv1802331491:87 , srv182795437:87 , srv2011163523:87 , srv284864885:87 , srv667860538:87 , srv853605779:87 , srv878243376:87 , srv904059624:87 , srv958724914:87 , srv999276486:87 , srv1129691132:88 , srv1738188989:88 , srv1910563025:88 , srv1921542853:88 , srv322410182:88 , srv457200299:88 , srv585981175:88 , srv620848169:88 , srv710902008:88 , srv733873280:89 , srv1714928948:90 , srv954914260:90 , srv1414387688:91 , srv212847868:91 , srv748104038:91 , srv1158577463:92 , srv1467505087:92 , srv1445156515:93 , srv706375859:549 }
2024-04-21 12:53:36,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-21 12:53:36,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1445156515=19, srv1876407462=38, srv1129691132=5, srv233082396=55, srv37206681=66, srv679478512=82, srv733873280=85, srv441470780=68, srv2034898274=47, srv284864885=62, srv591253928=79, srv1694178787=28, srv243448036=57, srv1221754877=8, srv1862965203=36, srv958724914=98, srv1198815983=7, srv1414387688=18, srv1467505087=21, srv710902008=84, srv853605779=90, srv1229489051=10, srv1496186708=24, srv1857119079=35, srv51742292=74, srv2011163523=46, srv1802331491=33, srv1714928948=30, srv1355187816=16, srv1738188989=31, srv274772634=60, srv874555299=91, srv1574729808=27, srv1523751884=26, srv182795437=34, srv1108497942=4, srv239137015=56, srv100333911=0, srv1342985683=14, srv1706458119=29, srv904059624=95, srv391002211=67, srv820891309=88, srv1277217136=13, srv1961227550=43, srv954914260=97, srv277443826=61, srv1374499075=17, srv1256042274=12, srv748104038=86, srv527890381=76, srv2115923998=50, srv322410182=64, srv521173175=75, srv28703826=63, srv457200299=70, srv1352512516=15, srv2108476013=49, srv1052775551=2, srv1082942642=3, srv147428933=22, srv1158577463=6, srv4636076=71, srv348007800=65, srv1924911667=41, srv894352334=94, srv212847868=52, srv260517597=58, srv214706315=53, srv496476213=73, srv269825303=59, srv491303186=72, srv706375859=83, srv1488332470=23, srv1977418287=44, srv878243376=92, srv667860538=81, srv186658604=37, srv1910563025=39, srv620848169=80, srv888464926=93, srv1748555488=32, srv999276486=99, srv1940297223=42, srv2004943756=45, srv1450794586=20, srv212741930=51, srv574975051=77, srv122714139=9, srv230200499=54, srv816676725=87, srv2060957646=48, srv1017997641=1, srv943345322=96, srv444925593=69, srv151658331=25, srv841080980=89, srv585981175=78, srv1241056453=11, srv1921542853=40} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-21 12:53:36,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-21 12:53:36,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-21 12:53:36,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-21 12:53:36,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-21 12:53:36,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-21 12:53:36,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-21 12:53:36,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-21 12:53:36,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-21 12:53:36,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-21 12:53:36,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-21 12:53:36,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-21 12:53:36,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-21 12:53:36,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-21 12:53:36,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-21 12:53:36,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-21 12:53:36,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-21 12:53:36,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-21 12:53:36,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-21 12:53:36,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-21 12:53:36,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-21 12:53:36,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-21 12:53:36,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-21 12:53:36,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-21 12:53:36,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-21 12:53:36,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-21 12:53:36,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-21 12:53:36,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-21 12:53:36,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-21 12:53:36,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-21 12:53:36,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-21 12:53:36,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-21 12:53:36,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-21 12:53:36,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-21 12:53:36,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-21 12:53:36,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-21 12:53:36,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-21 12:53:36,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-21 12:53:36,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-21 12:53:36,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-21 12:53:36,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-21 12:53:36,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-21 12:53:36,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-21 12:53:36,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-21 12:53:36,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-21 12:53:36,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-21 12:53:36,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-21 12:53:36,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-21 12:53:36,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-21 12:53:36,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-21 12:53:36,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-21 12:53:36,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-21 12:53:36,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-21 12:53:36,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-21 12:53:36,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-21 12:53:36,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-21 12:53:36,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-21 12:53:36,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-21 12:53:36,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-21 12:53:36,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-21 12:53:36,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-21 12:53:36,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-21 12:53:36,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-21 12:53:36,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-21 12:53:36,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-21 12:53:36,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-21 12:53:36,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-21 12:53:36,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-21 12:53:36,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-21 12:53:36,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-21 12:53:36,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-21 12:53:36,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-21 12:53:36,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-21 12:53:36,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-21 12:53:36,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-21 12:53:36,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-21 12:53:36,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-21 12:53:36,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-21 12:53:36,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-21 12:53:36,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-21 12:53:36,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-21 12:53:36,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-21 12:53:36,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-21 12:53:36,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-21 12:53:36,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-21 12:53:36,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-21 12:53:36,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-21 12:53:36,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-21 12:53:36,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-21 12:53:36,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-21 12:53:36,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-21 12:53:36,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-21 12:53:36,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-21 12:53:36,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-21 12:53:36,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-21 12:53:36,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-21 12:53:36,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-21 12:53:36,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-21 12:53:36,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-21 12:53:36,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-21 12:53:36,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-21 12:53:36,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-21 12:53:36,235 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02309077063978689); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03680567467104796, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02309077063978689); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04541666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-21 12:53:36,235 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-04-21 12:53:36,235 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.015168964468742194, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02309077063978689); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03680567467104796, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02309077063978689); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04541666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-04-21 12:53:36,690 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 557 ms to try 5000 different iterations.  Found a solution that moves 987 regions; Going from a computed imbalance of 0.015168964468742194 to a new imbalance of 5.733776095436664E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007670414998073679); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010968785422624831); MoveCostFunction : (multiplier=7.0, imbalance=0.10966666666666666, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007670414998073679); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0045); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-21 12:53:36,692 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1414387688:81 , srv1445156515:81 , srv212847868:81 , srv1158577463:82 , srv151658331:82 , srv2060957646:82 , srv748104038:82 , srv1450794586:83 , srv1467505087:83 , srv1910563025:83 , srv233082396:83 , srv28703826:83 , srv51742292:83 , srv878243376:83 , srv100333911:84 , srv1574729808:84 , srv1738188989:84 , srv1921542853:84 , srv1977418287:84 , srv212741930:84 , srv243448036:84 , srv260517597:84 , srv284864885:84 , srv322410182:84 , srv457200299:84 , srv4636076:84 , srv710902008:84 , srv904059624:84 , srv954914260:84 , srv1108497942:85 , srv1342985683:85 , srv1374499075:85 , srv1523751884:85 , srv1706458119:85 , srv1714928948:85 , srv182795437:85 , srv1862965203:85 , srv186658604:85 , srv230200499:85 , srv274772634:85 , srv441470780:85 , srv527890381:85 , srv585981175:85 , srv591253928:85 , srv816676725:85 , srv853605779:85 , srv999276486:85 , srv1017997641:86 , srv1082942642:86 , srv1221754877:86 , srv122714139:86 , srv1229489051:86 , srv1488332470:86 , srv1496186708:86 , srv1748555488:86 , srv1802331491:86 , srv1857119079:86 , srv1876407462:86 , srv1924911667:86 , srv1961227550:86 , srv2004943756:86 , srv348007800:86 , srv37206681:86 , srv391002211:86 , srv444925593:86 , srv620848169:86 , srv667860538:86 , srv733873280:86 , srv820891309:86 , srv874555299:86 , srv888464926:86 , srv894352334:86 , srv958724914:86 , srv1198815983:87 , srv1256042274:87 , srv1277217136:87 , srv1355187816:87 , srv1694178787:87 , srv1940297223:87 , srv2011163523:87 , srv2034898274:87 , srv2115923998:87 , srv214706315:87 , srv239137015:87 , srv269825303:87 , srv496476213:87 , srv521173175:87 , srv943345322:87 , srv1052775551:88 , srv1129691132:88 , srv1241056453:88 , srv1352512516:88 , srv147428933:88 , srv277443826:88 , srv491303186:88 , srv574975051:88 , srv679478512:88 , srv2108476013:89 , srv841080980:89 , srv706375859:547 }
2024-04-21 12:53:36,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-21 12:53:36,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1445156515=19, srv1876407462=38, srv1129691132=5, srv233082396=55, srv37206681=66, srv679478512=82, srv733873280=85, srv441470780=68, srv2034898274=47, srv284864885=62, srv591253928=79, srv1694178787=28, srv243448036=57, srv1221754877=8, srv1862965203=36, srv958724914=98, srv1198815983=7, srv1414387688=18, srv1467505087=21, srv710902008=84, srv853605779=90, srv1229489051=10, srv1496186708=24, srv1857119079=35, srv51742292=74, srv2011163523=46, srv1802331491=33, srv1714928948=30, srv1355187816=16, srv1738188989=31, srv274772634=60, srv874555299=91, srv1574729808=27, srv1523751884=26, srv182795437=34, srv1108497942=4, srv239137015=56, srv100333911=0, srv1342985683=14, srv1706458119=29, srv904059624=95, srv391002211=67, srv820891309=88, srv1277217136=13, srv1961227550=43, srv954914260=97, srv277443826=61, srv1374499075=17, srv1256042274=12, srv748104038=86, srv527890381=76, srv2115923998=50, srv322410182=64, srv521173175=75, srv28703826=63, srv457200299=70, srv1352512516=15, srv2108476013=49, srv1052775551=2, srv1082942642=3, srv147428933=22, srv1158577463=6, srv4636076=71, srv348007800=65, srv1924911667=41, srv894352334=94, srv212847868=52, srv260517597=58, srv214706315=53, srv496476213=73, srv269825303=59, srv491303186=72, srv706375859=83, srv1488332470=23, srv1977418287=44, srv878243376=92, srv667860538=81, srv186658604=37, srv1910563025=39, srv620848169=80, srv888464926=93, srv1748555488=32, srv999276486=99, srv1940297223=42, srv2004943756=45, srv1450794586=20, srv212741930=51, srv574975051=77, srv122714139=9, srv230200499=54, srv816676725=87, srv2060957646=48, srv1017997641=1, srv943345322=96, srv444925593=69, srv151658331=25, srv841080980=89, srv585981175=78, srv1241056453=11, srv1921542853=40} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-21 12:53:36,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-21 12:53:36,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-21 12:53:36,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-21 12:53:36,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-21 12:53:36,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-21 12:53:36,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-21 12:53:36,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-21 12:53:36,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-21 12:53:36,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-21 12:53:36,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-21 12:53:36,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-21 12:53:36,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-21 12:53:36,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-21 12:53:36,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-21 12:53:36,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-21 12:53:36,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-21 12:53:36,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-21 12:53:36,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-21 12:53:36,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-21 12:53:36,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-21 12:53:36,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-21 12:53:36,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-21 12:53:36,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-21 12:53:36,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-21 12:53:36,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-21 12:53:36,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-21 12:53:36,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-21 12:53:36,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-21 12:53:36,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-21 12:53:36,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-21 12:53:36,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-21 12:53:36,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-21 12:53:36,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-21 12:53:36,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-21 12:53:36,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-21 12:53:36,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-21 12:53:36,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-21 12:53:36,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-21 12:53:36,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-21 12:53:36,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-21 12:53:36,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-21 12:53:36,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-21 12:53:36,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-21 12:53:36,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-21 12:53:36,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-21 12:53:36,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-21 12:53:36,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-21 12:53:36,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-21 12:53:36,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-21 12:53:36,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-21 12:53:36,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-21 12:53:36,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-21 12:53:36,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-21 12:53:36,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-21 12:53:36,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-21 12:53:36,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-21 12:53:36,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-21 12:53:36,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-21 12:53:36,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-21 12:53:36,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-21 12:53:36,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-21 12:53:36,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-21 12:53:36,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-21 12:53:36,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-21 12:53:36,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-21 12:53:36,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-21 12:53:36,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-21 12:53:36,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-21 12:53:36,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-21 12:53:36,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-21 12:53:36,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-21 12:53:36,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-21 12:53:36,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-21 12:53:36,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-21 12:53:36,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-21 12:53:36,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-21 12:53:36,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-21 12:53:36,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-21 12:53:36,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-21 12:53:36,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-21 12:53:36,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-21 12:53:36,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-21 12:53:36,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-21 12:53:36,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-21 12:53:36,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-21 12:53:36,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-21 12:53:36,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-21 12:53:36,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-21 12:53:36,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-21 12:53:36,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-21 12:53:36,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-21 12:53:36,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-21 12:53:36,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-21 12:53:36,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-21 12:53:36,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-21 12:53:36,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-21 12:53:36,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-21 12:53:36,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-21 12:53:36,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-21 12:53:36,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-21 12:53:36,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-21 12:53:36,833 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007670414998073679); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010968785422624831); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007670414998073679); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0045); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-21 12:53:36,833 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-04-21 12:53:36,833 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=5.664664878293001E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007670414998073679); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010968785422624831); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007670414998073679); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0045); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-04-21 12:53:37,099 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 367 ms to try 5000 different iterations.  Found a solution that moves 307 regions; Going from a computed imbalance of 5.664664878293001E-4 to a new imbalance of 5.183369674431416E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.470732932414788E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002118805753879094); MoveCostFunction : (multiplier=7.0, imbalance=0.03411111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.470732932414788E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=4.166666666666667E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-21 12:53:37,101 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1082942642:83 , srv2108476013:83 , srv591253928:83 , srv999276486:83 , srv1052775551:84 , srv1108497942:84 , srv1158577463:84 , srv1198815983:84 , srv1241056453:84 , srv1256042274:84 , srv1355187816:84 , srv1450794586:84 , srv1467505087:84 , srv1694178787:84 , srv1802331491:84 , srv182795437:84 , srv1857119079:84 , srv1940297223:84 , srv2011163523:84 , srv2034898274:84 , srv230200499:84 , srv233082396:84 , srv239137015:84 , srv243448036:84 , srv269825303:84 , srv274772634:84 , srv348007800:84 , srv444925593:84 , srv491303186:84 , srv496476213:84 , srv620848169:84 , srv679478512:84 , srv710902008:84 , srv733873280:84 , srv820891309:84 , srv841080980:84 , srv853605779:84 , srv874555299:84 , srv888464926:84 , srv904059624:84 , srv943345322:84 , srv100333911:85 , srv1017997641:85 , srv1129691132:85 , srv1221754877:85 , srv122714139:85 , srv1229489051:85 , srv1277217136:85 , srv1352512516:85 , srv1374499075:85 , srv1414387688:85 , srv1445156515:85 , srv147428933:85 , srv1488332470:85 , srv1574729808:85 , srv1706458119:85 , srv1714928948:85 , srv1738188989:85 , srv186658604:85 , srv1876407462:85 , srv1910563025:85 , srv1921542853:85 , srv1924911667:85 , srv1961227550:85 , srv1977418287:85 , srv2004943756:85 , srv2060957646:85 , srv2115923998:85 , srv212741930:85 , srv212847868:85 , srv277443826:85 , srv28703826:85 , srv322410182:85 , srv391002211:85 , srv441470780:85 , srv457200299:85 , srv51742292:85 , srv521173175:85 , srv574975051:85 , srv585981175:85 , srv667860538:85 , srv748104038:85 , srv816676725:85 , srv878243376:85 , srv894352334:85 , srv954914260:85 , srv1342985683:86 , srv1496186708:86 , srv151658331:86 , srv1523751884:86 , srv1748555488:86 , srv1862965203:86 , srv260517597:86 , srv284864885:86 , srv37206681:86 , srv4636076:86 , srv527890381:86 , srv958724914:86 , srv214706315:87 , srv706375859:616 }
2024-04-21 12:53:37,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-21 12:53:37,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1445156515=19, srv1876407462=38, srv1129691132=5, srv233082396=55, srv37206681=66, srv679478512=82, srv733873280=85, srv441470780=68, srv2034898274=47, srv284864885=62, srv591253928=79, srv1694178787=28, srv243448036=57, srv1221754877=8, srv1862965203=36, srv958724914=98, srv1198815983=7, srv1414387688=18, srv1467505087=21, srv710902008=84, srv853605779=90, srv1229489051=10, srv1496186708=24, srv1857119079=35, srv51742292=74, srv2011163523=46, srv1802331491=33, srv1714928948=30, srv1355187816=16, srv1738188989=31, srv274772634=60, srv874555299=91, srv1574729808=27, srv1523751884=26, srv182795437=34, srv1108497942=4, srv239137015=56, srv100333911=0, srv1342985683=14, srv1706458119=29, srv904059624=95, srv391002211=67, srv820891309=88, srv1277217136=13, srv1961227550=43, srv954914260=97, srv277443826=61, srv1374499075=17, srv1256042274=12, srv748104038=86, srv527890381=76, srv2115923998=50, srv322410182=64, srv521173175=75, srv28703826=63, srv457200299=70, srv1352512516=15, srv2108476013=49, srv1052775551=2, srv1082942642=3, srv147428933=22, srv1158577463=6, srv4636076=71, srv348007800=65, srv1924911667=41, srv894352334=94, srv212847868=52, srv260517597=58, srv214706315=53, srv496476213=73, srv269825303=59, srv491303186=72, srv706375859=83, srv1488332470=23, srv1977418287=44, srv878243376=92, srv667860538=81, srv186658604=37, srv1910563025=39, srv620848169=80, srv888464926=93, srv1748555488=32, srv999276486=99, srv1940297223=42, srv2004943756=45, srv1450794586=20, srv212741930=51, srv574975051=77, srv122714139=9, srv230200499=54, srv816676725=87, srv2060957646=48, srv1017997641=1, srv943345322=96, srv444925593=69, srv151658331=25, srv841080980=89, srv585981175=78, srv1241056453=11, srv1921542853=40} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-21 12:53:37,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-21 12:53:37,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-21 12:53:37,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-21 12:53:37,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-21 12:53:37,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-21 12:53:37,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-21 12:53:37,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-21 12:53:37,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-21 12:53:37,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-21 12:53:37,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-21 12:53:37,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-21 12:53:37,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-21 12:53:37,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-21 12:53:37,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-21 12:53:37,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-21 12:53:37,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-21 12:53:37,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-21 12:53:37,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-21 12:53:37,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-21 12:53:37,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-21 12:53:37,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-21 12:53:37,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-21 12:53:37,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-21 12:53:37,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-21 12:53:37,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-21 12:53:37,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-21 12:53:37,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-21 12:53:37,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-21 12:53:37,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-21 12:53:37,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-21 12:53:37,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-21 12:53:37,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-21 12:53:37,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-21 12:53:37,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-21 12:53:37,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-21 12:53:37,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-21 12:53:37,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-21 12:53:37,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-21 12:53:37,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-21 12:53:37,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-21 12:53:37,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-21 12:53:37,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-21 12:53:37,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-21 12:53:37,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-21 12:53:37,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-21 12:53:37,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-21 12:53:37,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-21 12:53:37,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-21 12:53:37,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-21 12:53:37,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-21 12:53:37,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-21 12:53:37,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-21 12:53:37,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-21 12:53:37,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-21 12:53:37,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-21 12:53:37,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-21 12:53:37,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-21 12:53:37,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-21 12:53:37,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-21 12:53:37,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-21 12:53:37,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-21 12:53:37,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-21 12:53:37,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-21 12:53:37,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-21 12:53:37,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-21 12:53:37,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-21 12:53:37,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-21 12:53:37,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-21 12:53:37,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-21 12:53:37,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-21 12:53:37,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-21 12:53:37,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-21 12:53:37,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-21 12:53:37,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-21 12:53:37,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-21 12:53:37,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-21 12:53:37,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-21 12:53:37,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-21 12:53:37,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-21 12:53:37,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-21 12:53:37,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-21 12:53:37,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-21 12:53:37,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-21 12:53:37,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-21 12:53:37,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-21 12:53:37,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-21 12:53:37,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-21 12:53:37,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-21 12:53:37,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-21 12:53:37,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-21 12:53:37,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-21 12:53:37,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-21 12:53:37,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-21 12:53:37,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-21 12:53:37,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-21 12:53:37,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-21 12:53:37,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-21 12:53:37,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-21 12:53:37,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-21 12:53:37,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-21 12:53:37,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-21 12:53:37,269 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.470732932414788E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002118805753879094); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.470732932414788E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=4.166666666666667E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-21 12:53:37,269 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-04-21 12:53:37,270 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=4.9684036798710855E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.470732932414788E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002118805753879094); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.470732932414788E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=4.166666666666667E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-04-21 12:53:37,591 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 440 ms to try 5000 different iterations.  Found a solution that moves 33 regions; Going from a computed imbalance of 4.9684036798710855E-5 to a new imbalance of 8.761718501804472E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.0036666666666666666); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-21 12:53:37,591 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1129691132:83 , srv122714139:83 , srv1414387688:83 , srv151658331:83 , srv1706458119:83 , srv1862965203:83 , srv186658604:83 , srv214706315:83 , srv284864885:83 , srv496476213:83 , srv574975051:83 , srv667860538:83 , srv100333911:84 , srv1017997641:84 , srv1052775551:84 , srv1108497942:84 , srv1158577463:84 , srv1221754877:84 , srv1229489051:84 , srv1241056453:84 , srv1256042274:84 , srv1277217136:84 , srv1342985683:84 , srv1352512516:84 , srv1355187816:84 , srv1374499075:84 , srv1445156515:84 , srv1450794586:84 , srv1467505087:84 , srv147428933:84 , srv1488332470:84 , srv1496186708:84 , srv1523751884:84 , srv1574729808:84 , srv1694178787:84 , srv1714928948:84 , srv1738188989:84 , srv1748555488:84 , srv1802331491:84 , srv1876407462:84 , srv1921542853:84 , srv1924911667:84 , srv1961227550:84 , srv1977418287:84 , srv2004943756:84 , srv2011163523:84 , srv2060957646:84 , srv2108476013:84 , srv2115923998:84 , srv212741930:84 , srv212847868:84 , srv233082396:84 , srv239137015:84 , srv243448036:84 , srv260517597:84 , srv274772634:84 , srv277443826:84 , srv28703826:84 , srv322410182:84 , srv348007800:84 , srv37206681:84 , srv391002211:84 , srv441470780:84 , srv444925593:84 , srv457200299:84 , srv4636076:84 , srv491303186:84 , srv51742292:84 , srv521173175:84 , srv527890381:84 , srv585981175:84 , srv620848169:84 , srv679478512:84 , srv710902008:84 , srv733873280:84 , srv748104038:84 , srv816676725:84 , srv820891309:84 , srv841080980:84 , srv853605779:84 , srv874555299:84 , srv878243376:84 , srv894352334:84 , srv904059624:84 , srv943345322:84 , srv954914260:84 , srv958724914:84 , srv1082942642:85 , srv1198815983:85 , srv182795437:85 , srv1857119079:85 , srv1910563025:85 , srv1940297223:85 , srv2034898274:85 , srv230200499:85 , srv269825303:85 , srv591253928:85 , srv888464926:85 , srv999276486:85 , srv706375859:684 }
2024-04-21 12:53:37,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-21 12:53:37,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1445156515=19, srv1876407462=38, srv1129691132=5, srv233082396=55, srv37206681=66, srv679478512=82, srv733873280=85, srv441470780=68, srv2034898274=47, srv284864885=62, srv591253928=79, srv1694178787=28, srv243448036=57, srv1221754877=8, srv1862965203=36, srv958724914=98, srv1198815983=7, srv1414387688=18, srv1467505087=21, srv710902008=84, srv853605779=90, srv1229489051=10, srv1496186708=24, srv1857119079=35, srv51742292=74, srv2011163523=46, srv1802331491=33, srv1714928948=30, srv1355187816=16, srv1738188989=31, srv274772634=60, srv874555299=91, srv1574729808=27, srv1523751884=26, srv182795437=34, srv1108497942=4, srv239137015=56, srv100333911=0, srv1342985683=14, srv1706458119=29, srv904059624=95, srv391002211=67, srv820891309=88, srv1277217136=13, srv1961227550=43, srv954914260=97, srv277443826=61, srv1374499075=17, srv1256042274=12, srv748104038=86, srv527890381=76, srv2115923998=50, srv322410182=64, srv521173175=75, srv28703826=63, srv457200299=70, srv1352512516=15, srv2108476013=49, srv1052775551=2, srv1082942642=3, srv147428933=22, srv1158577463=6, srv4636076=71, srv348007800=65, srv1924911667=41, srv894352334=94, srv212847868=52, srv260517597=58, srv214706315=53, srv496476213=73, srv269825303=59, srv491303186=72, srv706375859=83, srv1488332470=23, srv1977418287=44, srv878243376=92, srv667860538=81, srv186658604=37, srv1910563025=39, srv620848169=80, srv888464926=93, srv1748555488=32, srv999276486=99, srv1940297223=42, srv2004943756=45, srv1450794586=20, srv212741930=51, srv574975051=77, srv122714139=9, srv230200499=54, srv816676725=87, srv2060957646=48, srv1017997641=1, srv943345322=96, srv444925593=69, srv151658331=25, srv841080980=89, srv585981175=78, srv1241056453=11, srv1921542853=40} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-21 12:53:37,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-21 12:53:37,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-21 12:53:37,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-21 12:53:37,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-21 12:53:37,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-21 12:53:37,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-21 12:53:37,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-21 12:53:37,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-21 12:53:37,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-21 12:53:37,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-21 12:53:37,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-21 12:53:37,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-21 12:53:37,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-21 12:53:37,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-21 12:53:37,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-21 12:53:37,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-21 12:53:37,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-21 12:53:37,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-21 12:53:37,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-21 12:53:37,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-21 12:53:37,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-21 12:53:37,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-21 12:53:37,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-21 12:53:37,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-21 12:53:37,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-21 12:53:37,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-21 12:53:37,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-21 12:53:37,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-21 12:53:37,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-21 12:53:37,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-21 12:53:37,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-21 12:53:37,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-21 12:53:37,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-21 12:53:37,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-21 12:53:37,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-21 12:53:37,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-21 12:53:37,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-21 12:53:37,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-21 12:53:37,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-21 12:53:37,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-21 12:53:37,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-21 12:53:37,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-21 12:53:37,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-21 12:53:37,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-21 12:53:37,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-21 12:53:37,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-21 12:53:37,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-21 12:53:37,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-21 12:53:37,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-21 12:53:37,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-21 12:53:37,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-21 12:53:37,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-21 12:53:37,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-21 12:53:37,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-21 12:53:37,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-21 12:53:37,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-21 12:53:37,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-21 12:53:37,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-21 12:53:37,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-21 12:53:37,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-21 12:53:37,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-21 12:53:37,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-21 12:53:37,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-21 12:53:37,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-21 12:53:37,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-21 12:53:37,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-21 12:53:37,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-21 12:53:37,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-21 12:53:37,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-21 12:53:37,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-21 12:53:37,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-21 12:53:37,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-21 12:53:37,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-21 12:53:37,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-21 12:53:37,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-21 12:53:37,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-21 12:53:37,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-21 12:53:37,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-21 12:53:37,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-21 12:53:37,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-21 12:53:37,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-21 12:53:37,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-21 12:53:37,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-21 12:53:37,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-21 12:53:37,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-21 12:53:37,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-21 12:53:37,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-21 12:53:37,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-21 12:53:37,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-21 12:53:37,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-21 12:53:37,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-21 12:53:37,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-21 12:53:37,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-21 12:53:37,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-21 12:53:37,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-21 12:53:37,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-21 12:53:37,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-21 12:53:37,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-21 12:53:37,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-21 12:53:37,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-21 12:53:37,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-21 12:53:37,755 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=8.530647563026267E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-21 12:53:37,755 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1129691132:83 , srv122714139:83 , srv1414387688:83 , srv151658331:83 , srv1706458119:83 , srv1862965203:83 , srv186658604:83 , srv214706315:83 , srv284864885:83 , srv496476213:83 , srv574975051:83 , srv667860538:83 , srv100333911:84 , srv1017997641:84 , srv1052775551:84 , srv1108497942:84 , srv1158577463:84 , srv1221754877:84 , srv1229489051:84 , srv1241056453:84 , srv1256042274:84 , srv1277217136:84 , srv1342985683:84 , srv1352512516:84 , srv1355187816:84 , srv1374499075:84 , srv1445156515:84 , srv1450794586:84 , srv1467505087:84 , srv147428933:84 , srv1488332470:84 , srv1496186708:84 , srv1523751884:84 , srv1574729808:84 , srv1694178787:84 , srv1714928948:84 , srv1738188989:84 , srv1748555488:84 , srv1802331491:84 , srv1876407462:84 , srv1921542853:84 , srv1924911667:84 , srv1961227550:84 , srv1977418287:84 , srv2004943756:84 , srv2011163523:84 , srv2060957646:84 , srv2108476013:84 , srv2115923998:84 , srv212741930:84 , srv212847868:84 , srv233082396:84 , srv239137015:84 , srv243448036:84 , srv260517597:84 , srv274772634:84 , srv277443826:84 , srv28703826:84 , srv322410182:84 , srv348007800:84 , srv37206681:84 , srv391002211:84 , srv441470780:84 , srv444925593:84 , srv457200299:84 , srv4636076:84 , srv491303186:84 , srv51742292:84 , srv521173175:84 , srv527890381:84 , srv585981175:84 , srv620848169:84 , srv679478512:84 , srv710902008:84 , srv733873280:84 , srv748104038:84 , srv816676725:84 , srv820891309:84 , srv841080980:84 , srv853605779:84 , srv874555299:84 , srv878243376:84 , srv894352334:84 , srv904059624:84 , srv943345322:84 , srv954914260:84 , srv958724914:84 , srv1082942642:85 , srv1198815983:85 , srv182795437:85 , srv1857119079:85 , srv1910563025:85 , srv1940297223:85 , srv2034898274:85 , srv230200499:85 , srv269825303:85 , srv591253928:85 , srv888464926:85 , srv999276486:85 , srv706375859:684 }
2024-04-21 12:53:37,786 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=289 (was 289), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=297 (was 297), ProcessCount=170 (was 170), AvailableMemoryMB=7136 (was 7699)
2024-04-21 12:53:37,795 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=289, MaxFileDescriptor=60000, SystemLoadAverage=297, ProcessCount=170, AvailableMemoryMB=7135
2024-04-21 12:53:37,796 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-04-21 12:53:37,796 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2024-04-21 12:53:37,807 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1040713552:84 , srv1126376914:84 , srv1140612215:84 , srv1293142067:84 , srv1320790061:84 , srv1402724662:84 , srv1407999072:84 , srv1432235994:84 , srv1600464861:84 , srv1638830448:84 , srv1723077704:84 , srv1756192069:84 , srv184173960:84 , srv1862000158:84 , srv1867249961:84 , srv1965130565:84 , srv198360794:84 , srv214379702:84 , srv237342296:84 , srv277096686:84 , srv298463943:84 , srv417989325:84 , srv630643818:84 , srv730364422:84 , srv766140811:84 , srv778425586:84 , srv851401145:84 , srv878509504:84 , srv96030226:84 , srv1616438623:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2024-04-21 12:53:37,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-21 12:53:37,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv851401145=27, srv184173960=13, srv298463943=21, srv1638830448=10, srv630643818=23, srv1756192069=12, srv1600464861=8, srv1402724662=5, srv1723077704=11, srv1616438623=9, srv198360794=17, srv1140612215=2, srv1867249961=15, srv417989325=22, srv237342296=19, srv778425586=26, srv1126376914=1, srv878509504=28, srv277096686=20, srv1432235994=7, srv1965130565=16, srv96030226=29, srv214379702=18, srv730364422=24, srv1293142067=3, srv1320790061=4, srv766140811=25, srv1040713552=0, srv1407999072=6, srv1862000158=14} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-21 12:53:37,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-21 12:53:37,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-21 12:53:37,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-21 12:53:37,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-21 12:53:37,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-21 12:53:37,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-21 12:53:37,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-21 12:53:37,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-21 12:53:37,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-21 12:53:37,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-21 12:53:37,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-21 12:53:37,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-21 12:53:37,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-21 12:53:37,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-21 12:53:37,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-21 12:53:37,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-21 12:53:37,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-21 12:53:37,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-21 12:53:37,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-21 12:53:37,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-21 12:53:37,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-21 12:53:37,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-21 12:53:37,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-21 12:53:37,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-21 12:53:37,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-21 12:53:37,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-21 12:53:37,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-21 12:53:37,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-21 12:53:37,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-21 12:53:37,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-21 12:53:37,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-04-21 12:53:37,839 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1352386734580837, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-21 12:53:37,839 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912619175908397, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1352386734580837, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2024-04-21 12:55:37,825 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5774558 different iterations.  Found a solution that moves 1849 regions; Going from a computed imbalance of 0.9912619175908397 to a new imbalance of 4.3156582404131396E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6848148148148148, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-21 12:55:37,832 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1040713552:90 , srv1126376914:90 , srv1140612215:90 , srv1293142067:90 , srv1320790061:90 , srv1402724662:90 , srv1407999072:90 , srv1432235994:90 , srv1600464861:90 , srv1616438623:90 , srv1638830448:90 , srv1723077704:90 , srv1756192069:90 , srv184173960:90 , srv1862000158:90 , srv1867249961:90 , srv1965130565:90 , srv198360794:90 , srv214379702:90 , srv237342296:90 , srv277096686:90 , srv298463943:90 , srv417989325:90 , srv630643818:90 , srv730364422:90 , srv766140811:90 , srv778425586:90 , srv851401145:90 , srv878509504:90 , srv96030226:90 }
2024-04-21 12:55:37,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-21 12:55:37,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv851401145=27, srv184173960=13, srv298463943=21, srv1638830448=10, srv630643818=23, srv1756192069=12, srv1600464861=8, srv1402724662=5, srv1723077704=11, srv1616438623=9, srv198360794=17, srv1140612215=2, srv1867249961=15, srv417989325=22, srv237342296=19, srv778425586=26, srv1126376914=1, srv878509504=28, srv277096686=20, srv1432235994=7, srv1965130565=16, srv96030226=29, srv214379702=18, srv730364422=24, srv1293142067=3, srv1320790061=4, srv766140811=25, srv1040713552=0, srv1407999072=6, srv1862000158=14} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-21 12:55:37,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-21 12:55:37,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-21 12:55:37,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-21 12:55:37,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-21 12:55:37,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-21 12:55:37,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-21 12:55:37,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-21 12:55:37,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-21 12:55:37,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-21 12:55:37,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-21 12:55:37,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-21 12:55:37,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-21 12:55:37,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-21 12:55:37,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-21 12:55:37,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-21 12:55:37,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-21 12:55:37,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-21 12:55:37,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-21 12:55:37,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-21 12:55:37,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-21 12:55:37,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-21 12:55:37,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-21 12:55:37,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-21 12:55:37,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-21 12:55:37,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-21 12:55:37,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-21 12:55:37,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-21 12:55:37,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-21 12:55:37,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-21 12:55:37,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-21 12:55:37,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-04-21 12:55:37,855 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-21 12:55:37,855 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1040713552:90 , srv1126376914:90 , srv1140612215:90 , srv1293142067:90 , srv1320790061:90 , srv1402724662:90 , srv1407999072:90 , srv1432235994:90 , srv1600464861:90 , srv1616438623:90 , srv1638830448:90 , srv1723077704:90 , srv1756192069:90 , srv184173960:90 , srv1862000158:90 , srv1867249961:90 , srv1965130565:90 , srv198360794:90 , srv214379702:90 , srv237342296:90 , srv277096686:90 , srv298463943:90 , srv417989325:90 , srv630643818:90 , srv730364422:90 , srv766140811:90 , srv778425586:90 , srv851401145:90 , srv878509504:90 , srv96030226:90 }
2024-04-21 12:55:37,870 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=289 (was 289), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=209 (was 297), ProcessCount=167 (was 170), AvailableMemoryMB=7177 (was 7135) - AvailableMemoryMB LEAK? -