2023-08-22 07:53:12,515 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-08-22 07:53:12,862 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-08-22 07:53:12,982 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-08-22 07:53:13,045 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-08-22 07:53:13,053 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-08-22 07:53:13,067 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=338, ProcessCount=172, AvailableMemoryMB=12985
2023-08-22 07:53:13,069 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-08-22 07:53:13,070 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-08-22 07:53:13,219 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1008272162:84 , srv1029255319:84 , srv1076362376:84 , srv1088585811:84 , srv1095344859:84 , srv1104472849:84 , srv1125989437:84 , srv1156804956:84 , srv1191354374:84 , srv1192182019:84 , srv1250754619:84 , srv1317062318:84 , srv1329414153:84 , srv1330295367:84 , srv1335908116:84 , srv1349638999:84 , srv142581238:84 , srv1439346858:84 , srv1472140573:84 , srv1489500910:84 , srv1518289609:84 , srv1531315111:84 , srv1539049914:84 , srv1543805989:84 , srv1544009646:84 , srv1544887147:84 , srv1559730578:84 , srv1572078377:84 , srv1580267813:84 , srv160339140:84 , srv1649656859:84 , srv1657304281:84 , srv1667632310:84 , srv1671821824:84 , srv168346826:84 , srv1704259215:84 , srv1761484008:84 , srv1790804242:84 , srv1803111429:84 , srv1807410775:84 , srv18521917:84 , srv1875644461:84 , srv1901759836:84 , srv1940267674:84 , srv1972875349:84 , srv1979782694:84 , srv1983115488:84 , srv2001667792:84 , srv2010713331:84 , srv2021416501:84 , srv2040005206:84 , srv2051397577:84 , srv2054545178:84 , srv2061389591:84 , srv2064780536:84 , srv2067710217:84 , srv2082676819:84 , srv2105474830:84 , srv2116717652:84 , srv243412302:84 , srv244982528:84 , srv260298886:84 , srv291228734:84 , srv299335254:84 , srv305649618:84 , srv344678512:84 , srv35023706:84 , srv365676655:84 , srv366621821:84 , srv369150559:84 , srv400866578:84 , srv401410528:84 , srv402985012:84 , srv42358162:84 , srv45328379:84 , srv488688110:84 , srv528918827:84 , srv58799114:84 , srv604229453:84 , srv604229588:84 , srv682144268:84 , srv69579792:84 , srv700587349:84 , srv717690018:84 , srv745556356:84 , srv763837050:84 , srv799161080:84 , srv817617111:84 , srv819047665:84 , srv840467025:84 , srv851646069:84 , srv85202232:84 , srv855577892:84 , srv886264656:84 , srv935870757:84 , srv942815608:84 , srv968862600:84 , srv995646181:84 , srv998338769:84 , srv662508047:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-08-22 07:53:13,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-22 07:53:13,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv305649618=64, srv35023706=66, srv1531315111=21, srv1803111429=38, srv260298886=61, srv2105474830=57, srv366621821=68, srv1156804956=7, srv1539049914=22, srv717690018=84, srv1008272162=0, srv1790804242=37, srv1125989437=6, srv1349638999=15, srv2054545178=52, srv1335908116=14, srv886264656=94, srv1983115488=46, srv291228734=62, srv1330295367=13, srv1580267813=28, srv2051397577=51, srv851646069=91, srv1875644461=41, srv402985012=72, srv604229453=78, srv682144268=81, srv2040005206=50, srv998338769=99, srv1649656859=30, srv855577892=93, srv344678512=65, srv401410528=71, srv1192182019=9, srv2021416501=49, srv528918827=76, srv995646181=98, srv2116717652=58, srv1667632310=32, srv1704259215=35, srv2061389591=53, srv1544887147=25, srv1572078377=27, srv604229588=79, srv142581238=16, srv42358162=73, srv1095344859=4, srv1439346858=17, srv58799114=77, srv1472140573=18, srv799161080=87, srv160339140=29, srv1761484008=36, srv2001667792=47, srv69579792=82, srv935870757=95, srv817617111=88, srv745556356=85, srv400866578=70, srv700587349=83, srv2010713331=48, srv2082676819=56, srv1489500910=19, srv1901759836=42, srv819047665=89, srv968862600=97, srv1191354374=8, srv299335254=63, srv243412302=59, srv1972875349=44, srv365676655=67, srv369150559=69, srv1317062318=11, srv168346826=34, srv1543805989=23, srv1559730578=26, srv1029255319=1, srv1104472849=5, srv942815608=96, srv763837050=86, srv244982528=60, srv1250754619=10, srv2067710217=55, srv840467025=90, srv1979782694=45, srv1807410775=39, srv1671821824=33, srv1940267674=43, srv2064780536=54, srv662508047=80, srv85202232=92, srv1657304281=31, srv488688110=75, srv1329414153=12, srv45328379=74, srv18521917=40, srv1076362376=2, srv1518289609=20, srv1544009646=24, srv1088585811=3} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-22 07:53:13,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-22 07:53:13,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-22 07:53:13,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-22 07:53:13,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-22 07:53:13,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-22 07:53:13,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-22 07:53:13,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-22 07:53:13,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-22 07:53:13,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-22 07:53:13,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-22 07:53:13,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-22 07:53:13,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-22 07:53:13,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-22 07:53:13,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-22 07:53:13,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-22 07:53:13,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-22 07:53:13,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-22 07:53:13,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-22 07:53:13,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-22 07:53:13,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-22 07:53:13,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-22 07:53:13,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-22 07:53:13,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-22 07:53:13,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-22 07:53:13,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-22 07:53:13,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-22 07:53:13,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-22 07:53:13,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-22 07:53:13,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-22 07:53:13,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-22 07:53:13,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-22 07:53:13,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-22 07:53:13,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-22 07:53:13,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-22 07:53:13,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-22 07:53:13,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-22 07:53:13,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-22 07:53:13,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-22 07:53:13,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-22 07:53:13,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-22 07:53:13,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-22 07:53:13,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-22 07:53:13,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-22 07:53:13,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-22 07:53:13,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-22 07:53:13,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-22 07:53:13,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-22 07:53:13,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-22 07:53:13,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-22 07:53:13,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-22 07:53:13,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-22 07:53:13,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-22 07:53:13,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-22 07:53:13,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-22 07:53:13,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-22 07:53:13,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-22 07:53:13,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-22 07:53:13,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-22 07:53:13,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-22 07:53:13,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-22 07:53:13,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-22 07:53:13,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-22 07:53:13,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-22 07:53:13,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-22 07:53:13,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-22 07:53:13,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-22 07:53:13,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-22 07:53:13,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-22 07:53:13,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-22 07:53:13,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-22 07:53:13,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-22 07:53:13,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-22 07:53:13,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-22 07:53:13,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-22 07:53:13,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-22 07:53:13,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-22 07:53:13,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-22 07:53:13,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-22 07:53:13,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-22 07:53:13,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-22 07:53:13,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-22 07:53:13,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-22 07:53:13,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-22 07:53:13,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-22 07:53:13,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-22 07:53:13,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-22 07:53:13,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-22 07:53:13,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-22 07:53:13,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-22 07:53:13,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-22 07:53:13,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-22 07:53:13,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-22 07:53:13,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-22 07:53:13,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-22 07:53:13,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-22 07:53:13,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-22 07:53:13,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-22 07:53:13,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-22 07:53:13,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-22 07:53:13,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-22 07:53:13,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-22 07:53:13,589 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-22 07:53:13,589 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-22 07:53:13,590 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-22 07:53:14,041 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 680 ms to try 5000 different iterations.  Found a solution that moves 4710 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17198522682836032. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03882903844048607, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05666567636290547, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5233333333333333, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03882903844048607, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.167, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23508333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-22 07:53:14,064 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv299335254:81 , srv244982528:82 , srv488688110:82 , srv604229588:82 , srv851646069:82 , srv1088585811:83 , srv1191354374:83 , srv1559730578:83 , srv1572078377:83 , srv1979782694:83 , srv840467025:83 , srv1531315111:84 , srv1543805989:84 , srv160339140:84 , srv2116717652:84 , srv35023706:84 , srv402985012:84 , srv528918827:84 , srv604229453:84 , srv799161080:84 , srv935870757:84 , srv1125989437:85 , srv1156804956:85 , srv1192182019:85 , srv1349638999:85 , srv1439346858:85 , srv1667632310:85 , srv1807410775:85 , srv1875644461:85 , srv1972875349:85 , srv2021416501:85 , srv2040005206:85 , srv2051397577:85 , srv2061389591:85 , srv243412302:85 , srv344678512:85 , srv819047665:85 , srv968862600:85 , srv1076362376:86 , srv1104472849:86 , srv1317062318:86 , srv142581238:86 , srv1472140573:86 , srv1489500910:86 , srv1649656859:86 , srv1983115488:86 , srv2054545178:86 , srv2064780536:86 , srv365676655:86 , srv366621821:86 , srv45328379:86 , srv817617111:86 , srv85202232:86 , srv886264656:86 , srv998338769:86 , srv1657304281:87 , srv1761484008:87 , srv1790804242:87 , srv1803111429:87 , srv1901759836:87 , srv1940267674:87 , srv2010713331:87 , srv400866578:87 , srv401410528:87 , srv42358162:87 , srv58799114:87 , srv700587349:87 , srv717690018:87 , srv855577892:87 , srv1029255319:88 , srv1095344859:88 , srv1330295367:88 , srv1539049914:88 , srv18521917:88 , srv305649618:88 , srv942815608:88 , srv1544009646:89 , srv1544887147:89 , srv1671821824:89 , srv168346826:89 , srv2001667792:89 , srv260298886:89 , srv369150559:89 , srv1008272162:90 , srv1518289609:90 , srv2082676819:90 , srv2105474830:90 , srv291228734:90 , srv69579792:90 , srv763837050:90 , srv1250754619:91 , srv1329414153:91 , srv1335908116:91 , srv1704259215:91 , srv2067710217:91 , srv745556356:91 , srv682144268:92 , srv1580267813:93 , srv995646181:93 , srv662508047:435 }
2023-08-22 07:53:14,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-22 07:53:14,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv305649618=64, srv35023706=66, srv1531315111=21, srv1803111429=38, srv260298886=61, srv2105474830=57, srv366621821=68, srv1156804956=7, srv1539049914=22, srv717690018=84, srv1008272162=0, srv1790804242=37, srv1125989437=6, srv1349638999=15, srv2054545178=52, srv1335908116=14, srv886264656=94, srv1983115488=46, srv291228734=62, srv1330295367=13, srv1580267813=28, srv2051397577=51, srv851646069=91, srv1875644461=41, srv402985012=72, srv604229453=78, srv682144268=81, srv2040005206=50, srv998338769=99, srv1649656859=30, srv855577892=93, srv344678512=65, srv401410528=71, srv1192182019=9, srv2021416501=49, srv528918827=76, srv995646181=98, srv2116717652=58, srv1667632310=32, srv1704259215=35, srv2061389591=53, srv1544887147=25, srv1572078377=27, srv604229588=79, srv142581238=16, srv42358162=73, srv1095344859=4, srv1439346858=17, srv58799114=77, srv1472140573=18, srv799161080=87, srv160339140=29, srv1761484008=36, srv2001667792=47, srv69579792=82, srv935870757=95, srv817617111=88, srv745556356=85, srv400866578=70, srv700587349=83, srv2010713331=48, srv2082676819=56, srv1489500910=19, srv1901759836=42, srv819047665=89, srv968862600=97, srv1191354374=8, srv299335254=63, srv243412302=59, srv1972875349=44, srv365676655=67, srv369150559=69, srv1317062318=11, srv168346826=34, srv1543805989=23, srv1559730578=26, srv1029255319=1, srv1104472849=5, srv942815608=96, srv763837050=86, srv244982528=60, srv1250754619=10, srv2067710217=55, srv840467025=90, srv1979782694=45, srv1807410775=39, srv1671821824=33, srv1940267674=43, srv2064780536=54, srv662508047=80, srv85202232=92, srv1657304281=31, srv488688110=75, srv1329414153=12, srv45328379=74, srv18521917=40, srv1076362376=2, srv1518289609=20, srv1544009646=24, srv1088585811=3} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-22 07:53:14,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-22 07:53:14,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-22 07:53:14,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-22 07:53:14,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-22 07:53:14,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-22 07:53:14,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-22 07:53:14,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-22 07:53:14,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-22 07:53:14,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-22 07:53:14,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-22 07:53:14,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-22 07:53:14,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-22 07:53:14,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-22 07:53:14,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-22 07:53:14,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-22 07:53:14,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-22 07:53:14,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-22 07:53:14,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-22 07:53:14,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-22 07:53:14,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-22 07:53:14,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-22 07:53:14,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-22 07:53:14,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-22 07:53:14,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-22 07:53:14,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-22 07:53:14,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-22 07:53:14,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-22 07:53:14,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-22 07:53:14,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-22 07:53:14,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-22 07:53:14,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-22 07:53:14,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-22 07:53:14,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-22 07:53:14,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-22 07:53:14,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-22 07:53:14,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-22 07:53:14,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-22 07:53:14,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-22 07:53:14,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-22 07:53:14,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-22 07:53:14,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-22 07:53:14,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-22 07:53:14,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-22 07:53:14,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-22 07:53:14,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-22 07:53:14,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-22 07:53:14,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-22 07:53:14,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-22 07:53:14,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-22 07:53:14,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-22 07:53:14,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-22 07:53:14,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-22 07:53:14,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-22 07:53:14,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-22 07:53:14,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-22 07:53:14,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-22 07:53:14,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-22 07:53:14,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-22 07:53:14,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-22 07:53:14,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-22 07:53:14,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-22 07:53:14,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-22 07:53:14,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-22 07:53:14,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-22 07:53:14,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-22 07:53:14,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-22 07:53:14,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-22 07:53:14,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-22 07:53:14,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-22 07:53:14,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-22 07:53:14,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-22 07:53:14,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-22 07:53:14,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-22 07:53:14,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-22 07:53:14,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-22 07:53:14,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-22 07:53:14,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-22 07:53:14,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-22 07:53:14,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-22 07:53:14,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-22 07:53:14,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-22 07:53:14,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-22 07:53:14,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-22 07:53:14,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-22 07:53:14,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-22 07:53:14,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-22 07:53:14,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-22 07:53:14,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-22 07:53:14,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-22 07:53:14,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-22 07:53:14,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-22 07:53:14,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-22 07:53:14,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-22 07:53:14,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-22 07:53:14,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-22 07:53:14,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-22 07:53:14,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-22 07:53:14,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-22 07:53:14,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-22 07:53:14,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-22 07:53:14,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-22 07:53:14,236 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03882903844048607, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05666567636290547, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03882903844048607, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.167, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23508333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-22 07:53:14,236 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-22 07:53:14,236 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17195224670346196, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03882903844048607, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05666567636290547, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03882903844048607, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.167, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23508333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-22 07:53:14,583 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 455 ms to try 5000 different iterations.  Found a solution that moves 2629 regions; Going from a computed imbalance of 0.17195224670346196 to a new imbalance of 0.015296601178110056. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022084308295752846); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03381470602318381, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2921111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022084308295752846); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04683333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-22 07:53:14,597 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv995646181:77 , srv1329414153:79 , srv1518289609:79 , srv1580267813:79 , srv1250754619:80 , srv745556356:80 , srv1544009646:81 , srv1704259215:81 , srv2082676819:81 , srv2105474830:81 , srv305649618:81 , srv1335908116:82 , srv2067710217:82 , srv42358162:82 , srv58799114:82 , srv682144268:82 , srv1539049914:83 , srv1544887147:83 , srv1671821824:83 , srv18521917:83 , srv2001667792:83 , srv2010713331:83 , srv369150559:83 , srv763837050:83 , srv855577892:83 , srv1008272162:84 , srv1095344859:84 , srv1330295367:84 , srv1803111429:84 , srv1983115488:84 , srv2051397577:84 , srv243412302:84 , srv260298886:84 , srv291228734:84 , srv69579792:84 , srv717690018:84 , srv886264656:84 , srv1029255319:85 , srv1317062318:85 , srv1657304281:85 , srv1790804242:85 , srv35023706:85 , srv604229453:85 , srv700587349:85 , srv142581238:86 , srv1489500910:86 , srv1559730578:86 , srv168346826:86 , srv1875644461:86 , srv1901759836:86 , srv2040005206:86 , srv2064780536:86 , srv365676655:86 , srv400866578:86 , srv817617111:86 , srv819047665:86 , srv85202232:86 , srv935870757:86 , srv968862600:86 , srv998338769:86 , srv1104472849:87 , srv1125989437:87 , srv1192182019:87 , srv1349638999:87 , srv1543805989:87 , srv1572078377:87 , srv1649656859:87 , srv1761484008:87 , srv1807410775:87 , srv1979782694:87 , srv2021416501:87 , srv2054545178:87 , srv2061389591:87 , srv344678512:87 , srv45328379:87 , srv528918827:87 , srv942815608:87 , srv1076362376:88 , srv1088585811:88 , srv1156804956:88 , srv366621821:88 , srv401410528:88 , srv1472140573:89 , srv1531315111:89 , srv160339140:89 , srv1667632310:89 , srv2116717652:89 , srv244982528:89 , srv840467025:89 , srv1940267674:90 , srv299335254:90 , srv402985012:90 , srv799161080:90 , srv1191354374:91 , srv1439346858:91 , srv488688110:91 , srv851646069:91 , srv1972875349:92 , srv604229588:92 , srv662508047:535 }
2023-08-22 07:53:14,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-22 07:53:14,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv305649618=64, srv35023706=66, srv1531315111=21, srv1803111429=38, srv260298886=61, srv2105474830=57, srv366621821=68, srv1156804956=7, srv1539049914=22, srv717690018=84, srv1008272162=0, srv1790804242=37, srv1125989437=6, srv1349638999=15, srv2054545178=52, srv1335908116=14, srv886264656=94, srv1983115488=46, srv291228734=62, srv1330295367=13, srv1580267813=28, srv2051397577=51, srv851646069=91, srv1875644461=41, srv402985012=72, srv604229453=78, srv682144268=81, srv2040005206=50, srv998338769=99, srv1649656859=30, srv855577892=93, srv344678512=65, srv401410528=71, srv1192182019=9, srv2021416501=49, srv528918827=76, srv995646181=98, srv2116717652=58, srv1667632310=32, srv1704259215=35, srv2061389591=53, srv1544887147=25, srv1572078377=27, srv604229588=79, srv142581238=16, srv42358162=73, srv1095344859=4, srv1439346858=17, srv58799114=77, srv1472140573=18, srv799161080=87, srv160339140=29, srv1761484008=36, srv2001667792=47, srv69579792=82, srv935870757=95, srv817617111=88, srv745556356=85, srv400866578=70, srv700587349=83, srv2010713331=48, srv2082676819=56, srv1489500910=19, srv1901759836=42, srv819047665=89, srv968862600=97, srv1191354374=8, srv299335254=63, srv243412302=59, srv1972875349=44, srv365676655=67, srv369150559=69, srv1317062318=11, srv168346826=34, srv1543805989=23, srv1559730578=26, srv1029255319=1, srv1104472849=5, srv942815608=96, srv763837050=86, srv244982528=60, srv1250754619=10, srv2067710217=55, srv840467025=90, srv1979782694=45, srv1807410775=39, srv1671821824=33, srv1940267674=43, srv2064780536=54, srv662508047=80, srv85202232=92, srv1657304281=31, srv488688110=75, srv1329414153=12, srv45328379=74, srv18521917=40, srv1076362376=2, srv1518289609=20, srv1544009646=24, srv1088585811=3} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-22 07:53:14,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-22 07:53:14,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-22 07:53:14,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-22 07:53:14,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-22 07:53:14,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-22 07:53:14,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-22 07:53:14,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-22 07:53:14,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-22 07:53:14,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-22 07:53:14,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-22 07:53:14,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-22 07:53:14,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-22 07:53:14,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-22 07:53:14,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-22 07:53:14,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-22 07:53:14,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-22 07:53:14,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-22 07:53:14,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-22 07:53:14,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-22 07:53:14,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-22 07:53:14,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-22 07:53:14,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-22 07:53:14,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-22 07:53:14,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-22 07:53:14,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-22 07:53:14,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-22 07:53:14,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-22 07:53:14,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-22 07:53:14,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-22 07:53:14,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-22 07:53:14,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-22 07:53:14,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-22 07:53:14,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-22 07:53:14,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-22 07:53:14,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-22 07:53:14,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-22 07:53:14,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-22 07:53:14,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-22 07:53:14,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-22 07:53:14,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-22 07:53:14,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-22 07:53:14,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-22 07:53:14,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-22 07:53:14,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-22 07:53:14,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-22 07:53:14,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-22 07:53:14,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-22 07:53:14,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-22 07:53:14,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-22 07:53:14,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-22 07:53:14,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-22 07:53:14,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-22 07:53:14,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-22 07:53:14,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-22 07:53:14,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-22 07:53:14,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-22 07:53:14,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-22 07:53:14,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-22 07:53:14,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-22 07:53:14,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-22 07:53:14,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-22 07:53:14,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-22 07:53:14,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-22 07:53:14,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-22 07:53:14,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-22 07:53:14,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-22 07:53:14,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-22 07:53:14,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-22 07:53:14,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-22 07:53:14,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-22 07:53:14,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-22 07:53:14,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-22 07:53:14,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-22 07:53:14,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-22 07:53:14,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-22 07:53:14,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-22 07:53:14,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-22 07:53:14,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-22 07:53:14,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-22 07:53:14,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-22 07:53:14,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-22 07:53:14,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-22 07:53:14,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-22 07:53:14,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-22 07:53:14,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-22 07:53:14,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-22 07:53:14,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-22 07:53:14,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-22 07:53:14,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-22 07:53:14,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-22 07:53:14,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-22 07:53:14,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-22 07:53:14,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-22 07:53:14,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-22 07:53:14,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-22 07:53:14,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-22 07:53:14,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-22 07:53:14,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-22 07:53:14,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-22 07:53:14,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-22 07:53:14,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-22 07:53:14,776 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022084308295752846); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03381470602318381, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022084308295752846); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04683333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-22 07:53:14,776 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-22 07:53:14,776 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.01527819252665406, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022084308295752846); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03381470602318381, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022084308295752846); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04683333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-22 07:53:15,105 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 435 ms to try 5000 different iterations.  Found a solution that moves 959 regions; Going from a computed imbalance of 0.01527819252665406 to a new imbalance of 8.402888772987794E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006426656048721966); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009971902164189443); MoveCostFunction : (multiplier=7.0, imbalance=0.10655555555555556, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006426656048721966); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005083333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-22 07:53:15,107 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1972875349:80 , srv1439346858:81 , srv1940267674:81 , srv1472140573:82 , srv168346826:82 , srv942815608:82 , srv1008272162:83 , srv1076362376:83 , srv1667632310:83 , srv1761484008:83 , srv401410528:83 , srv604229588:83 , srv69579792:83 , srv799161080:83 , srv1029255319:84 , srv1156804956:84 , srv1191354374:84 , srv1531315111:84 , srv1901759836:84 , srv2067710217:84 , srv260298886:84 , srv291228734:84 , srv366621821:84 , srv402985012:84 , srv682144268:84 , srv1095344859:85 , srv1104472849:85 , srv1192182019:85 , srv1335908116:85 , srv1349638999:85 , srv1544887147:85 , srv1580267813:85 , srv160339140:85 , srv1649656859:85 , srv1671821824:85 , srv1704259215:85 , srv1790804242:85 , srv1807410775:85 , srv2001667792:85 , srv2021416501:85 , srv2054545178:85 , srv2061389591:85 , srv2116717652:85 , srv344678512:85 , srv369150559:85 , srv400866578:85 , srv45328379:85 , srv488688110:85 , srv700587349:85 , srv763837050:85 , srv817617111:85 , srv819047665:85 , srv851646069:85 , srv1088585811:86 , srv1125989437:86 , srv1317062318:86 , srv1329414153:86 , srv1330295367:86 , srv142581238:86 , srv1489500910:86 , srv1657304281:86 , srv2040005206:86 , srv2064780536:86 , srv2082676819:86 , srv299335254:86 , srv365676655:86 , srv528918827:86 , srv717690018:86 , srv840467025:86 , srv85202232:86 , srv968862600:86 , srv998338769:86 , srv1250754619:87 , srv1539049914:87 , srv1543805989:87 , srv1544009646:87 , srv1572078377:87 , srv1803111429:87 , srv18521917:87 , srv1875644461:87 , srv1979782694:87 , srv2105474830:87 , srv244982528:87 , srv42358162:87 , srv745556356:87 , srv935870757:87 , srv1983115488:88 , srv2010713331:88 , srv2051397577:88 , srv243412302:88 , srv305649618:88 , srv35023706:88 , srv58799114:88 , srv855577892:88 , srv886264656:88 , srv995646181:88 , srv1518289609:89 , srv1559730578:89 , srv604229453:89 , srv662508047:545 }
2023-08-22 07:53:15,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-22 07:53:15,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv305649618=64, srv35023706=66, srv1531315111=21, srv1803111429=38, srv260298886=61, srv2105474830=57, srv366621821=68, srv1156804956=7, srv1539049914=22, srv717690018=84, srv1008272162=0, srv1790804242=37, srv1125989437=6, srv1349638999=15, srv2054545178=52, srv1335908116=14, srv886264656=94, srv1983115488=46, srv291228734=62, srv1330295367=13, srv1580267813=28, srv2051397577=51, srv851646069=91, srv1875644461=41, srv402985012=72, srv604229453=78, srv682144268=81, srv2040005206=50, srv998338769=99, srv1649656859=30, srv855577892=93, srv344678512=65, srv401410528=71, srv1192182019=9, srv2021416501=49, srv528918827=76, srv995646181=98, srv2116717652=58, srv1667632310=32, srv1704259215=35, srv2061389591=53, srv1544887147=25, srv1572078377=27, srv604229588=79, srv142581238=16, srv42358162=73, srv1095344859=4, srv1439346858=17, srv58799114=77, srv1472140573=18, srv799161080=87, srv160339140=29, srv1761484008=36, srv2001667792=47, srv69579792=82, srv935870757=95, srv817617111=88, srv745556356=85, srv400866578=70, srv700587349=83, srv2010713331=48, srv2082676819=56, srv1489500910=19, srv1901759836=42, srv819047665=89, srv968862600=97, srv1191354374=8, srv299335254=63, srv243412302=59, srv1972875349=44, srv365676655=67, srv369150559=69, srv1317062318=11, srv168346826=34, srv1543805989=23, srv1559730578=26, srv1029255319=1, srv1104472849=5, srv942815608=96, srv763837050=86, srv244982528=60, srv1250754619=10, srv2067710217=55, srv840467025=90, srv1979782694=45, srv1807410775=39, srv1671821824=33, srv1940267674=43, srv2064780536=54, srv662508047=80, srv85202232=92, srv1657304281=31, srv488688110=75, srv1329414153=12, srv45328379=74, srv18521917=40, srv1076362376=2, srv1518289609=20, srv1544009646=24, srv1088585811=3} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-22 07:53:15,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-22 07:53:15,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-22 07:53:15,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-22 07:53:15,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-22 07:53:15,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-22 07:53:15,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-22 07:53:15,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-22 07:53:15,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-22 07:53:15,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-22 07:53:15,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-22 07:53:15,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-22 07:53:15,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-22 07:53:15,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-22 07:53:15,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-22 07:53:15,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-22 07:53:15,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-22 07:53:15,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-22 07:53:15,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-22 07:53:15,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-22 07:53:15,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-22 07:53:15,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-22 07:53:15,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-22 07:53:15,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-22 07:53:15,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-22 07:53:15,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-22 07:53:15,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-22 07:53:15,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-22 07:53:15,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-22 07:53:15,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-22 07:53:15,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-22 07:53:15,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-22 07:53:15,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-22 07:53:15,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-22 07:53:15,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-22 07:53:15,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-22 07:53:15,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-22 07:53:15,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-22 07:53:15,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-22 07:53:15,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-22 07:53:15,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-22 07:53:15,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-22 07:53:15,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-22 07:53:15,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-22 07:53:15,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-22 07:53:15,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-22 07:53:15,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-22 07:53:15,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-22 07:53:15,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-22 07:53:15,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-22 07:53:15,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-22 07:53:15,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-22 07:53:15,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-22 07:53:15,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-22 07:53:15,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-22 07:53:15,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-22 07:53:15,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-22 07:53:15,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-22 07:53:15,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-22 07:53:15,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-22 07:53:15,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-22 07:53:15,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-22 07:53:15,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-22 07:53:15,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-22 07:53:15,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-22 07:53:15,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-22 07:53:15,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-22 07:53:15,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-22 07:53:15,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-22 07:53:15,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-22 07:53:15,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-22 07:53:15,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-22 07:53:15,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-22 07:53:15,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-22 07:53:15,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-22 07:53:15,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-22 07:53:15,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-22 07:53:15,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-22 07:53:15,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-22 07:53:15,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-22 07:53:15,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-22 07:53:15,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-22 07:53:15,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-22 07:53:15,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-22 07:53:15,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-22 07:53:15,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-22 07:53:15,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-22 07:53:15,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-22 07:53:15,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-22 07:53:15,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-22 07:53:15,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-22 07:53:15,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-22 07:53:15,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-22 07:53:15,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-22 07:53:15,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-22 07:53:15,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-22 07:53:15,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-22 07:53:15,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-22 07:53:15,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-22 07:53:15,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-22 07:53:15,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-22 07:53:15,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-22 07:53:15,253 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006426656048721966); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009971902164189443); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006426656048721966); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005083333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-22 07:53:15,253 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-22 07:53:15,254 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=8.335738157748916E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006426656048721966); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009971902164189443); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006426656048721966); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005083333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-22 07:53:15,650 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 500 ms to try 5000 different iterations.  Found a solution that moves 287 regions; Going from a computed imbalance of 8.335738157748916E-4 to a new imbalance of 3.5970029312450724E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002010075630518424); MoveCostFunction : (multiplier=7.0, imbalance=0.03188888888888889, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-22 07:53:15,652 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1191354374:83 , srv244982528:83 , srv366621821:83 , srv85202232:83 , srv1008272162:84 , srv1104472849:84 , srv1125989437:84 , srv1250754619:84 , srv1330295367:84 , srv1335908116:84 , srv142581238:84 , srv1489500910:84 , srv1518289609:84 , srv1539049914:84 , srv1543805989:84 , srv1544009646:84 , srv1559730578:84 , srv1580267813:84 , srv160339140:84 , srv1657304281:84 , srv1803111429:84 , srv18521917:84 , srv1875644461:84 , srv1940267674:84 , srv1983115488:84 , srv2010713331:84 , srv2054545178:84 , srv2064780536:84 , srv2105474830:84 , srv2116717652:84 , srv291228734:84 , srv365676655:84 , srv369150559:84 , srv400866578:84 , srv402985012:84 , srv45328379:84 , srv488688110:84 , srv604229453:84 , srv682144268:84 , srv717690018:84 , srv763837050:84 , srv840467025:84 , srv851646069:84 , srv886264656:84 , srv995646181:84 , srv1029255319:85 , srv1076362376:85 , srv1088585811:85 , srv1095344859:85 , srv1156804956:85 , srv1192182019:85 , srv1317062318:85 , srv1349638999:85 , srv1439346858:85 , srv1472140573:85 , srv1531315111:85 , srv1544887147:85 , srv1572078377:85 , srv1649656859:85 , srv1667632310:85 , srv1671821824:85 , srv168346826:85 , srv1704259215:85 , srv1761484008:85 , srv1807410775:85 , srv1901759836:85 , srv1972875349:85 , srv2001667792:85 , srv2021416501:85 , srv2051397577:85 , srv2061389591:85 , srv2082676819:85 , srv243412302:85 , srv260298886:85 , srv299335254:85 , srv305649618:85 , srv344678512:85 , srv35023706:85 , srv401410528:85 , srv528918827:85 , srv58799114:85 , srv604229588:85 , srv700587349:85 , srv745556356:85 , srv799161080:85 , srv817617111:85 , srv855577892:85 , srv935870757:85 , srv942815608:85 , srv968862600:85 , srv998338769:85 , srv1329414153:86 , srv1790804242:86 , srv1979782694:86 , srv2040005206:86 , srv2067710217:86 , srv42358162:86 , srv69579792:86 , srv819047665:86 , srv662508047:626 }
2023-08-22 07:53:15,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-22 07:53:15,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv305649618=64, srv35023706=66, srv1531315111=21, srv1803111429=38, srv260298886=61, srv2105474830=57, srv366621821=68, srv1156804956=7, srv1539049914=22, srv717690018=84, srv1008272162=0, srv1790804242=37, srv1125989437=6, srv1349638999=15, srv2054545178=52, srv1335908116=14, srv886264656=94, srv1983115488=46, srv291228734=62, srv1330295367=13, srv1580267813=28, srv2051397577=51, srv851646069=91, srv1875644461=41, srv402985012=72, srv604229453=78, srv682144268=81, srv2040005206=50, srv998338769=99, srv1649656859=30, srv855577892=93, srv344678512=65, srv401410528=71, srv1192182019=9, srv2021416501=49, srv528918827=76, srv995646181=98, srv2116717652=58, srv1667632310=32, srv1704259215=35, srv2061389591=53, srv1544887147=25, srv1572078377=27, srv604229588=79, srv142581238=16, srv42358162=73, srv1095344859=4, srv1439346858=17, srv58799114=77, srv1472140573=18, srv799161080=87, srv160339140=29, srv1761484008=36, srv2001667792=47, srv69579792=82, srv935870757=95, srv817617111=88, srv745556356=85, srv400866578=70, srv700587349=83, srv2010713331=48, srv2082676819=56, srv1489500910=19, srv1901759836=42, srv819047665=89, srv968862600=97, srv1191354374=8, srv299335254=63, srv243412302=59, srv1972875349=44, srv365676655=67, srv369150559=69, srv1317062318=11, srv168346826=34, srv1543805989=23, srv1559730578=26, srv1029255319=1, srv1104472849=5, srv942815608=96, srv763837050=86, srv244982528=60, srv1250754619=10, srv2067710217=55, srv840467025=90, srv1979782694=45, srv1807410775=39, srv1671821824=33, srv1940267674=43, srv2064780536=54, srv662508047=80, srv85202232=92, srv1657304281=31, srv488688110=75, srv1329414153=12, srv45328379=74, srv18521917=40, srv1076362376=2, srv1518289609=20, srv1544009646=24, srv1088585811=3} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-22 07:53:15,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-22 07:53:15,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-22 07:53:15,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-22 07:53:15,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-22 07:53:15,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-22 07:53:15,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-22 07:53:15,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-22 07:53:15,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-22 07:53:15,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-22 07:53:15,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-22 07:53:15,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-22 07:53:15,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-22 07:53:15,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-22 07:53:15,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-22 07:53:15,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-22 07:53:15,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-22 07:53:15,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-22 07:53:15,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-22 07:53:15,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-22 07:53:15,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-22 07:53:15,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-22 07:53:15,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-22 07:53:15,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-22 07:53:15,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-22 07:53:15,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-22 07:53:15,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-22 07:53:15,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-22 07:53:15,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-22 07:53:15,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-22 07:53:15,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-22 07:53:15,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-22 07:53:15,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-22 07:53:15,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-22 07:53:15,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-22 07:53:15,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-22 07:53:15,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-22 07:53:15,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-22 07:53:15,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-22 07:53:15,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-22 07:53:15,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-22 07:53:15,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-22 07:53:15,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-22 07:53:15,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-22 07:53:15,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-22 07:53:15,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-22 07:53:15,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-22 07:53:15,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-22 07:53:15,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-22 07:53:15,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-22 07:53:15,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-22 07:53:15,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-22 07:53:15,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-22 07:53:15,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-22 07:53:15,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-22 07:53:15,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-22 07:53:15,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-22 07:53:15,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-22 07:53:15,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-22 07:53:15,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-22 07:53:15,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-22 07:53:15,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-22 07:53:15,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-22 07:53:15,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-22 07:53:15,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-22 07:53:15,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-22 07:53:15,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-22 07:53:15,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-22 07:53:15,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-22 07:53:15,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-22 07:53:15,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-22 07:53:15,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-22 07:53:15,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-22 07:53:15,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-22 07:53:15,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-22 07:53:15,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-22 07:53:15,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-22 07:53:15,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-22 07:53:15,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-22 07:53:15,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-22 07:53:15,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-22 07:53:15,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-22 07:53:15,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-22 07:53:15,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-22 07:53:15,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-22 07:53:15,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-22 07:53:15,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-22 07:53:15,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-22 07:53:15,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-22 07:53:15,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-22 07:53:15,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-22 07:53:15,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-22 07:53:15,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-22 07:53:15,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-22 07:53:15,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-22 07:53:15,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-22 07:53:15,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-22 07:53:15,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-22 07:53:15,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-22 07:53:15,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-22 07:53:15,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-22 07:53:15,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-22 07:53:15,832 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002010075630518424); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-22 07:53:15,832 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-22 07:53:15,833 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=3.396041236004634E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002010075630518424); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-22 07:53:16,164 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 466 ms to try 5000 different iterations.  Found a solution that moves 28 regions; Going from a computed imbalance of 3.396041236004634E-5 to a new imbalance of 7.583817690791035E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0016412198797244363); MoveCostFunction : (multiplier=7.0, imbalance=0.003111111111111111); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-22 07:53:16,165 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1649656859:83 , srv1790804242:83 , srv1979782694:83 , srv2040005206:83 , srv2067710217:83 , srv401410528:83 , srv69579792:83 , srv745556356:83 , srv855577892:83 , srv998338769:83 , srv1029255319:84 , srv1076362376:84 , srv1088585811:84 , srv1095344859:84 , srv1104472849:84 , srv1125989437:84 , srv1156804956:84 , srv1192182019:84 , srv1250754619:84 , srv1317062318:84 , srv1329414153:84 , srv1330295367:84 , srv1335908116:84 , srv1349638999:84 , srv142581238:84 , srv1439346858:84 , srv1472140573:84 , srv1489500910:84 , srv1518289609:84 , srv1531315111:84 , srv1539049914:84 , srv1543805989:84 , srv1544887147:84 , srv1559730578:84 , srv1572078377:84 , srv160339140:84 , srv1657304281:84 , srv1667632310:84 , srv1671821824:84 , srv168346826:84 , srv1704259215:84 , srv1761484008:84 , srv1803111429:84 , srv1807410775:84 , srv18521917:84 , srv1875644461:84 , srv1901759836:84 , srv1940267674:84 , srv1972875349:84 , srv1983115488:84 , srv2001667792:84 , srv2010713331:84 , srv2021416501:84 , srv2051397577:84 , srv2054545178:84 , srv2061389591:84 , srv2064780536:84 , srv2082676819:84 , srv2105474830:84 , srv2116717652:84 , srv243412302:84 , srv260298886:84 , srv291228734:84 , srv299335254:84 , srv305649618:84 , srv344678512:84 , srv35023706:84 , srv365676655:84 , srv400866578:84 , srv402985012:84 , srv42358162:84 , srv45328379:84 , srv488688110:84 , srv528918827:84 , srv58799114:84 , srv604229453:84 , srv604229588:84 , srv682144268:84 , srv700587349:84 , srv763837050:84 , srv799161080:84 , srv817617111:84 , srv819047665:84 , srv840467025:84 , srv851646069:84 , srv886264656:84 , srv935870757:84 , srv942815608:84 , srv968862600:84 , srv995646181:84 , srv1008272162:85 , srv1191354374:85 , srv1544009646:85 , srv1580267813:85 , srv244982528:85 , srv366621821:85 , srv369150559:85 , srv717690018:85 , srv85202232:85 , srv662508047:685 }
2023-08-22 07:53:16,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-22 07:53:16,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv305649618=64, srv35023706=66, srv1531315111=21, srv1803111429=38, srv260298886=61, srv2105474830=57, srv366621821=68, srv1156804956=7, srv1539049914=22, srv717690018=84, srv1008272162=0, srv1790804242=37, srv1125989437=6, srv1349638999=15, srv2054545178=52, srv1335908116=14, srv886264656=94, srv1983115488=46, srv291228734=62, srv1330295367=13, srv1580267813=28, srv2051397577=51, srv851646069=91, srv1875644461=41, srv402985012=72, srv604229453=78, srv682144268=81, srv2040005206=50, srv998338769=99, srv1649656859=30, srv855577892=93, srv344678512=65, srv401410528=71, srv1192182019=9, srv2021416501=49, srv528918827=76, srv995646181=98, srv2116717652=58, srv1667632310=32, srv1704259215=35, srv2061389591=53, srv1544887147=25, srv1572078377=27, srv604229588=79, srv142581238=16, srv42358162=73, srv1095344859=4, srv1439346858=17, srv58799114=77, srv1472140573=18, srv799161080=87, srv160339140=29, srv1761484008=36, srv2001667792=47, srv69579792=82, srv935870757=95, srv817617111=88, srv745556356=85, srv400866578=70, srv700587349=83, srv2010713331=48, srv2082676819=56, srv1489500910=19, srv1901759836=42, srv819047665=89, srv968862600=97, srv1191354374=8, srv299335254=63, srv243412302=59, srv1972875349=44, srv365676655=67, srv369150559=69, srv1317062318=11, srv168346826=34, srv1543805989=23, srv1559730578=26, srv1029255319=1, srv1104472849=5, srv942815608=96, srv763837050=86, srv244982528=60, srv1250754619=10, srv2067710217=55, srv840467025=90, srv1979782694=45, srv1807410775=39, srv1671821824=33, srv1940267674=43, srv2064780536=54, srv662508047=80, srv85202232=92, srv1657304281=31, srv488688110=75, srv1329414153=12, srv45328379=74, srv18521917=40, srv1076362376=2, srv1518289609=20, srv1544009646=24, srv1088585811=3} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-22 07:53:16,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-22 07:53:16,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-22 07:53:16,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-22 07:53:16,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-22 07:53:16,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-22 07:53:16,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-22 07:53:16,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-22 07:53:16,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-22 07:53:16,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-22 07:53:16,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-22 07:53:16,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-22 07:53:16,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-22 07:53:16,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-22 07:53:16,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-22 07:53:16,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-22 07:53:16,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-22 07:53:16,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-22 07:53:16,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-22 07:53:16,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-22 07:53:16,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-22 07:53:16,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-22 07:53:16,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-22 07:53:16,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-22 07:53:16,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-22 07:53:16,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-22 07:53:16,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-22 07:53:16,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-22 07:53:16,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-22 07:53:16,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-22 07:53:16,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-22 07:53:16,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-22 07:53:16,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-22 07:53:16,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-22 07:53:16,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-22 07:53:16,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-22 07:53:16,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-22 07:53:16,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-22 07:53:16,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-22 07:53:16,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-22 07:53:16,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-22 07:53:16,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-22 07:53:16,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-22 07:53:16,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-22 07:53:16,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-22 07:53:16,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-22 07:53:16,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-22 07:53:16,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-22 07:53:16,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-22 07:53:16,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-22 07:53:16,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-22 07:53:16,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-22 07:53:16,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-22 07:53:16,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-22 07:53:16,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-22 07:53:16,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-22 07:53:16,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-22 07:53:16,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-22 07:53:16,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-22 07:53:16,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-22 07:53:16,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-22 07:53:16,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-22 07:53:16,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-22 07:53:16,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-22 07:53:16,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-22 07:53:16,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-22 07:53:16,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-22 07:53:16,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-22 07:53:16,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-22 07:53:16,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-22 07:53:16,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-22 07:53:16,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-22 07:53:16,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-22 07:53:16,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-22 07:53:16,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-22 07:53:16,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-22 07:53:16,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-22 07:53:16,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-22 07:53:16,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-22 07:53:16,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-22 07:53:16,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-22 07:53:16,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-22 07:53:16,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-22 07:53:16,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-22 07:53:16,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-22 07:53:16,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-22 07:53:16,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-22 07:53:16,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-22 07:53:16,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-22 07:53:16,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-22 07:53:16,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-22 07:53:16,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-22 07:53:16,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-22 07:53:16,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-22 07:53:16,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-22 07:53:16,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-22 07:53:16,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-22 07:53:16,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-22 07:53:16,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-22 07:53:16,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-22 07:53:16,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-22 07:53:16,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-22 07:53:16,316 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.387757500312559E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0016412198797244363); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-22 07:53:16,317 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1649656859:83 , srv1790804242:83 , srv1979782694:83 , srv2040005206:83 , srv2067710217:83 , srv401410528:83 , srv69579792:83 , srv745556356:83 , srv855577892:83 , srv998338769:83 , srv1029255319:84 , srv1076362376:84 , srv1088585811:84 , srv1095344859:84 , srv1104472849:84 , srv1125989437:84 , srv1156804956:84 , srv1192182019:84 , srv1250754619:84 , srv1317062318:84 , srv1329414153:84 , srv1330295367:84 , srv1335908116:84 , srv1349638999:84 , srv142581238:84 , srv1439346858:84 , srv1472140573:84 , srv1489500910:84 , srv1518289609:84 , srv1531315111:84 , srv1539049914:84 , srv1543805989:84 , srv1544887147:84 , srv1559730578:84 , srv1572078377:84 , srv160339140:84 , srv1657304281:84 , srv1667632310:84 , srv1671821824:84 , srv168346826:84 , srv1704259215:84 , srv1761484008:84 , srv1803111429:84 , srv1807410775:84 , srv18521917:84 , srv1875644461:84 , srv1901759836:84 , srv1940267674:84 , srv1972875349:84 , srv1983115488:84 , srv2001667792:84 , srv2010713331:84 , srv2021416501:84 , srv2051397577:84 , srv2054545178:84 , srv2061389591:84 , srv2064780536:84 , srv2082676819:84 , srv2105474830:84 , srv2116717652:84 , srv243412302:84 , srv260298886:84 , srv291228734:84 , srv299335254:84 , srv305649618:84 , srv344678512:84 , srv35023706:84 , srv365676655:84 , srv400866578:84 , srv402985012:84 , srv42358162:84 , srv45328379:84 , srv488688110:84 , srv528918827:84 , srv58799114:84 , srv604229453:84 , srv604229588:84 , srv682144268:84 , srv700587349:84 , srv763837050:84 , srv799161080:84 , srv817617111:84 , srv819047665:84 , srv840467025:84 , srv851646069:84 , srv886264656:84 , srv935870757:84 , srv942815608:84 , srv968862600:84 , srv995646181:84 , srv1008272162:85 , srv1191354374:85 , srv1544009646:85 , srv1580267813:85 , srv244982528:85 , srv366621821:85 , srv369150559:85 , srv717690018:85 , srv85202232:85 , srv662508047:685 }
2023-08-22 07:53:16,345 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=359 (was 338) - SystemLoadAverage LEAK? -, ProcessCount=172 (was 172), AvailableMemoryMB=12122 (was 12985)
2023-08-22 07:53:16,357 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=359, ProcessCount=172, AvailableMemoryMB=12121
2023-08-22 07:53:16,357 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-08-22 07:53:16,358 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-08-22 07:53:16,367 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1099440491:84 , srv1108992673:84 , srv1208997324:84 , srv1247682004:84 , srv1277008307:84 , srv1279151291:84 , srv1367151256:84 , srv1456921329:84 , srv1509075136:84 , srv1515927913:84 , srv1603108898:84 , srv1617296276:84 , srv1629598323:84 , srv175713542:84 , srv1843190384:84 , srv1882727169:84 , srv2007580168:84 , srv2029812313:84 , srv2042599607:84 , srv2096289585:84 , srv312840739:84 , srv327820564:84 , srv368462509:84 , srv3957641:84 , srv424125178:84 , srv784938360:84 , srv825666229:84 , srv986204915:84 , srv995482242:84 , srv507385154:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-08-22 07:53:16,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-22 07:53:16,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1108992673=1, srv1279151291=5, srv1882727169=15, srv1099440491=0, srv2042599607=18, srv1247682004=3, srv507385154=25, srv784938360=26, srv1603108898=10, srv1629598323=12, srv312840739=20, srv986204915=28, srv1617296276=11, srv1456921329=7, srv1843190384=14, srv1515927913=9, srv368462509=22, srv424125178=24, srv327820564=21, srv1367151256=6, srv995482242=29, srv825666229=27, srv1509075136=8, srv2096289585=19, srv1277008307=4, srv2007580168=16, srv1208997324=2, srv175713542=13, srv3957641=23, srv2029812313=17} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-22 07:53:16,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-22 07:53:16,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-22 07:53:16,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-22 07:53:16,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-22 07:53:16,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-22 07:53:16,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-22 07:53:16,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-22 07:53:16,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-22 07:53:16,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-22 07:53:16,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-22 07:53:16,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-22 07:53:16,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-22 07:53:16,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-22 07:53:16,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-22 07:53:16,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-22 07:53:16,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-22 07:53:16,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-22 07:53:16,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-22 07:53:16,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-22 07:53:16,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-22 07:53:16,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-22 07:53:16,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-22 07:53:16,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-22 07:53:16,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-22 07:53:16,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-22 07:53:16,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-22 07:53:16,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-22 07:53:16,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-22 07:53:16,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-22 07:53:16,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-22 07:53:16,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-08-22 07:53:16,403 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1152324402547888, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-22 07:53:16,403 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912556136920837, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1152324402547888, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-08-22 07:55:16,383 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5693544 different iterations.  Found a solution that moves 1858 regions; Going from a computed imbalance of 0.9912556136920837 to a new imbalance of 4.336664689392977E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6881481481481482, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-22 07:55:16,390 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1099440491:90 , srv1108992673:90 , srv1208997324:90 , srv1247682004:90 , srv1277008307:90 , srv1279151291:90 , srv1367151256:90 , srv1456921329:90 , srv1509075136:90 , srv1515927913:90 , srv1603108898:90 , srv1617296276:90 , srv1629598323:90 , srv175713542:90 , srv1843190384:90 , srv1882727169:90 , srv2007580168:90 , srv2029812313:90 , srv2042599607:90 , srv2096289585:90 , srv312840739:90 , srv327820564:90 , srv368462509:90 , srv3957641:90 , srv424125178:90 , srv507385154:90 , srv784938360:90 , srv825666229:90 , srv986204915:90 , srv995482242:90 }
2023-08-22 07:55:16,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-22 07:55:16,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1108992673=1, srv1279151291=5, srv1882727169=15, srv1099440491=0, srv2042599607=18, srv1247682004=3, srv507385154=25, srv784938360=26, srv1603108898=10, srv1629598323=12, srv312840739=20, srv986204915=28, srv1617296276=11, srv1456921329=7, srv1843190384=14, srv1515927913=9, srv368462509=22, srv424125178=24, srv327820564=21, srv1367151256=6, srv995482242=29, srv825666229=27, srv1509075136=8, srv2096289585=19, srv1277008307=4, srv2007580168=16, srv1208997324=2, srv175713542=13, srv3957641=23, srv2029812313=17} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-22 07:55:16,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-22 07:55:16,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-22 07:55:16,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-22 07:55:16,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-22 07:55:16,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-22 07:55:16,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-22 07:55:16,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-22 07:55:16,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-22 07:55:16,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-22 07:55:16,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-22 07:55:16,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-22 07:55:16,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-22 07:55:16,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-22 07:55:16,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-22 07:55:16,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-22 07:55:16,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-22 07:55:16,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-22 07:55:16,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-22 07:55:16,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-22 07:55:16,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-22 07:55:16,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-22 07:55:16,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-22 07:55:16,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-22 07:55:16,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-22 07:55:16,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-22 07:55:16,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-22 07:55:16,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-22 07:55:16,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-22 07:55:16,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-22 07:55:16,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-22 07:55:16,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-08-22 07:55:16,412 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-22 07:55:16,413 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1099440491:90 , srv1108992673:90 , srv1208997324:90 , srv1247682004:90 , srv1277008307:90 , srv1279151291:90 , srv1367151256:90 , srv1456921329:90 , srv1509075136:90 , srv1515927913:90 , srv1603108898:90 , srv1617296276:90 , srv1629598323:90 , srv175713542:90 , srv1843190384:90 , srv1882727169:90 , srv2007580168:90 , srv2029812313:90 , srv2042599607:90 , srv2096289585:90 , srv312840739:90 , srv327820564:90 , srv368462509:90 , srv3957641:90 , srv424125178:90 , srv507385154:90 , srv784938360:90 , srv825666229:90 , srv986204915:90 , srv995482242:90 }
2023-08-22 07:55:16,436 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=214 (was 359), ProcessCount=172 (was 172), AvailableMemoryMB=12051 (was 12121)