2023-05-30 19:53:20,075 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-05-30 19:53:20,345 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-05-30 19:53:20,442 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-05-30 19:53:20,496 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-05-30 19:53:20,503 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-05-30 19:53:20,516 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=264, MaxFileDescriptor=60000, SystemLoadAverage=316, ProcessCount=172, AvailableMemoryMB=4370
2023-05-30 19:53:20,518 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-05-30 19:53:20,518 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-05-30 19:53:20,653 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1019050371:84 , srv1046954352:84 , srv1047536055:84 , srv1057190309:84 , srv107626250:84 , srv1091553461:84 , srv1119619991:84 , srv1130758014:84 , srv1136813798:84 , srv1139436582:84 , srv1154276321:84 , srv1169730909:84 , srv1195976063:84 , srv1213047955:84 , srv1242257397:84 , srv1262910504:84 , srv1301728219:84 , srv1343964694:84 , srv1368448247:84 , srv1390038661:84 , srv1415624956:84 , srv1462702235:84 , srv1491044156:84 , srv1514836098:84 , srv1536085923:84 , srv1571200167:84 , srv157256720:84 , srv1602991061:84 , srv1643000717:84 , srv1643206039:84 , srv1649800346:84 , srv1655083526:84 , srv1703601434:84 , srv1725658782:84 , srv1730338995:84 , srv1748049277:84 , srv1753047965:84 , srv177651150:84 , srv1777756003:84 , srv1793407908:84 , srv1808958191:84 , srv1842558014:84 , srv1854274560:84 , srv1874292142:84 , srv1883522399:84 , srv1931291584:84 , srv1958745310:84 , srv1970273697:84 , srv198239515:84 , srv1999752958:84 , srv2039023992:84 , srv206860258:84 , srv207270893:84 , srv2088450365:84 , srv2097595483:84 , srv2104994169:84 , srv2105694069:84 , srv2112896269:84 , srv213686171:84 , srv231502507:84 , srv25252612:84 , srv319183148:84 , srv379246304:84 , srv386728944:84 , srv499631508:84 , srv502867243:84 , srv510982382:84 , srv525168945:84 , srv554103346:84 , srv585033456:84 , srv587076939:84 , srv604096864:84 , srv604590271:84 , srv60570015:84 , srv621541168:84 , srv629630180:84 , srv630770643:84 , srv651629425:84 , srv651783121:84 , srv651856095:84 , srv652261429:84 , srv673066535:84 , srv782609151:84 , srv784604958:84 , srv786413325:84 , srv80456158:84 , srv820778608:84 , srv862715173:84 , srv868442050:84 , srv911620936:84 , srv91501441:84 , srv915277635:84 , srv936162779:84 , srv939626138:84 , srv955050964:84 , srv962269706:84 , srv975997952:84 , srv979839276:84 , srv994858526:84 , srv1153582808:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-05-30 19:53:20,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-30 19:53:20,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1931291584=46, srv319183148=62, srv1091553461=5, srv936162779=93, srv1046954352=1, srv652261429=81, srv1655083526=32, srv1808958191=41, srv1643000717=29, srv955050964=95, srv1958745310=47, srv1874292142=44, srv1136813798=8, srv2105694069=57, srv1119619991=6, srv629630180=76, srv1725658782=34, srv1730338995=35, srv207270893=53, srv1195976063=13, srv2039023992=51, srv1415624956=21, srv1491044156=23, srv868442050=89, srv1854274560=43, srv621541168=75, srv1793407908=40, srv2097595483=55, srv502867243=66, srv673066535=82, srv379246304=63, srv630770643=77, srv994858526=99, srv1343964694=18, srv1970273697=48, srv91501441=91, srv782609151=83, srv962269706=96, srv177651150=38, srv2112896269=58, srv231502507=60, srv1154276321=11, srv1571200167=26, srv979839276=98, srv499631508=65, srv1462702235=22, srv1536085923=25, srv1999752958=50, srv1139436582=9, srv213686171=59, srv915277635=92, srv1748049277=36, srv206860258=52, srv1777756003=39, srv1169730909=12, srv1842558014=42, srv1703601434=33, srv1301728219=17, srv1883522399=45, srv651629425=78, srv2088450365=54, srv1602991061=28, srv554103346=69, srv651783121=79, srv1130758014=7, srv386728944=64, srv1213047955=14, srv784604958=84, srv587076939=71, srv80456158=86, srv1262910504=16, srv198239515=49, srv1019050371=0, srv107626250=4, srv786413325=85, srv604590271=73, srv1368448247=19, srv862715173=88, srv604096864=72, srv157256720=27, srv651856095=80, srv1047536055=2, srv60570015=74, srv1153582808=10, srv585033456=70, srv510982382=67, srv911620936=90, srv1242257397=15, srv2104994169=56, srv25252612=61, srv975997952=97, srv820778608=87, srv1057190309=3, srv1390038661=20, srv1753047965=37, srv1514836098=24, srv1643206039=30, srv1649800346=31, srv525168945=68, srv939626138=94} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-30 19:53:20,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-30 19:53:20,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-30 19:53:20,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-30 19:53:20,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-30 19:53:20,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-30 19:53:20,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-30 19:53:20,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-30 19:53:20,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-30 19:53:20,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-30 19:53:20,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-30 19:53:20,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-30 19:53:20,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-30 19:53:20,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-30 19:53:20,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-30 19:53:20,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-30 19:53:20,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-30 19:53:20,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-30 19:53:20,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-30 19:53:20,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-30 19:53:20,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-30 19:53:20,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-30 19:53:20,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-30 19:53:20,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-30 19:53:20,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-30 19:53:20,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-30 19:53:20,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-30 19:53:20,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-30 19:53:20,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-30 19:53:20,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-30 19:53:20,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-30 19:53:20,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-30 19:53:20,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-30 19:53:20,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-30 19:53:20,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-30 19:53:20,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-30 19:53:20,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-30 19:53:20,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-30 19:53:20,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-30 19:53:20,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-30 19:53:20,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-30 19:53:20,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-30 19:53:20,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-30 19:53:20,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-30 19:53:20,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-30 19:53:20,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-30 19:53:20,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-30 19:53:20,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-30 19:53:20,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-30 19:53:20,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-30 19:53:20,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-30 19:53:20,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-30 19:53:20,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-30 19:53:20,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-30 19:53:20,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-30 19:53:20,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-30 19:53:20,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-30 19:53:20,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-30 19:53:20,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-30 19:53:20,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-30 19:53:20,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-30 19:53:20,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-30 19:53:20,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-30 19:53:20,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-30 19:53:20,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-30 19:53:20,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-30 19:53:20,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-30 19:53:20,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-30 19:53:20,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-30 19:53:20,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-30 19:53:20,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-30 19:53:20,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-30 19:53:20,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-30 19:53:20,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-30 19:53:20,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-30 19:53:20,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-30 19:53:20,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-30 19:53:20,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-30 19:53:20,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-30 19:53:20,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-30 19:53:20,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-30 19:53:20,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-30 19:53:20,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-30 19:53:20,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-30 19:53:20,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-30 19:53:20,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-30 19:53:20,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-30 19:53:20,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-30 19:53:20,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-30 19:53:20,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-30 19:53:20,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-30 19:53:20,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-30 19:53:20,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-30 19:53:20,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-30 19:53:20,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-30 19:53:20,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-30 19:53:20,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-30 19:53:20,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-30 19:53:20,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-30 19:53:20,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-30 19:53:20,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-30 19:53:20,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-30 19:53:20,883 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-30 19:53:20,884 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-30 19:53:20,884 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-30 19:53:21,234 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 477 ms to try 5000 different iterations.  Found a solution that moves 4709 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.1772635139826826. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.041503721791652876, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05473125854735417, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5232222222222223, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.041503721791652876, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17216666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.242, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-30 19:53:21,245 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv2104994169:81 , srv1571200167:83 , srv1883522399:83 , srv2105694069:83 , srv213686171:83 , srv379246304:83 , srv502867243:83 , srv1047536055:84 , srv1154276321:84 , srv1242257397:84 , srv1301728219:84 , srv1343964694:84 , srv1491044156:84 , srv1602991061:84 , srv1753047965:84 , srv1808958191:84 , srv1854274560:84 , srv1931291584:84 , srv319183148:84 , srv499631508:84 , srv604096864:84 , srv651783121:84 , srv651856095:84 , srv868442050:84 , srv936162779:84 , srv1057190309:85 , srv107626250:85 , srv1130758014:85 , srv1139436582:85 , srv1415624956:85 , srv1643000717:85 , srv1643206039:85 , srv1703601434:85 , srv1725658782:85 , srv1874292142:85 , srv25252612:85 , srv510982382:85 , srv554103346:85 , srv60570015:85 , srv621541168:85 , srv651629425:85 , srv786413325:85 , srv80456158:85 , srv820778608:85 , srv91501441:85 , srv915277635:85 , srv955050964:85 , srv975997952:85 , srv1195976063:86 , srv1368448247:86 , srv1462702235:86 , srv1536085923:86 , srv1649800346:86 , srv1655083526:86 , srv1777756003:86 , srv1999752958:86 , srv525168945:86 , srv673066535:86 , srv1091553461:87 , srv1842558014:87 , srv2039023992:87 , srv206860258:87 , srv2088450365:87 , srv2097595483:87 , srv2112896269:87 , srv587076939:87 , srv604590271:87 , srv782609151:87 , srv784604958:87 , srv911620936:87 , srv939626138:87 , srv1046954352:88 , srv1213047955:88 , srv157256720:88 , srv177651150:88 , srv1958745310:88 , srv198239515:88 , srv231502507:88 , srv386728944:88 , srv585033456:88 , srv652261429:88 , srv862715173:88 , srv962269706:88 , srv979839276:88 , srv1019050371:89 , srv1119619991:89 , srv1169730909:89 , srv1730338995:89 , srv1262910504:90 , srv1970273697:90 , srv207270893:90 , srv630770643:90 , srv1514836098:91 , srv1748049277:91 , srv994858526:91 , srv1136813798:92 , srv1390038661:92 , srv1793407908:92 , srv629630180:95 , srv1153582808:459 }
2023-05-30 19:53:21,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-30 19:53:21,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1931291584=46, srv319183148=62, srv1091553461=5, srv936162779=93, srv1046954352=1, srv652261429=81, srv1655083526=32, srv1808958191=41, srv1643000717=29, srv955050964=95, srv1958745310=47, srv1874292142=44, srv1136813798=8, srv2105694069=57, srv1119619991=6, srv629630180=76, srv1725658782=34, srv1730338995=35, srv207270893=53, srv1195976063=13, srv2039023992=51, srv1415624956=21, srv1491044156=23, srv868442050=89, srv1854274560=43, srv621541168=75, srv1793407908=40, srv2097595483=55, srv502867243=66, srv673066535=82, srv379246304=63, srv630770643=77, srv994858526=99, srv1343964694=18, srv1970273697=48, srv91501441=91, srv782609151=83, srv962269706=96, srv177651150=38, srv2112896269=58, srv231502507=60, srv1154276321=11, srv1571200167=26, srv979839276=98, srv499631508=65, srv1462702235=22, srv1536085923=25, srv1999752958=50, srv1139436582=9, srv213686171=59, srv915277635=92, srv1748049277=36, srv206860258=52, srv1777756003=39, srv1169730909=12, srv1842558014=42, srv1703601434=33, srv1301728219=17, srv1883522399=45, srv651629425=78, srv2088450365=54, srv1602991061=28, srv554103346=69, srv651783121=79, srv1130758014=7, srv386728944=64, srv1213047955=14, srv784604958=84, srv587076939=71, srv80456158=86, srv1262910504=16, srv198239515=49, srv1019050371=0, srv107626250=4, srv786413325=85, srv604590271=73, srv1368448247=19, srv862715173=88, srv604096864=72, srv157256720=27, srv651856095=80, srv1047536055=2, srv60570015=74, srv1153582808=10, srv585033456=70, srv510982382=67, srv911620936=90, srv1242257397=15, srv2104994169=56, srv25252612=61, srv975997952=97, srv820778608=87, srv1057190309=3, srv1390038661=20, srv1753047965=37, srv1514836098=24, srv1643206039=30, srv1649800346=31, srv525168945=68, srv939626138=94} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-30 19:53:21,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-30 19:53:21,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-30 19:53:21,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-30 19:53:21,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-30 19:53:21,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-30 19:53:21,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-30 19:53:21,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-30 19:53:21,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-30 19:53:21,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-30 19:53:21,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-30 19:53:21,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-30 19:53:21,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-30 19:53:21,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-30 19:53:21,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-30 19:53:21,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-30 19:53:21,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-30 19:53:21,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-30 19:53:21,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-30 19:53:21,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-30 19:53:21,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-30 19:53:21,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-30 19:53:21,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-30 19:53:21,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-30 19:53:21,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-30 19:53:21,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-30 19:53:21,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-30 19:53:21,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-30 19:53:21,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-30 19:53:21,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-30 19:53:21,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-30 19:53:21,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-30 19:53:21,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-30 19:53:21,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-30 19:53:21,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-30 19:53:21,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-30 19:53:21,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-30 19:53:21,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-30 19:53:21,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-30 19:53:21,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-30 19:53:21,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-30 19:53:21,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-30 19:53:21,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-30 19:53:21,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-30 19:53:21,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-30 19:53:21,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-30 19:53:21,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-30 19:53:21,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-30 19:53:21,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-30 19:53:21,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-30 19:53:21,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-30 19:53:21,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-30 19:53:21,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-30 19:53:21,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-30 19:53:21,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-30 19:53:21,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-30 19:53:21,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-30 19:53:21,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-30 19:53:21,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-30 19:53:21,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-30 19:53:21,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-30 19:53:21,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-30 19:53:21,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-30 19:53:21,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-30 19:53:21,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-30 19:53:21,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-30 19:53:21,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-30 19:53:21,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-30 19:53:21,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-30 19:53:21,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-30 19:53:21,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-30 19:53:21,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-30 19:53:21,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-30 19:53:21,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-30 19:53:21,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-30 19:53:21,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-30 19:53:21,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-30 19:53:21,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-30 19:53:21,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-30 19:53:21,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-30 19:53:21,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-30 19:53:21,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-30 19:53:21,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-30 19:53:21,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-30 19:53:21,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-30 19:53:21,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-30 19:53:21,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-30 19:53:21,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-30 19:53:21,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-30 19:53:21,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-30 19:53:21,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-30 19:53:21,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-30 19:53:21,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-30 19:53:21,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-30 19:53:21,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-30 19:53:21,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-30 19:53:21,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-30 19:53:21,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-30 19:53:21,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-30 19:53:21,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-30 19:53:21,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-30 19:53:21,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-30 19:53:21,391 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.041503721791652876, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05473125854735417, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.041503721791652876, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17216666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.242, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-30 19:53:21,392 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-30 19:53:21,392 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.1772305408599339, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.041503721791652876, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05473125854735417, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.041503721791652876, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17216666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.242, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-30 19:53:21,745 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 458 ms to try 5000 different iterations.  Found a solution that moves 2656 regions; Going from a computed imbalance of 0.1772305408599339 to a new imbalance of 0.01565068726780455. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020940000034540697); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.028658757032671324, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2951111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020940000034540697); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012416666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04691666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-30 19:53:21,760 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv629630180:76 , srv1748049277:79 , srv1136813798:80 , srv1262910504:80 , srv994858526:80 , srv1169730909:81 , srv630770643:81 , srv1213047955:82 , srv1390038661:82 , srv1514836098:82 , srv1793407908:82 , srv1019050371:83 , srv1091553461:83 , srv1119619991:83 , srv177651150:83 , srv198239515:83 , srv207270893:83 , srv585033456:83 , srv939626138:83 , srv979839276:83 , srv1970273697:84 , srv1999752958:84 , srv2039023992:84 , srv1046954352:85 , srv107626250:85 , srv157256720:85 , srv1777756003:85 , srv1842558014:85 , srv1958745310:85 , srv206860258:85 , srv2088450365:85 , srv2097595483:85 , srv2112896269:85 , srv231502507:85 , srv525168945:85 , srv587076939:85 , srv604590271:85 , srv786413325:85 , srv862715173:85 , srv962269706:85 , srv1195976063:86 , srv1368448247:86 , srv1536085923:86 , srv1643000717:86 , srv1931291584:86 , srv379246304:86 , srv784604958:86 , srv911620936:86 , srv1047536055:87 , srv1057190309:87 , srv1130758014:87 , srv1139436582:87 , srv1301728219:87 , srv1462702235:87 , srv1491044156:87 , srv1602991061:87 , srv1655083526:87 , srv1730338995:87 , srv1753047965:87 , srv1854274560:87 , srv1874292142:87 , srv1883522399:87 , srv213686171:87 , srv510982382:87 , srv554103346:87 , srv604096864:87 , srv621541168:87 , srv651629425:87 , srv651856095:87 , srv652261429:87 , srv673066535:87 , srv782609151:87 , srv80456158:87 , srv955050964:87 , srv1154276321:88 , srv1242257397:88 , srv1571200167:88 , srv1643206039:88 , srv1725658782:88 , srv25252612:88 , srv499631508:88 , srv502867243:88 , srv60570015:88 , srv651783121:88 , srv91501441:88 , srv975997952:88 , srv1343964694:89 , srv1415624956:89 , srv1649800346:89 , srv1703601434:89 , srv1808958191:89 , srv2105694069:89 , srv820778608:89 , srv915277635:89 , srv319183148:90 , srv386728944:90 , srv868442050:90 , srv2104994169:91 , srv936162779:91 , srv1153582808:501 }
2023-05-30 19:53:21,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-30 19:53:21,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1931291584=46, srv319183148=62, srv1091553461=5, srv936162779=93, srv1046954352=1, srv652261429=81, srv1655083526=32, srv1808958191=41, srv1643000717=29, srv955050964=95, srv1958745310=47, srv1874292142=44, srv1136813798=8, srv2105694069=57, srv1119619991=6, srv629630180=76, srv1725658782=34, srv1730338995=35, srv207270893=53, srv1195976063=13, srv2039023992=51, srv1415624956=21, srv1491044156=23, srv868442050=89, srv1854274560=43, srv621541168=75, srv1793407908=40, srv2097595483=55, srv502867243=66, srv673066535=82, srv379246304=63, srv630770643=77, srv994858526=99, srv1343964694=18, srv1970273697=48, srv91501441=91, srv782609151=83, srv962269706=96, srv177651150=38, srv2112896269=58, srv231502507=60, srv1154276321=11, srv1571200167=26, srv979839276=98, srv499631508=65, srv1462702235=22, srv1536085923=25, srv1999752958=50, srv1139436582=9, srv213686171=59, srv915277635=92, srv1748049277=36, srv206860258=52, srv1777756003=39, srv1169730909=12, srv1842558014=42, srv1703601434=33, srv1301728219=17, srv1883522399=45, srv651629425=78, srv2088450365=54, srv1602991061=28, srv554103346=69, srv651783121=79, srv1130758014=7, srv386728944=64, srv1213047955=14, srv784604958=84, srv587076939=71, srv80456158=86, srv1262910504=16, srv198239515=49, srv1019050371=0, srv107626250=4, srv786413325=85, srv604590271=73, srv1368448247=19, srv862715173=88, srv604096864=72, srv157256720=27, srv651856095=80, srv1047536055=2, srv60570015=74, srv1153582808=10, srv585033456=70, srv510982382=67, srv911620936=90, srv1242257397=15, srv2104994169=56, srv25252612=61, srv975997952=97, srv820778608=87, srv1057190309=3, srv1390038661=20, srv1753047965=37, srv1514836098=24, srv1643206039=30, srv1649800346=31, srv525168945=68, srv939626138=94} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-30 19:53:21,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-30 19:53:21,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-30 19:53:21,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-30 19:53:21,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-30 19:53:21,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-30 19:53:21,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-30 19:53:21,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-30 19:53:21,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-30 19:53:21,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-30 19:53:21,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-30 19:53:21,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-30 19:53:21,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-30 19:53:21,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-30 19:53:21,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-30 19:53:21,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-30 19:53:21,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-30 19:53:21,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-30 19:53:21,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-30 19:53:21,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-30 19:53:21,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-30 19:53:21,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-30 19:53:21,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-30 19:53:21,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-30 19:53:21,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-30 19:53:21,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-30 19:53:21,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-30 19:53:21,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-30 19:53:21,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-30 19:53:21,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-30 19:53:21,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-30 19:53:21,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-30 19:53:21,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-30 19:53:21,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-30 19:53:21,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-30 19:53:21,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-30 19:53:21,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-30 19:53:21,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-30 19:53:21,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-30 19:53:21,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-30 19:53:21,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-30 19:53:21,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-30 19:53:21,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-30 19:53:21,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-30 19:53:21,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-30 19:53:21,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-30 19:53:21,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-30 19:53:21,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-30 19:53:21,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-30 19:53:21,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-30 19:53:21,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-30 19:53:21,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-30 19:53:21,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-30 19:53:21,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-30 19:53:21,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-30 19:53:21,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-30 19:53:21,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-30 19:53:21,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-30 19:53:21,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-30 19:53:21,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-30 19:53:21,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-30 19:53:21,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-30 19:53:21,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-30 19:53:21,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-30 19:53:21,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-30 19:53:21,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-30 19:53:21,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-30 19:53:21,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-30 19:53:21,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-30 19:53:21,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-30 19:53:21,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-30 19:53:21,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-30 19:53:21,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-30 19:53:21,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-30 19:53:21,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-30 19:53:21,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-30 19:53:21,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-30 19:53:21,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-30 19:53:21,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-30 19:53:21,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-30 19:53:21,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-30 19:53:21,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-30 19:53:21,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-30 19:53:21,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-30 19:53:21,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-30 19:53:21,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-30 19:53:21,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-30 19:53:21,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-30 19:53:21,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-30 19:53:21,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-30 19:53:21,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-30 19:53:21,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-30 19:53:21,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-30 19:53:21,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-30 19:53:21,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-30 19:53:21,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-30 19:53:21,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-30 19:53:21,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-30 19:53:21,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-30 19:53:21,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-30 19:53:21,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-30 19:53:21,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-30 19:53:21,919 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020940000034540697); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.028658757032671324, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020940000034540697); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012416666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04691666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-30 19:53:21,919 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-30 19:53:21,919 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.015632089558307735, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020940000034540697); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.028658757032671324, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020940000034540697); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012416666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04691666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-30 19:53:22,225 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 407 ms to try 5000 different iterations.  Found a solution that moves 1013 regions; Going from a computed imbalance of 0.015632089558307735 to a new imbalance of 6.523050005078871E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004090874450810096); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00562581830935124); MoveCostFunction : (multiplier=7.0, imbalance=0.11255555555555556, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.004090874450810096); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004166666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-30 19:53:22,228 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv386728944:79 , srv1649800346:82 , srv1730338995:82 , srv1390038661:83 , srv1703601434:83 , srv1793407908:83 , srv1970273697:83 , srv652261429:83 , srv868442050:83 , srv915277635:83 , srv936162779:83 , srv1415624956:84 , srv1514836098:84 , srv1643206039:84 , srv1655083526:84 , srv1725658782:84 , srv1808958191:84 , srv319183148:84 , srv782609151:84 , srv784604958:84 , srv820778608:84 , srv862715173:84 , srv1046954352:85 , srv1057190309:85 , srv1119619991:85 , srv1136813798:85 , srv1154276321:85 , srv1343964694:85 , srv1462702235:85 , srv1536085923:85 , srv157256720:85 , srv1874292142:85 , srv1958745310:85 , srv2097595483:85 , srv2104994169:85 , srv2105694069:85 , srv2112896269:85 , srv231502507:85 , srv510982382:85 , srv60570015:85 , srv621541168:85 , srv673066535:85 , srv80456158:85 , srv91501441:85 , srv962269706:85 , srv975997952:85 , srv1019050371:86 , srv1047536055:86 , srv1130758014:86 , srv1195976063:86 , srv1242257397:86 , srv1301728219:86 , srv1368448247:86 , srv1491044156:86 , srv1643000717:86 , srv177651150:86 , srv1842558014:86 , srv2039023992:86 , srv206860258:86 , srv207270893:86 , srv2088450365:86 , srv25252612:86 , srv499631508:86 , srv554103346:86 , srv587076939:86 , srv604096864:86 , srv604590271:86 , srv629630180:86 , srv651629425:86 , srv651783121:86 , srv911620936:86 , srv955050964:86 , srv994858526:86 , srv1091553461:87 , srv1139436582:87 , srv1213047955:87 , srv1571200167:87 , srv1753047965:87 , srv1777756003:87 , srv1854274560:87 , srv1883522399:87 , srv198239515:87 , srv502867243:87 , srv525168945:87 , srv585033456:87 , srv630770643:87 , srv651856095:87 , srv786413325:87 , srv979839276:87 , srv107626250:88 , srv1169730909:88 , srv1262910504:88 , srv1602991061:88 , srv1748049277:88 , srv1931291584:88 , srv1999752958:88 , srv213686171:88 , srv939626138:88 , srv379246304:89 , srv1153582808:534 }
2023-05-30 19:53:22,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-30 19:53:22,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1931291584=46, srv319183148=62, srv1091553461=5, srv936162779=93, srv1046954352=1, srv652261429=81, srv1655083526=32, srv1808958191=41, srv1643000717=29, srv955050964=95, srv1958745310=47, srv1874292142=44, srv1136813798=8, srv2105694069=57, srv1119619991=6, srv629630180=76, srv1725658782=34, srv1730338995=35, srv207270893=53, srv1195976063=13, srv2039023992=51, srv1415624956=21, srv1491044156=23, srv868442050=89, srv1854274560=43, srv621541168=75, srv1793407908=40, srv2097595483=55, srv502867243=66, srv673066535=82, srv379246304=63, srv630770643=77, srv994858526=99, srv1343964694=18, srv1970273697=48, srv91501441=91, srv782609151=83, srv962269706=96, srv177651150=38, srv2112896269=58, srv231502507=60, srv1154276321=11, srv1571200167=26, srv979839276=98, srv499631508=65, srv1462702235=22, srv1536085923=25, srv1999752958=50, srv1139436582=9, srv213686171=59, srv915277635=92, srv1748049277=36, srv206860258=52, srv1777756003=39, srv1169730909=12, srv1842558014=42, srv1703601434=33, srv1301728219=17, srv1883522399=45, srv651629425=78, srv2088450365=54, srv1602991061=28, srv554103346=69, srv651783121=79, srv1130758014=7, srv386728944=64, srv1213047955=14, srv784604958=84, srv587076939=71, srv80456158=86, srv1262910504=16, srv198239515=49, srv1019050371=0, srv107626250=4, srv786413325=85, srv604590271=73, srv1368448247=19, srv862715173=88, srv604096864=72, srv157256720=27, srv651856095=80, srv1047536055=2, srv60570015=74, srv1153582808=10, srv585033456=70, srv510982382=67, srv911620936=90, srv1242257397=15, srv2104994169=56, srv25252612=61, srv975997952=97, srv820778608=87, srv1057190309=3, srv1390038661=20, srv1753047965=37, srv1514836098=24, srv1643206039=30, srv1649800346=31, srv525168945=68, srv939626138=94} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-30 19:53:22,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-30 19:53:22,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-30 19:53:22,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-30 19:53:22,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-30 19:53:22,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-30 19:53:22,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-30 19:53:22,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-30 19:53:22,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-30 19:53:22,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-30 19:53:22,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-30 19:53:22,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-30 19:53:22,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-30 19:53:22,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-30 19:53:22,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-30 19:53:22,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-30 19:53:22,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-30 19:53:22,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-30 19:53:22,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-30 19:53:22,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-30 19:53:22,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-30 19:53:22,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-30 19:53:22,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-30 19:53:22,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-30 19:53:22,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-30 19:53:22,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-30 19:53:22,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-30 19:53:22,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-30 19:53:22,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-30 19:53:22,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-30 19:53:22,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-30 19:53:22,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-30 19:53:22,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-30 19:53:22,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-30 19:53:22,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-30 19:53:22,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-30 19:53:22,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-30 19:53:22,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-30 19:53:22,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-30 19:53:22,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-30 19:53:22,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-30 19:53:22,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-30 19:53:22,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-30 19:53:22,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-30 19:53:22,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-30 19:53:22,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-30 19:53:22,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-30 19:53:22,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-30 19:53:22,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-30 19:53:22,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-30 19:53:22,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-30 19:53:22,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-30 19:53:22,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-30 19:53:22,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-30 19:53:22,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-30 19:53:22,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-30 19:53:22,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-30 19:53:22,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-30 19:53:22,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-30 19:53:22,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-30 19:53:22,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-30 19:53:22,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-30 19:53:22,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-30 19:53:22,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-30 19:53:22,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-30 19:53:22,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-30 19:53:22,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-30 19:53:22,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-30 19:53:22,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-30 19:53:22,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-30 19:53:22,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-30 19:53:22,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-30 19:53:22,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-30 19:53:22,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-30 19:53:22,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-30 19:53:22,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-30 19:53:22,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-30 19:53:22,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-30 19:53:22,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-30 19:53:22,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-30 19:53:22,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-30 19:53:22,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-30 19:53:22,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-30 19:53:22,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-30 19:53:22,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-30 19:53:22,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-30 19:53:22,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-30 19:53:22,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-30 19:53:22,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-30 19:53:22,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-30 19:53:22,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-30 19:53:22,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-30 19:53:22,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-30 19:53:22,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-30 19:53:22,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-30 19:53:22,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-30 19:53:22,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-30 19:53:22,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-30 19:53:22,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-30 19:53:22,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-30 19:53:22,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-30 19:53:22,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-30 19:53:22,358 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004090874450810096); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00562581830935124); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.004090874450810096); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004166666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-30 19:53:22,358 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-30 19:53:22,358 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=6.452118229023622E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004090874450810096); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00562581830935124); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.004090874450810096); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004166666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-30 19:53:22,757 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 496 ms to try 5000 different iterations.  Found a solution that moves 209 regions; Going from a computed imbalance of 6.452118229023622E-4 to a new imbalance of 3.4201870245877876E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.5313429231318235E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.02322222222222222); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.5313429231318235E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-30 19:53:22,758 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1139436582:83 , srv1602991061:83 , srv207270893:83 , srv25252612:83 , srv379246304:83 , srv585033456:83 , srv673066535:83 , srv911620936:83 , srv1019050371:84 , srv1046954352:84 , srv107626250:84 , srv1119619991:84 , srv1130758014:84 , srv1195976063:84 , srv1242257397:84 , srv1262910504:84 , srv1343964694:84 , srv1368448247:84 , srv1415624956:84 , srv1462702235:84 , srv1571200167:84 , srv157256720:84 , srv1730338995:84 , srv1748049277:84 , srv1753047965:84 , srv1777756003:84 , srv1842558014:84 , srv1931291584:84 , srv1958745310:84 , srv198239515:84 , srv1999752958:84 , srv206860258:84 , srv2088450365:84 , srv213686171:84 , srv231502507:84 , srv319183148:84 , srv499631508:84 , srv502867243:84 , srv525168945:84 , srv554103346:84 , srv587076939:84 , srv604590271:84 , srv60570015:84 , srv630770643:84 , srv651629425:84 , srv651856095:84 , srv652261429:84 , srv782609151:84 , srv80456158:84 , srv820778608:84 , srv91501441:84 , srv936162779:84 , srv939626138:84 , srv955050964:84 , srv962269706:84 , srv975997952:84 , srv979839276:84 , srv1047536055:85 , srv1057190309:85 , srv1091553461:85 , srv1136813798:85 , srv1154276321:85 , srv1169730909:85 , srv1213047955:85 , srv1301728219:85 , srv1390038661:85 , srv1514836098:85 , srv1536085923:85 , srv1643000717:85 , srv1643206039:85 , srv1649800346:85 , srv1655083526:85 , srv1703601434:85 , srv1725658782:85 , srv177651150:85 , srv1793407908:85 , srv1808958191:85 , srv1854274560:85 , srv1874292142:85 , srv1883522399:85 , srv1970273697:85 , srv2039023992:85 , srv2097595483:85 , srv2104994169:85 , srv2105694069:85 , srv2112896269:85 , srv386728944:85 , srv510982382:85 , srv604096864:85 , srv621541168:85 , srv629630180:85 , srv651783121:85 , srv784604958:85 , srv786413325:85 , srv868442050:85 , srv915277635:85 , srv994858526:85 , srv1491044156:86 , srv862715173:86 , srv1153582808:648 }
2023-05-30 19:53:22,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-30 19:53:22,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1931291584=46, srv319183148=62, srv1091553461=5, srv936162779=93, srv1046954352=1, srv652261429=81, srv1655083526=32, srv1808958191=41, srv1643000717=29, srv955050964=95, srv1958745310=47, srv1874292142=44, srv1136813798=8, srv2105694069=57, srv1119619991=6, srv629630180=76, srv1725658782=34, srv1730338995=35, srv207270893=53, srv1195976063=13, srv2039023992=51, srv1415624956=21, srv1491044156=23, srv868442050=89, srv1854274560=43, srv621541168=75, srv1793407908=40, srv2097595483=55, srv502867243=66, srv673066535=82, srv379246304=63, srv630770643=77, srv994858526=99, srv1343964694=18, srv1970273697=48, srv91501441=91, srv782609151=83, srv962269706=96, srv177651150=38, srv2112896269=58, srv231502507=60, srv1154276321=11, srv1571200167=26, srv979839276=98, srv499631508=65, srv1462702235=22, srv1536085923=25, srv1999752958=50, srv1139436582=9, srv213686171=59, srv915277635=92, srv1748049277=36, srv206860258=52, srv1777756003=39, srv1169730909=12, srv1842558014=42, srv1703601434=33, srv1301728219=17, srv1883522399=45, srv651629425=78, srv2088450365=54, srv1602991061=28, srv554103346=69, srv651783121=79, srv1130758014=7, srv386728944=64, srv1213047955=14, srv784604958=84, srv587076939=71, srv80456158=86, srv1262910504=16, srv198239515=49, srv1019050371=0, srv107626250=4, srv786413325=85, srv604590271=73, srv1368448247=19, srv862715173=88, srv604096864=72, srv157256720=27, srv651856095=80, srv1047536055=2, srv60570015=74, srv1153582808=10, srv585033456=70, srv510982382=67, srv911620936=90, srv1242257397=15, srv2104994169=56, srv25252612=61, srv975997952=97, srv820778608=87, srv1057190309=3, srv1390038661=20, srv1753047965=37, srv1514836098=24, srv1643206039=30, srv1649800346=31, srv525168945=68, srv939626138=94} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-30 19:53:22,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-30 19:53:22,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-30 19:53:22,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-30 19:53:22,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-30 19:53:22,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-30 19:53:22,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-30 19:53:22,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-30 19:53:22,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-30 19:53:22,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-30 19:53:22,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-30 19:53:22,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-30 19:53:22,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-30 19:53:22,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-30 19:53:22,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-30 19:53:22,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-30 19:53:22,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-30 19:53:22,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-30 19:53:22,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-30 19:53:22,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-30 19:53:22,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-30 19:53:22,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-30 19:53:22,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-30 19:53:22,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-30 19:53:22,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-30 19:53:22,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-30 19:53:22,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-30 19:53:22,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-30 19:53:22,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-30 19:53:22,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-30 19:53:22,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-30 19:53:22,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-30 19:53:22,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-30 19:53:22,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-30 19:53:22,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-30 19:53:22,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-30 19:53:22,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-30 19:53:22,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-30 19:53:22,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-30 19:53:22,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-30 19:53:22,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-30 19:53:22,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-30 19:53:22,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-30 19:53:22,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-30 19:53:22,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-30 19:53:22,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-30 19:53:22,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-30 19:53:22,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-30 19:53:22,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-30 19:53:22,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-30 19:53:22,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-30 19:53:22,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-30 19:53:22,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-30 19:53:22,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-30 19:53:22,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-30 19:53:22,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-30 19:53:22,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-30 19:53:22,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-30 19:53:22,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-30 19:53:22,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-30 19:53:22,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-30 19:53:22,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-30 19:53:22,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-30 19:53:22,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-30 19:53:22,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-30 19:53:22,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-30 19:53:22,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-30 19:53:22,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-30 19:53:22,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-30 19:53:22,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-30 19:53:22,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-30 19:53:22,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-30 19:53:22,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-30 19:53:22,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-30 19:53:22,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-30 19:53:22,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-30 19:53:22,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-30 19:53:22,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-30 19:53:22,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-30 19:53:22,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-30 19:53:22,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-30 19:53:22,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-30 19:53:22,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-30 19:53:22,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-30 19:53:22,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-30 19:53:22,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-30 19:53:22,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-30 19:53:22,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-30 19:53:22,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-30 19:53:22,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-30 19:53:22,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-30 19:53:22,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-30 19:53:22,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-30 19:53:22,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-30 19:53:22,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-30 19:53:22,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-30 19:53:22,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-30 19:53:22,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-30 19:53:22,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-30 19:53:22,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-30 19:53:22,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-30 19:53:22,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-30 19:53:22,895 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.5313429231318235E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.5313429231318235E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-30 19:53:22,895 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-30 19:53:22,895 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=3.2738420966949244E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.5313429231318235E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.5313429231318235E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-30 19:53:23,149 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 354 ms to try 5000 different iterations.  Found a solution that moves 22 regions; Going from a computed imbalance of 3.2738420966949244E-5 to a new imbalance of 7.541804792831362E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0016412198797244363); MoveCostFunction : (multiplier=7.0, imbalance=0.0024444444444444444); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-30 19:53:23,150 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1169730909:83 , srv1491044156:83 , srv1854274560:83 , srv651783121:83 , srv862715173:83 , srv1019050371:84 , srv1046954352:84 , srv1047536055:84 , srv1057190309:84 , srv107626250:84 , srv1091553461:84 , srv1130758014:84 , srv1136813798:84 , srv1139436582:84 , srv1154276321:84 , srv1195976063:84 , srv1213047955:84 , srv1242257397:84 , srv1262910504:84 , srv1301728219:84 , srv1343964694:84 , srv1368448247:84 , srv1390038661:84 , srv1415624956:84 , srv1462702235:84 , srv1514836098:84 , srv1536085923:84 , srv1571200167:84 , srv157256720:84 , srv1602991061:84 , srv1643000717:84 , srv1643206039:84 , srv1649800346:84 , srv1655083526:84 , srv1703601434:84 , srv1725658782:84 , srv1730338995:84 , srv1748049277:84 , srv1753047965:84 , srv177651150:84 , srv1777756003:84 , srv1793407908:84 , srv1808958191:84 , srv1842558014:84 , srv1874292142:84 , srv1883522399:84 , srv1931291584:84 , srv1958745310:84 , srv1970273697:84 , srv198239515:84 , srv1999752958:84 , srv2039023992:84 , srv206860258:84 , srv207270893:84 , srv2088450365:84 , srv2097595483:84 , srv2104994169:84 , srv2105694069:84 , srv2112896269:84 , srv213686171:84 , srv231502507:84 , srv25252612:84 , srv319183148:84 , srv386728944:84 , srv499631508:84 , srv502867243:84 , srv510982382:84 , srv525168945:84 , srv554103346:84 , srv587076939:84 , srv604096864:84 , srv604590271:84 , srv60570015:84 , srv621541168:84 , srv629630180:84 , srv630770643:84 , srv651629425:84 , srv651856095:84 , srv652261429:84 , srv782609151:84 , srv784604958:84 , srv786413325:84 , srv820778608:84 , srv868442050:84 , srv911620936:84 , srv91501441:84 , srv915277635:84 , srv936162779:84 , srv939626138:84 , srv955050964:84 , srv962269706:84 , srv975997952:84 , srv979839276:84 , srv994858526:84 , srv1119619991:85 , srv379246304:85 , srv585033456:85 , srv673066535:85 , srv80456158:85 , srv1153582808:684 }
2023-05-30 19:53:23,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-30 19:53:23,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1931291584=46, srv319183148=62, srv1091553461=5, srv936162779=93, srv1046954352=1, srv652261429=81, srv1655083526=32, srv1808958191=41, srv1643000717=29, srv955050964=95, srv1958745310=47, srv1874292142=44, srv1136813798=8, srv2105694069=57, srv1119619991=6, srv629630180=76, srv1725658782=34, srv1730338995=35, srv207270893=53, srv1195976063=13, srv2039023992=51, srv1415624956=21, srv1491044156=23, srv868442050=89, srv1854274560=43, srv621541168=75, srv1793407908=40, srv2097595483=55, srv502867243=66, srv673066535=82, srv379246304=63, srv630770643=77, srv994858526=99, srv1343964694=18, srv1970273697=48, srv91501441=91, srv782609151=83, srv962269706=96, srv177651150=38, srv2112896269=58, srv231502507=60, srv1154276321=11, srv1571200167=26, srv979839276=98, srv499631508=65, srv1462702235=22, srv1536085923=25, srv1999752958=50, srv1139436582=9, srv213686171=59, srv915277635=92, srv1748049277=36, srv206860258=52, srv1777756003=39, srv1169730909=12, srv1842558014=42, srv1703601434=33, srv1301728219=17, srv1883522399=45, srv651629425=78, srv2088450365=54, srv1602991061=28, srv554103346=69, srv651783121=79, srv1130758014=7, srv386728944=64, srv1213047955=14, srv784604958=84, srv587076939=71, srv80456158=86, srv1262910504=16, srv198239515=49, srv1019050371=0, srv107626250=4, srv786413325=85, srv604590271=73, srv1368448247=19, srv862715173=88, srv604096864=72, srv157256720=27, srv651856095=80, srv1047536055=2, srv60570015=74, srv1153582808=10, srv585033456=70, srv510982382=67, srv911620936=90, srv1242257397=15, srv2104994169=56, srv25252612=61, srv975997952=97, srv820778608=87, srv1057190309=3, srv1390038661=20, srv1753047965=37, srv1514836098=24, srv1643206039=30, srv1649800346=31, srv525168945=68, srv939626138=94} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-30 19:53:23,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-30 19:53:23,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-30 19:53:23,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-30 19:53:23,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-30 19:53:23,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-30 19:53:23,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-30 19:53:23,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-30 19:53:23,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-30 19:53:23,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-30 19:53:23,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-30 19:53:23,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-30 19:53:23,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-30 19:53:23,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-30 19:53:23,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-30 19:53:23,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-30 19:53:23,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-30 19:53:23,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-30 19:53:23,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-30 19:53:23,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-30 19:53:23,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-30 19:53:23,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-30 19:53:23,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-30 19:53:23,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-30 19:53:23,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-30 19:53:23,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-30 19:53:23,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-30 19:53:23,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-30 19:53:23,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-30 19:53:23,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-30 19:53:23,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-30 19:53:23,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-30 19:53:23,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-30 19:53:23,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-30 19:53:23,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-30 19:53:23,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-30 19:53:23,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-30 19:53:23,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-30 19:53:23,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-30 19:53:23,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-30 19:53:23,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-30 19:53:23,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-30 19:53:23,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-30 19:53:23,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-30 19:53:23,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-30 19:53:23,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-30 19:53:23,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-30 19:53:23,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-30 19:53:23,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-30 19:53:23,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-30 19:53:23,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-30 19:53:23,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-30 19:53:23,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-30 19:53:23,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-30 19:53:23,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-30 19:53:23,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-30 19:53:23,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-30 19:53:23,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-30 19:53:23,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-30 19:53:23,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-30 19:53:23,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-30 19:53:23,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-30 19:53:23,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-30 19:53:23,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-30 19:53:23,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-30 19:53:23,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-30 19:53:23,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-30 19:53:23,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-30 19:53:23,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-30 19:53:23,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-30 19:53:23,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-30 19:53:23,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-30 19:53:23,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-30 19:53:23,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-30 19:53:23,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-30 19:53:23,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-30 19:53:23,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-30 19:53:23,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-30 19:53:23,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-30 19:53:23,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-30 19:53:23,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-30 19:53:23,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-30 19:53:23,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-30 19:53:23,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-30 19:53:23,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-30 19:53:23,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-30 19:53:23,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-30 19:53:23,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-30 19:53:23,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-30 19:53:23,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-30 19:53:23,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-30 19:53:23,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-30 19:53:23,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-30 19:53:23,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-30 19:53:23,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-30 19:53:23,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-30 19:53:23,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-30 19:53:23,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-30 19:53:23,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-30 19:53:23,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-30 19:53:23,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-30 19:53:23,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-30 19:53:23,293 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.387757500312559E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0016412198797244363); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-30 19:53:23,293 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1169730909:83 , srv1491044156:83 , srv1854274560:83 , srv651783121:83 , srv862715173:83 , srv1019050371:84 , srv1046954352:84 , srv1047536055:84 , srv1057190309:84 , srv107626250:84 , srv1091553461:84 , srv1130758014:84 , srv1136813798:84 , srv1139436582:84 , srv1154276321:84 , srv1195976063:84 , srv1213047955:84 , srv1242257397:84 , srv1262910504:84 , srv1301728219:84 , srv1343964694:84 , srv1368448247:84 , srv1390038661:84 , srv1415624956:84 , srv1462702235:84 , srv1514836098:84 , srv1536085923:84 , srv1571200167:84 , srv157256720:84 , srv1602991061:84 , srv1643000717:84 , srv1643206039:84 , srv1649800346:84 , srv1655083526:84 , srv1703601434:84 , srv1725658782:84 , srv1730338995:84 , srv1748049277:84 , srv1753047965:84 , srv177651150:84 , srv1777756003:84 , srv1793407908:84 , srv1808958191:84 , srv1842558014:84 , srv1874292142:84 , srv1883522399:84 , srv1931291584:84 , srv1958745310:84 , srv1970273697:84 , srv198239515:84 , srv1999752958:84 , srv2039023992:84 , srv206860258:84 , srv207270893:84 , srv2088450365:84 , srv2097595483:84 , srv2104994169:84 , srv2105694069:84 , srv2112896269:84 , srv213686171:84 , srv231502507:84 , srv25252612:84 , srv319183148:84 , srv386728944:84 , srv499631508:84 , srv502867243:84 , srv510982382:84 , srv525168945:84 , srv554103346:84 , srv587076939:84 , srv604096864:84 , srv604590271:84 , srv60570015:84 , srv621541168:84 , srv629630180:84 , srv630770643:84 , srv651629425:84 , srv651856095:84 , srv652261429:84 , srv782609151:84 , srv784604958:84 , srv786413325:84 , srv820778608:84 , srv868442050:84 , srv911620936:84 , srv91501441:84 , srv915277635:84 , srv936162779:84 , srv939626138:84 , srv955050964:84 , srv962269706:84 , srv975997952:84 , srv979839276:84 , srv994858526:84 , srv1119619991:85 , srv379246304:85 , srv585033456:85 , srv673066535:85 , srv80456158:85 , srv1153582808:684 }
2023-05-30 19:53:23,320 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=264 (was 264), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=316 (was 316), ProcessCount=172 (was 172), AvailableMemoryMB=3891 (was 4370)
2023-05-30 19:53:23,328 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=264, MaxFileDescriptor=60000, SystemLoadAverage=316, ProcessCount=172, AvailableMemoryMB=3891
2023-05-30 19:53:23,329 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-05-30 19:53:23,329 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-05-30 19:53:23,340 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1028660972:84 , srv1158710533:84 , srv121338623:84 , srv1283487360:84 , srv1295314402:84 , srv1326083978:84 , srv1363040045:84 , srv1448109815:84 , srv1475892518:84 , srv1480214920:84 , srv1569749982:84 , srv1630409246:84 , srv1633140325:84 , srv1745999557:84 , srv1789957605:84 , srv1932542718:84 , srv1996141863:84 , srv2020656613:84 , srv216756771:84 , srv291479332:84 , srv320744761:84 , srv388758717:84 , srv528775372:84 , srv529620019:84 , srv678342479:84 , srv861926195:84 , srv871770852:84 , srv926190722:84 , srv981322893:84 , srv307601511:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-05-30 19:53:23,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-30 19:53:23,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv388758717=22, srv291479332=19, srv528775372=23, srv2020656613=17, srv926190722=28, srv1448109815=7, srv1475892518=8, srv1633140325=12, srv1363040045=6, srv307601511=20, srv1158710533=1, srv1028660972=0, srv216756771=18, srv1326083978=5, srv871770852=27, srv678342479=25, srv320744761=21, srv1569749982=10, srv861926195=26, srv121338623=2, srv1789957605=14, srv529620019=24, srv1932542718=15, srv1996141863=16, srv1630409246=11, srv1745999557=13, srv981322893=29, srv1283487360=3, srv1480214920=9, srv1295314402=4} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-30 19:53:23,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-30 19:53:23,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-30 19:53:23,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-30 19:53:23,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-30 19:53:23,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-30 19:53:23,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-30 19:53:23,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-30 19:53:23,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-30 19:53:23,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-30 19:53:23,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-30 19:53:23,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-30 19:53:23,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-30 19:53:23,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-30 19:53:23,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-30 19:53:23,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-30 19:53:23,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-30 19:53:23,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-30 19:53:23,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-30 19:53:23,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-30 19:53:23,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-30 19:53:23,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-30 19:53:23,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-30 19:53:23,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-30 19:53:23,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-30 19:53:23,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-30 19:53:23,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-30 19:53:23,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-30 19:53:23,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-30 19:53:23,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-30 19:53:23,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-30 19:53:23,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-05-30 19:53:23,374 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1322473366890933, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-30 19:53:23,374 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912609750303915, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1322473366890933, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-05-30 19:55:23,361 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5926553 different iterations.  Found a solution that moves 1872 regions; Going from a computed imbalance of 0.9912609750303915 to a new imbalance of 4.3693413878060563E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6933333333333334, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-30 19:55:23,366 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1028660972:90 , srv1158710533:90 , srv121338623:90 , srv1283487360:90 , srv1295314402:90 , srv1326083978:90 , srv1363040045:90 , srv1448109815:90 , srv1475892518:90 , srv1480214920:90 , srv1569749982:90 , srv1630409246:90 , srv1633140325:90 , srv1745999557:90 , srv1789957605:90 , srv1932542718:90 , srv1996141863:90 , srv2020656613:90 , srv216756771:90 , srv291479332:90 , srv307601511:90 , srv320744761:90 , srv388758717:90 , srv528775372:90 , srv529620019:90 , srv678342479:90 , srv861926195:90 , srv871770852:90 , srv926190722:90 , srv981322893:90 }
2023-05-30 19:55:23,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-30 19:55:23,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv388758717=22, srv291479332=19, srv528775372=23, srv2020656613=17, srv926190722=28, srv1448109815=7, srv1475892518=8, srv1633140325=12, srv1363040045=6, srv307601511=20, srv1158710533=1, srv1028660972=0, srv216756771=18, srv1326083978=5, srv871770852=27, srv678342479=25, srv320744761=21, srv1569749982=10, srv861926195=26, srv121338623=2, srv1789957605=14, srv529620019=24, srv1932542718=15, srv1996141863=16, srv1630409246=11, srv1745999557=13, srv981322893=29, srv1283487360=3, srv1480214920=9, srv1295314402=4} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-30 19:55:23,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-30 19:55:23,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-30 19:55:23,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-30 19:55:23,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-30 19:55:23,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-30 19:55:23,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-30 19:55:23,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-30 19:55:23,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-30 19:55:23,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-30 19:55:23,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-30 19:55:23,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-30 19:55:23,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-30 19:55:23,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-30 19:55:23,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-30 19:55:23,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-30 19:55:23,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-30 19:55:23,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-30 19:55:23,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-30 19:55:23,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-30 19:55:23,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-30 19:55:23,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-30 19:55:23,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-30 19:55:23,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-30 19:55:23,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-30 19:55:23,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-30 19:55:23,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-30 19:55:23,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-30 19:55:23,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-30 19:55:23,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-30 19:55:23,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-30 19:55:23,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-05-30 19:55:23,384 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-30 19:55:23,384 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1028660972:90 , srv1158710533:90 , srv121338623:90 , srv1283487360:90 , srv1295314402:90 , srv1326083978:90 , srv1363040045:90 , srv1448109815:90 , srv1475892518:90 , srv1480214920:90 , srv1569749982:90 , srv1630409246:90 , srv1633140325:90 , srv1745999557:90 , srv1789957605:90 , srv1932542718:90 , srv1996141863:90 , srv2020656613:90 , srv216756771:90 , srv291479332:90 , srv307601511:90 , srv320744761:90 , srv388758717:90 , srv528775372:90 , srv529620019:90 , srv678342479:90 , srv861926195:90 , srv871770852:90 , srv926190722:90 , srv981322893:90 }
2023-05-30 19:55:23,398 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=264 (was 264), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=219 (was 316), ProcessCount=168 (was 172), AvailableMemoryMB=3781 (was 3891)