2023-06-09 00:53:26,300 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-06-09 00:53:26,572 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-06-09 00:53:26,670 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-06-09 00:53:26,725 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-06-09 00:53:26,732 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-06-09 00:53:26,746 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=294, ProcessCount=172, AvailableMemoryMB=11494
2023-06-09 00:53:26,748 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-06-09 00:53:26,748 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-06-09 00:53:26,882 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1006081422:84 , srv1014280211:84 , srv1025046304:84 , srv1105983853:84 , srv110809370:84 , srv1119098830:84 , srv1129930137:84 , srv1133536892:84 , srv1145859290:84 , srv1172137741:84 , srv1183245545:84 , srv1209803467:84 , srv1224765165:84 , srv1241934280:84 , srv1242379342:84 , srv1244727080:84 , srv1288607774:84 , srv1292177631:84 , srv1303206426:84 , srv1369684749:84 , srv13802485:84 , srv1391247135:84 , srv1402889246:84 , srv1404961423:84 , srv1437740946:84 , srv1500327631:84 , srv150581828:84 , srv1510591999:84 , srv1523609382:84 , srv1547880109:84 , srv1560702829:84 , srv1578153985:84 , srv1592985327:84 , srv1596797633:84 , srv1629192883:84 , srv1635245361:84 , srv1676471201:84 , srv1715833586:84 , srv1757146683:84 , srv1764961895:84 , srv1785950514:84 , srv1801319023:84 , srv1849970540:84 , srv187297441:84 , srv1880240514:84 , srv1925344646:84 , srv1962669311:84 , srv198185660:84 , srv2001849705:84 , srv2090470656:84 , srv2108677063:84 , srv2114816147:84 , srv2122952766:84 , srv2133222991:84 , srv217266395:84 , srv220760533:84 , srv22224363:84 , srv230748383:84 , srv238551452:84 , srv267834147:84 , srv267870017:84 , srv282589150:84 , srv30315701:84 , srv308517780:84 , srv339837298:84 , srv355680809:84 , srv374122059:84 , srv400162849:84 , srv412938499:84 , srv42180415:84 , srv424135393:84 , srv429957175:84 , srv431029837:84 , srv431250979:84 , srv447225947:84 , srv451198092:84 , srv457178097:84 , srv467795023:84 , srv490636060:84 , srv496666519:84 , srv578584745:84 , srv585338884:84 , srv592247240:84 , srv6431931:84 , srv671372659:84 , srv671801291:84 , srv685056029:84 , srv685099205:84 , srv706961929:84 , srv723000814:84 , srv733285437:84 , srv757002485:84 , srv819078330:84 , srv856436470:84 , srv902172616:84 , srv934882412:84 , srv935115015:84 , srv960173609:84 , srv996055457:84 , srv430205911:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-06-09 00:53:26,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-06-09 00:53:26,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2133222991=53, srv447225947=75, srv451198092=76, srv1145859290=8, srv1764961895=39, srv2001849705=48, srv960173609=98, srv339837298=64, srv1757146683=38, srv6431931=84, srv1437740946=24, srv1801319023=41, srv1025046304=2, srv412938499=68, srv1172137741=9, srv267834147=59, srv1105983853=3, srv1560702829=30, srv1133536892=7, srv496666519=80, srv585338884=82, srv355680809=65, srv1404961423=23, srv457178097=77, srv671372659=85, srv1849970540=42, srv1676471201=36, srv110809370=4, srv217266395=54, srv856436470=94, srv1500327631=25, srv198185660=47, srv187297441=43, srv2114816147=51, srv592247240=83, srv723000814=90, srv733285437=91, srv1119098830=5, srv308517780=63, srv1129930137=6, srv13802485=20, srv467795023=78, srv1402889246=22, srv1523609382=28, srv1242379342=14, srv1578153985=31, srv400162849=67, srv1596797633=33, srv1014280211=1, srv1715833586=37, srv1183245545=10, srv374122059=66, srv1925344646=45, srv935115015=97, srv424135393=70, srv429957175=71, srv902172616=95, srv1880240514=44, srv2122952766=52, srv1288607774=16, srv1592985327=32, srv578584745=81, srv1006081422=0, srv685056029=87, srv1224765165=12, srv1510591999=27, srv220760533=55, srv934882412=96, srv819078330=93, srv1629192883=34, srv2108677063=50, srv150581828=26, srv42180415=69, srv267870017=60, srv1244727080=15, srv2090470656=49, srv30315701=62, srv430205911=72, srv671801291=86, srv685099205=88, srv1785950514=40, srv1962669311=46, srv1369684749=19, srv431250979=74, srv431029837=73, srv282589150=61, srv996055457=99, srv1391247135=21, srv1547880109=29, srv706961929=89, srv1303206426=18, srv490636060=79, srv238551452=58, srv22224363=56, srv1241934280=13, srv757002485=92, srv1209803467=11, srv1292177631=17, srv1635245361=35, srv230748383=57} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-06-09 00:53:26,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-06-09 00:53:26,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-06-09 00:53:26,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-06-09 00:53:26,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-06-09 00:53:26,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-06-09 00:53:26,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-06-09 00:53:26,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-06-09 00:53:26,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-06-09 00:53:26,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-06-09 00:53:26,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-06-09 00:53:26,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-06-09 00:53:26,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-06-09 00:53:26,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-06-09 00:53:26,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-06-09 00:53:26,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-06-09 00:53:26,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-06-09 00:53:26,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-06-09 00:53:26,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-06-09 00:53:26,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-06-09 00:53:26,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-06-09 00:53:26,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-06-09 00:53:26,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-06-09 00:53:26,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-06-09 00:53:26,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-06-09 00:53:26,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-06-09 00:53:26,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-06-09 00:53:26,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-06-09 00:53:26,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-06-09 00:53:26,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-06-09 00:53:26,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-06-09 00:53:26,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-06-09 00:53:26,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-06-09 00:53:26,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-06-09 00:53:26,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-06-09 00:53:26,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-06-09 00:53:26,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-06-09 00:53:26,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-06-09 00:53:26,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-06-09 00:53:26,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-06-09 00:53:26,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-06-09 00:53:26,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-06-09 00:53:26,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-06-09 00:53:26,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-06-09 00:53:26,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-06-09 00:53:26,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-06-09 00:53:26,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-06-09 00:53:26,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-06-09 00:53:26,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-06-09 00:53:26,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-06-09 00:53:26,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-06-09 00:53:26,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-06-09 00:53:26,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-06-09 00:53:26,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-06-09 00:53:26,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-06-09 00:53:26,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-06-09 00:53:26,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-06-09 00:53:26,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-06-09 00:53:26,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-06-09 00:53:26,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-06-09 00:53:26,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-06-09 00:53:26,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-06-09 00:53:26,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-06-09 00:53:26,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-06-09 00:53:26,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-06-09 00:53:26,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-06-09 00:53:26,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-06-09 00:53:26,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-06-09 00:53:26,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-06-09 00:53:26,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-06-09 00:53:26,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-06-09 00:53:26,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-06-09 00:53:26,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-06-09 00:53:26,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-06-09 00:53:26,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-06-09 00:53:26,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-06-09 00:53:26,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-06-09 00:53:26,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-06-09 00:53:26,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-06-09 00:53:26,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-06-09 00:53:26,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-06-09 00:53:26,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-06-09 00:53:26,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-06-09 00:53:26,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-06-09 00:53:26,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-06-09 00:53:26,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-06-09 00:53:26,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-06-09 00:53:26,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-06-09 00:53:26,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-06-09 00:53:26,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-06-09 00:53:26,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-06-09 00:53:26,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-06-09 00:53:26,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-06-09 00:53:26,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-06-09 00:53:26,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-06-09 00:53:26,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-06-09 00:53:26,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-06-09 00:53:26,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-06-09 00:53:26,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-06-09 00:53:26,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-06-09 00:53:26,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-06-09 00:53:26,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-06-09 00:53:27,156 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-06-09 00:53:27,157 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-06-09 00:53:27,157 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-06-09 00:53:27,519 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 523 ms to try 5000 different iterations.  Found a solution that moves 4680 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18063274728643475. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.039620975171307644, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0569462305706577, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.52, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.039620975171307644, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17583333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24275, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-06-09 00:53:27,553 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv429957175:78 , srv1183245545:82 , srv2122952766:82 , srv2133222991:82 , srv723000814:82 , srv935115015:82 , srv1172137741:83 , srv1244727080:83 , srv1369684749:83 , srv1629192883:83 , srv267834147:83 , srv374122059:83 , srv457178097:83 , srv733285437:83 , srv1224765165:84 , srv1303206426:84 , srv1391247135:84 , srv1510591999:84 , srv1764961895:84 , srv1962669311:84 , srv30315701:84 , srv42180415:84 , srv431029837:84 , srv447225947:84 , srv1119098830:85 , srv1209803467:85 , srv1242379342:85 , srv282589150:85 , srv308517780:85 , srv339837298:85 , srv412938499:85 , srv424135393:85 , srv451198092:85 , srv671372659:85 , srv685056029:85 , srv902172616:85 , srv1025046304:86 , srv110809370:86 , srv1129930137:86 , srv1133536892:86 , srv1241934280:86 , srv1404961423:86 , srv1578153985:86 , srv1635245361:86 , srv1757146683:86 , srv2108677063:86 , srv400162849:86 , srv6431931:86 , srv671801291:86 , srv685099205:86 , srv706961929:86 , srv819078330:86 , srv1014280211:87 , srv1292177631:87 , srv1402889246:87 , srv1676471201:87 , srv187297441:87 , srv198185660:87 , srv2090470656:87 , srv220760533:87 , srv22224363:87 , srv355680809:87 , srv934882412:87 , srv1006081422:88 , srv1105983853:88 , srv150581828:88 , srv1560702829:88 , srv1592985327:88 , srv1801319023:88 , srv230748383:88 , srv490636060:88 , srv496666519:88 , srv585338884:88 , srv856436470:88 , srv960173609:88 , srv1437740946:89 , srv1523609382:89 , srv1547880109:89 , srv1596797633:89 , srv1715833586:89 , srv1785950514:89 , srv1849970540:89 , srv1925344646:89 , srv2001849705:89 , srv2114816147:89 , srv217266395:89 , srv267870017:89 , srv431250979:89 , srv578584745:89 , srv592247240:89 , srv757002485:89 , srv996055457:89 , srv1500327631:90 , srv1288607774:91 , srv238551452:91 , srv1145859290:92 , srv467795023:92 , srv1880240514:93 , srv13802485:95 , srv430205911:442 }
2023-06-09 00:53:27,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-06-09 00:53:27,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2133222991=53, srv447225947=75, srv451198092=76, srv1145859290=8, srv1764961895=39, srv2001849705=48, srv960173609=98, srv339837298=64, srv1757146683=38, srv6431931=84, srv1437740946=24, srv1801319023=41, srv1025046304=2, srv412938499=68, srv1172137741=9, srv267834147=59, srv1105983853=3, srv1560702829=30, srv1133536892=7, srv496666519=80, srv585338884=82, srv355680809=65, srv1404961423=23, srv457178097=77, srv671372659=85, srv1849970540=42, srv1676471201=36, srv110809370=4, srv217266395=54, srv856436470=94, srv1500327631=25, srv198185660=47, srv187297441=43, srv2114816147=51, srv592247240=83, srv723000814=90, srv733285437=91, srv1119098830=5, srv308517780=63, srv1129930137=6, srv13802485=20, srv467795023=78, srv1402889246=22, srv1523609382=28, srv1242379342=14, srv1578153985=31, srv400162849=67, srv1596797633=33, srv1014280211=1, srv1715833586=37, srv1183245545=10, srv374122059=66, srv1925344646=45, srv935115015=97, srv424135393=70, srv429957175=71, srv902172616=95, srv1880240514=44, srv2122952766=52, srv1288607774=16, srv1592985327=32, srv578584745=81, srv1006081422=0, srv685056029=87, srv1224765165=12, srv1510591999=27, srv220760533=55, srv934882412=96, srv819078330=93, srv1629192883=34, srv2108677063=50, srv150581828=26, srv42180415=69, srv267870017=60, srv1244727080=15, srv2090470656=49, srv30315701=62, srv430205911=72, srv671801291=86, srv685099205=88, srv1785950514=40, srv1962669311=46, srv1369684749=19, srv431250979=74, srv431029837=73, srv282589150=61, srv996055457=99, srv1391247135=21, srv1547880109=29, srv706961929=89, srv1303206426=18, srv490636060=79, srv238551452=58, srv22224363=56, srv1241934280=13, srv757002485=92, srv1209803467=11, srv1292177631=17, srv1635245361=35, srv230748383=57} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-06-09 00:53:27,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-06-09 00:53:27,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-06-09 00:53:27,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-06-09 00:53:27,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-06-09 00:53:27,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-06-09 00:53:27,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-06-09 00:53:27,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-06-09 00:53:27,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-06-09 00:53:27,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-06-09 00:53:27,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-06-09 00:53:27,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-06-09 00:53:27,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-06-09 00:53:27,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-06-09 00:53:27,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-06-09 00:53:27,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-06-09 00:53:27,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-06-09 00:53:27,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-06-09 00:53:27,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-06-09 00:53:27,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-06-09 00:53:27,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-06-09 00:53:27,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-06-09 00:53:27,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-06-09 00:53:27,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-06-09 00:53:27,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-06-09 00:53:27,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-06-09 00:53:27,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-06-09 00:53:27,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-06-09 00:53:27,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-06-09 00:53:27,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-06-09 00:53:27,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-06-09 00:53:27,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-06-09 00:53:27,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-06-09 00:53:27,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-06-09 00:53:27,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-06-09 00:53:27,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-06-09 00:53:27,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-06-09 00:53:27,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-06-09 00:53:27,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-06-09 00:53:27,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-06-09 00:53:27,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-06-09 00:53:27,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-06-09 00:53:27,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-06-09 00:53:27,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-06-09 00:53:27,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-06-09 00:53:27,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-06-09 00:53:27,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-06-09 00:53:27,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-06-09 00:53:27,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-06-09 00:53:27,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-06-09 00:53:27,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-06-09 00:53:27,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-06-09 00:53:27,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-06-09 00:53:27,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-06-09 00:53:27,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-06-09 00:53:27,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-06-09 00:53:27,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-06-09 00:53:27,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-06-09 00:53:27,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-06-09 00:53:27,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-06-09 00:53:27,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-06-09 00:53:27,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-06-09 00:53:27,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-06-09 00:53:27,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-06-09 00:53:27,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-06-09 00:53:27,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-06-09 00:53:27,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-06-09 00:53:27,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-06-09 00:53:27,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-06-09 00:53:27,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-06-09 00:53:27,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-06-09 00:53:27,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-06-09 00:53:27,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-06-09 00:53:27,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-06-09 00:53:27,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-06-09 00:53:27,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-06-09 00:53:27,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-06-09 00:53:27,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-06-09 00:53:27,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-06-09 00:53:27,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-06-09 00:53:27,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-06-09 00:53:27,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-06-09 00:53:27,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-06-09 00:53:27,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-06-09 00:53:27,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-06-09 00:53:27,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-06-09 00:53:27,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-06-09 00:53:27,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-06-09 00:53:27,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-06-09 00:53:27,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-06-09 00:53:27,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-06-09 00:53:27,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-06-09 00:53:27,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-06-09 00:53:27,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-06-09 00:53:27,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-06-09 00:53:27,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-06-09 00:53:27,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-06-09 00:53:27,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-06-09 00:53:27,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-06-09 00:53:27,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-06-09 00:53:27,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-06-09 00:53:27,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-06-09 00:53:27,810 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.039620975171307644, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0569462305706577, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.039620975171307644, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17583333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24275, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-06-09 00:53:27,810 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-06-09 00:53:27,811 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18059997722602622, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.039620975171307644, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0569462305706577, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.039620975171307644, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17583333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24275, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-06-09 00:53:28,279 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 666 ms to try 5000 different iterations.  Found a solution that moves 2624 regions; Going from a computed imbalance of 0.18059997722602622 to a new imbalance of 0.016053221844828703. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021942117963309738); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.037060935050889365, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29155555555555557, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021942117963309738); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04591666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-06-09 00:53:28,292 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv13802485:77 , srv1880240514:78 , srv1145859290:80 , srv1849970540:80 , srv230748383:81 , srv467795023:81 , srv1288607774:82 , srv1500327631:82 , srv1523609382:82 , srv1547880109:82 , srv490636060:82 , srv1715833586:83 , srv1925344646:83 , srv2001849705:83 , srv2090470656:83 , srv431250979:83 , srv578584745:83 , srv819078330:83 , srv960173609:83 , srv1241934280:84 , srv1560702829:84 , srv1592985327:84 , srv1801319023:84 , srv2114816147:84 , srv217266395:84 , srv238551452:84 , srv585338884:84 , srv706961929:84 , srv757002485:84 , srv856436470:84 , srv996055457:84 , srv1006081422:85 , srv1014280211:85 , srv1025046304:85 , srv1105983853:85 , srv110809370:85 , srv1292177631:85 , srv1402889246:85 , srv1404961423:85 , srv1437740946:85 , srv150581828:85 , srv1596797633:85 , srv1635245361:85 , srv1676471201:85 , srv1757146683:85 , srv1785950514:85 , srv187297441:85 , srv2108677063:85 , srv220760533:85 , srv22224363:85 , srv267870017:85 , srv400162849:85 , srv451198092:85 , srv496666519:85 , srv592247240:85 , srv6431931:85 , srv1119098830:86 , srv1578153985:86 , srv198185660:86 , srv282589150:86 , srv308517780:86 , srv339837298:86 , srv355680809:86 , srv424135393:86 , srv685056029:86 , srv685099205:86 , srv1129930137:87 , srv1183245545:87 , srv1242379342:87 , srv42180415:87 , srv457178097:87 , srv671372659:87 , srv671801291:87 , srv902172616:87 , srv1133536892:88 , srv1303206426:88 , srv1369684749:88 , srv2122952766:88 , srv267834147:88 , srv935115015:88 , srv1209803467:89 , srv1224765165:89 , srv1244727080:89 , srv1391247135:89 , srv1629192883:89 , srv1962669311:89 , srv30315701:89 , srv374122059:89 , srv412938499:89 , srv447225947:89 , srv723000814:89 , srv1510591999:90 , srv1764961895:90 , srv733285437:90 , srv934882412:90 , srv1172137741:91 , srv2133222991:91 , srv431029837:91 , srv429957175:93 , srv430205911:527 }
2023-06-09 00:53:28,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-06-09 00:53:28,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2133222991=53, srv447225947=75, srv451198092=76, srv1145859290=8, srv1764961895=39, srv2001849705=48, srv960173609=98, srv339837298=64, srv1757146683=38, srv6431931=84, srv1437740946=24, srv1801319023=41, srv1025046304=2, srv412938499=68, srv1172137741=9, srv267834147=59, srv1105983853=3, srv1560702829=30, srv1133536892=7, srv496666519=80, srv585338884=82, srv355680809=65, srv1404961423=23, srv457178097=77, srv671372659=85, srv1849970540=42, srv1676471201=36, srv110809370=4, srv217266395=54, srv856436470=94, srv1500327631=25, srv198185660=47, srv187297441=43, srv2114816147=51, srv592247240=83, srv723000814=90, srv733285437=91, srv1119098830=5, srv308517780=63, srv1129930137=6, srv13802485=20, srv467795023=78, srv1402889246=22, srv1523609382=28, srv1242379342=14, srv1578153985=31, srv400162849=67, srv1596797633=33, srv1014280211=1, srv1715833586=37, srv1183245545=10, srv374122059=66, srv1925344646=45, srv935115015=97, srv424135393=70, srv429957175=71, srv902172616=95, srv1880240514=44, srv2122952766=52, srv1288607774=16, srv1592985327=32, srv578584745=81, srv1006081422=0, srv685056029=87, srv1224765165=12, srv1510591999=27, srv220760533=55, srv934882412=96, srv819078330=93, srv1629192883=34, srv2108677063=50, srv150581828=26, srv42180415=69, srv267870017=60, srv1244727080=15, srv2090470656=49, srv30315701=62, srv430205911=72, srv671801291=86, srv685099205=88, srv1785950514=40, srv1962669311=46, srv1369684749=19, srv431250979=74, srv431029837=73, srv282589150=61, srv996055457=99, srv1391247135=21, srv1547880109=29, srv706961929=89, srv1303206426=18, srv490636060=79, srv238551452=58, srv22224363=56, srv1241934280=13, srv757002485=92, srv1209803467=11, srv1292177631=17, srv1635245361=35, srv230748383=57} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-06-09 00:53:28,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-06-09 00:53:28,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-06-09 00:53:28,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-06-09 00:53:28,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-06-09 00:53:28,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-06-09 00:53:28,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-06-09 00:53:28,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-06-09 00:53:28,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-06-09 00:53:28,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-06-09 00:53:28,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-06-09 00:53:28,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-06-09 00:53:28,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-06-09 00:53:28,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-06-09 00:53:28,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-06-09 00:53:28,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-06-09 00:53:28,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-06-09 00:53:28,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-06-09 00:53:28,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-06-09 00:53:28,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-06-09 00:53:28,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-06-09 00:53:28,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-06-09 00:53:28,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-06-09 00:53:28,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-06-09 00:53:28,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-06-09 00:53:28,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-06-09 00:53:28,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-06-09 00:53:28,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-06-09 00:53:28,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-06-09 00:53:28,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-06-09 00:53:28,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-06-09 00:53:28,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-06-09 00:53:28,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-06-09 00:53:28,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-06-09 00:53:28,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-06-09 00:53:28,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-06-09 00:53:28,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-06-09 00:53:28,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-06-09 00:53:28,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-06-09 00:53:28,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-06-09 00:53:28,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-06-09 00:53:28,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-06-09 00:53:28,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-06-09 00:53:28,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-06-09 00:53:28,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-06-09 00:53:28,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-06-09 00:53:28,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-06-09 00:53:28,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-06-09 00:53:28,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-06-09 00:53:28,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-06-09 00:53:28,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-06-09 00:53:28,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-06-09 00:53:28,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-06-09 00:53:28,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-06-09 00:53:28,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-06-09 00:53:28,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-06-09 00:53:28,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-06-09 00:53:28,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-06-09 00:53:28,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-06-09 00:53:28,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-06-09 00:53:28,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-06-09 00:53:28,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-06-09 00:53:28,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-06-09 00:53:28,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-06-09 00:53:28,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-06-09 00:53:28,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-06-09 00:53:28,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-06-09 00:53:28,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-06-09 00:53:28,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-06-09 00:53:28,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-06-09 00:53:28,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-06-09 00:53:28,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-06-09 00:53:28,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-06-09 00:53:28,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-06-09 00:53:28,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-06-09 00:53:28,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-06-09 00:53:28,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-06-09 00:53:28,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-06-09 00:53:28,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-06-09 00:53:28,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-06-09 00:53:28,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-06-09 00:53:28,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-06-09 00:53:28,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-06-09 00:53:28,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-06-09 00:53:28,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-06-09 00:53:28,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-06-09 00:53:28,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-06-09 00:53:28,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-06-09 00:53:28,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-06-09 00:53:28,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-06-09 00:53:28,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-06-09 00:53:28,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-06-09 00:53:28,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-06-09 00:53:28,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-06-09 00:53:28,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-06-09 00:53:28,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-06-09 00:53:28,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-06-09 00:53:28,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-06-09 00:53:28,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-06-09 00:53:28,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-06-09 00:53:28,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-06-09 00:53:28,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-06-09 00:53:28,462 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021942117963309738); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.037060935050889365, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021942117963309738); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04591666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-06-09 00:53:28,462 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-06-09 00:53:28,463 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.016034848204121006, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021942117963309738); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.037060935050889365, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021942117963309738); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04591666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-06-09 00:53:28,744 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 389 ms to try 5000 different iterations.  Found a solution that moves 971 regions; Going from a computed imbalance of 0.016034848204121006 to a new imbalance of 0.0010275965986118855. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00622158085519251); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010117158808524375); MoveCostFunction : (multiplier=7.0, imbalance=0.1078888888888889, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.00622158085519251); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=6.666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003833333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-06-09 00:53:28,746 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv934882412:79 , srv1006081422:83 , srv1133536892:83 , srv1172137741:83 , srv1209803467:83 , srv1596797633:83 , srv1764961895:83 , srv1785950514:83 , srv1962669311:83 , srv412938499:83 , srv431029837:83 , srv1105983853:84 , srv1224765165:84 , srv1288607774:84 , srv1437740946:84 , srv1510591999:84 , srv198185660:84 , srv2133222991:84 , srv238551452:84 , srv30315701:84 , srv431250979:84 , srv447225947:84 , srv592247240:84 , srv671801291:84 , srv757002485:84 , srv996055457:84 , srv1129930137:85 , srv1145859290:85 , srv1242379342:85 , srv1391247135:85 , srv1402889246:85 , srv1500327631:85 , srv150581828:85 , srv1560702829:85 , srv1592985327:85 , srv1676471201:85 , srv1715833586:85 , srv1801319023:85 , srv187297441:85 , srv1925344646:85 , srv2001849705:85 , srv2114816147:85 , srv217266395:85 , srv220760533:85 , srv267870017:85 , srv355680809:85 , srv496666519:85 , srv585338884:85 , srv685099205:85 , srv733285437:85 , srv1014280211:86 , srv1025046304:86 , srv1119098830:86 , srv1292177631:86 , srv1303206426:86 , srv13802485:86 , srv1629192883:86 , srv1635245361:86 , srv1757146683:86 , srv1880240514:86 , srv2108677063:86 , srv22224363:86 , srv282589150:86 , srv308517780:86 , srv339837298:86 , srv374122059:86 , srv400162849:86 , srv42180415:86 , srv424135393:86 , srv467795023:86 , srv578584745:86 , srv6431931:86 , srv671372659:86 , srv685056029:86 , srv856436470:86 , srv1241934280:87 , srv1244727080:87 , srv1369684749:87 , srv1404961423:87 , srv1523609382:87 , srv1547880109:87 , srv1578153985:87 , srv2090470656:87 , srv2122952766:87 , srv267834147:87 , srv429957175:87 , srv451198092:87 , srv490636060:87 , srv706961929:87 , srv723000814:87 , srv902172616:87 , srv935115015:87 , srv110809370:88 , srv1183245545:88 , srv1849970540:88 , srv457178097:88 , srv960173609:88 , srv230748383:89 , srv819078330:89 , srv430205911:544 }
2023-06-09 00:53:28,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-06-09 00:53:28,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2133222991=53, srv447225947=75, srv451198092=76, srv1145859290=8, srv1764961895=39, srv2001849705=48, srv960173609=98, srv339837298=64, srv1757146683=38, srv6431931=84, srv1437740946=24, srv1801319023=41, srv1025046304=2, srv412938499=68, srv1172137741=9, srv267834147=59, srv1105983853=3, srv1560702829=30, srv1133536892=7, srv496666519=80, srv585338884=82, srv355680809=65, srv1404961423=23, srv457178097=77, srv671372659=85, srv1849970540=42, srv1676471201=36, srv110809370=4, srv217266395=54, srv856436470=94, srv1500327631=25, srv198185660=47, srv187297441=43, srv2114816147=51, srv592247240=83, srv723000814=90, srv733285437=91, srv1119098830=5, srv308517780=63, srv1129930137=6, srv13802485=20, srv467795023=78, srv1402889246=22, srv1523609382=28, srv1242379342=14, srv1578153985=31, srv400162849=67, srv1596797633=33, srv1014280211=1, srv1715833586=37, srv1183245545=10, srv374122059=66, srv1925344646=45, srv935115015=97, srv424135393=70, srv429957175=71, srv902172616=95, srv1880240514=44, srv2122952766=52, srv1288607774=16, srv1592985327=32, srv578584745=81, srv1006081422=0, srv685056029=87, srv1224765165=12, srv1510591999=27, srv220760533=55, srv934882412=96, srv819078330=93, srv1629192883=34, srv2108677063=50, srv150581828=26, srv42180415=69, srv267870017=60, srv1244727080=15, srv2090470656=49, srv30315701=62, srv430205911=72, srv671801291=86, srv685099205=88, srv1785950514=40, srv1962669311=46, srv1369684749=19, srv431250979=74, srv431029837=73, srv282589150=61, srv996055457=99, srv1391247135=21, srv1547880109=29, srv706961929=89, srv1303206426=18, srv490636060=79, srv238551452=58, srv22224363=56, srv1241934280=13, srv757002485=92, srv1209803467=11, srv1292177631=17, srv1635245361=35, srv230748383=57} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-06-09 00:53:28,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-06-09 00:53:28,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-06-09 00:53:28,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-06-09 00:53:28,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-06-09 00:53:28,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-06-09 00:53:28,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-06-09 00:53:28,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-06-09 00:53:28,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-06-09 00:53:28,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-06-09 00:53:28,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-06-09 00:53:28,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-06-09 00:53:28,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-06-09 00:53:28,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-06-09 00:53:28,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-06-09 00:53:28,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-06-09 00:53:28,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-06-09 00:53:28,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-06-09 00:53:28,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-06-09 00:53:28,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-06-09 00:53:28,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-06-09 00:53:28,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-06-09 00:53:28,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-06-09 00:53:28,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-06-09 00:53:28,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-06-09 00:53:28,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-06-09 00:53:28,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-06-09 00:53:28,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-06-09 00:53:28,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-06-09 00:53:28,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-06-09 00:53:28,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-06-09 00:53:28,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-06-09 00:53:28,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-06-09 00:53:28,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-06-09 00:53:28,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-06-09 00:53:28,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-06-09 00:53:28,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-06-09 00:53:28,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-06-09 00:53:28,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-06-09 00:53:28,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-06-09 00:53:28,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-06-09 00:53:28,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-06-09 00:53:28,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-06-09 00:53:28,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-06-09 00:53:28,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-06-09 00:53:28,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-06-09 00:53:28,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-06-09 00:53:28,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-06-09 00:53:28,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-06-09 00:53:28,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-06-09 00:53:28,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-06-09 00:53:28,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-06-09 00:53:28,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-06-09 00:53:28,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-06-09 00:53:28,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-06-09 00:53:28,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-06-09 00:53:28,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-06-09 00:53:28,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-06-09 00:53:28,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-06-09 00:53:28,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-06-09 00:53:28,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-06-09 00:53:28,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-06-09 00:53:28,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-06-09 00:53:28,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-06-09 00:53:28,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-06-09 00:53:28,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-06-09 00:53:28,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-06-09 00:53:28,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-06-09 00:53:28,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-06-09 00:53:28,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-06-09 00:53:28,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-06-09 00:53:28,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-06-09 00:53:28,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-06-09 00:53:28,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-06-09 00:53:28,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-06-09 00:53:28,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-06-09 00:53:28,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-06-09 00:53:28,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-06-09 00:53:28,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-06-09 00:53:28,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-06-09 00:53:28,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-06-09 00:53:28,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-06-09 00:53:28,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-06-09 00:53:28,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-06-09 00:53:28,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-06-09 00:53:28,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-06-09 00:53:28,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-06-09 00:53:28,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-06-09 00:53:28,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-06-09 00:53:28,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-06-09 00:53:28,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-06-09 00:53:28,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-06-09 00:53:28,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-06-09 00:53:28,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-06-09 00:53:28,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-06-09 00:53:28,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-06-09 00:53:28,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-06-09 00:53:28,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-06-09 00:53:28,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-06-09 00:53:28,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-06-09 00:53:28,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-06-09 00:53:28,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-06-09 00:53:28,885 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00622158085519251); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010117158808524375); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.00622158085519251); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=6.666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003833333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-06-09 00:53:28,885 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-06-09 00:53:28,885 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.0010207975112920783, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00622158085519251); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010117158808524375); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.00622158085519251); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=6.666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003833333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-06-09 00:53:29,250 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 467 ms to try 5000 different iterations.  Found a solution that moves 251 regions; Going from a computed imbalance of 0.0010207975112920783 to a new imbalance of 3.65048254778493E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0022721660362024225); MoveCostFunction : (multiplier=7.0, imbalance=0.02788888888888889, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-06-09 00:53:29,251 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv110809370:83 , srv1244727080:83 , srv1437740946:83 , srv1578153985:83 , srv267870017:83 , srv467795023:83 , srv902172616:83 , srv1014280211:84 , srv1145859290:84 , srv1224765165:84 , srv1292177631:84 , srv1303206426:84 , srv1369684749:84 , srv13802485:84 , srv1391247135:84 , srv150581828:84 , srv1510591999:84 , srv1523609382:84 , srv1547880109:84 , srv1629192883:84 , srv1676471201:84 , srv2114816147:84 , srv217266395:84 , srv22224363:84 , srv238551452:84 , srv267834147:84 , srv339837298:84 , srv355680809:84 , srv374122059:84 , srv429957175:84 , srv431029837:84 , srv451198092:84 , srv457178097:84 , srv496666519:84 , srv578584745:84 , srv592247240:84 , srv6431931:84 , srv671372659:84 , srv723000814:84 , srv733285437:84 , srv819078330:84 , srv856436470:84 , srv960173609:84 , srv1025046304:85 , srv1105983853:85 , srv1119098830:85 , srv1129930137:85 , srv1172137741:85 , srv1183245545:85 , srv1209803467:85 , srv1241934280:85 , srv1242379342:85 , srv1288607774:85 , srv1402889246:85 , srv1404961423:85 , srv1500327631:85 , srv1560702829:85 , srv1592985327:85 , srv1596797633:85 , srv1635245361:85 , srv1715833586:85 , srv1757146683:85 , srv1764961895:85 , srv1785950514:85 , srv1801319023:85 , srv1849970540:85 , srv187297441:85 , srv1880240514:85 , srv1925344646:85 , srv198185660:85 , srv2001849705:85 , srv2090470656:85 , srv2122952766:85 , srv2133222991:85 , srv220760533:85 , srv230748383:85 , srv282589150:85 , srv30315701:85 , srv308517780:85 , srv400162849:85 , srv412938499:85 , srv42180415:85 , srv424135393:85 , srv447225947:85 , srv490636060:85 , srv585338884:85 , srv671801291:85 , srv685056029:85 , srv685099205:85 , srv706961929:85 , srv757002485:85 , srv935115015:85 , srv996055457:85 , srv1006081422:86 , srv1133536892:86 , srv1962669311:86 , srv2108677063:86 , srv431250979:86 , srv934882412:86 , srv430205911:629 }
2023-06-09 00:53:29,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-06-09 00:53:29,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2133222991=53, srv447225947=75, srv451198092=76, srv1145859290=8, srv1764961895=39, srv2001849705=48, srv960173609=98, srv339837298=64, srv1757146683=38, srv6431931=84, srv1437740946=24, srv1801319023=41, srv1025046304=2, srv412938499=68, srv1172137741=9, srv267834147=59, srv1105983853=3, srv1560702829=30, srv1133536892=7, srv496666519=80, srv585338884=82, srv355680809=65, srv1404961423=23, srv457178097=77, srv671372659=85, srv1849970540=42, srv1676471201=36, srv110809370=4, srv217266395=54, srv856436470=94, srv1500327631=25, srv198185660=47, srv187297441=43, srv2114816147=51, srv592247240=83, srv723000814=90, srv733285437=91, srv1119098830=5, srv308517780=63, srv1129930137=6, srv13802485=20, srv467795023=78, srv1402889246=22, srv1523609382=28, srv1242379342=14, srv1578153985=31, srv400162849=67, srv1596797633=33, srv1014280211=1, srv1715833586=37, srv1183245545=10, srv374122059=66, srv1925344646=45, srv935115015=97, srv424135393=70, srv429957175=71, srv902172616=95, srv1880240514=44, srv2122952766=52, srv1288607774=16, srv1592985327=32, srv578584745=81, srv1006081422=0, srv685056029=87, srv1224765165=12, srv1510591999=27, srv220760533=55, srv934882412=96, srv819078330=93, srv1629192883=34, srv2108677063=50, srv150581828=26, srv42180415=69, srv267870017=60, srv1244727080=15, srv2090470656=49, srv30315701=62, srv430205911=72, srv671801291=86, srv685099205=88, srv1785950514=40, srv1962669311=46, srv1369684749=19, srv431250979=74, srv431029837=73, srv282589150=61, srv996055457=99, srv1391247135=21, srv1547880109=29, srv706961929=89, srv1303206426=18, srv490636060=79, srv238551452=58, srv22224363=56, srv1241934280=13, srv757002485=92, srv1209803467=11, srv1292177631=17, srv1635245361=35, srv230748383=57} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-06-09 00:53:29,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-06-09 00:53:29,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-06-09 00:53:29,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-06-09 00:53:29,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-06-09 00:53:29,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-06-09 00:53:29,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-06-09 00:53:29,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-06-09 00:53:29,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-06-09 00:53:29,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-06-09 00:53:29,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-06-09 00:53:29,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-06-09 00:53:29,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-06-09 00:53:29,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-06-09 00:53:29,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-06-09 00:53:29,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-06-09 00:53:29,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-06-09 00:53:29,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-06-09 00:53:29,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-06-09 00:53:29,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-06-09 00:53:29,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-06-09 00:53:29,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-06-09 00:53:29,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-06-09 00:53:29,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-06-09 00:53:29,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-06-09 00:53:29,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-06-09 00:53:29,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-06-09 00:53:29,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-06-09 00:53:29,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-06-09 00:53:29,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-06-09 00:53:29,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-06-09 00:53:29,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-06-09 00:53:29,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-06-09 00:53:29,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-06-09 00:53:29,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-06-09 00:53:29,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-06-09 00:53:29,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-06-09 00:53:29,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-06-09 00:53:29,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-06-09 00:53:29,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-06-09 00:53:29,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-06-09 00:53:29,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-06-09 00:53:29,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-06-09 00:53:29,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-06-09 00:53:29,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-06-09 00:53:29,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-06-09 00:53:29,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-06-09 00:53:29,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-06-09 00:53:29,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-06-09 00:53:29,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-06-09 00:53:29,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-06-09 00:53:29,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-06-09 00:53:29,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-06-09 00:53:29,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-06-09 00:53:29,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-06-09 00:53:29,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-06-09 00:53:29,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-06-09 00:53:29,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-06-09 00:53:29,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-06-09 00:53:29,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-06-09 00:53:29,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-06-09 00:53:29,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-06-09 00:53:29,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-06-09 00:53:29,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-06-09 00:53:29,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-06-09 00:53:29,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-06-09 00:53:29,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-06-09 00:53:29,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-06-09 00:53:29,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-06-09 00:53:29,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-06-09 00:53:29,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-06-09 00:53:29,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-06-09 00:53:29,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-06-09 00:53:29,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-06-09 00:53:29,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-06-09 00:53:29,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-06-09 00:53:29,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-06-09 00:53:29,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-06-09 00:53:29,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-06-09 00:53:29,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-06-09 00:53:29,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-06-09 00:53:29,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-06-09 00:53:29,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-06-09 00:53:29,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-06-09 00:53:29,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-06-09 00:53:29,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-06-09 00:53:29,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-06-09 00:53:29,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-06-09 00:53:29,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-06-09 00:53:29,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-06-09 00:53:29,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-06-09 00:53:29,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-06-09 00:53:29,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-06-09 00:53:29,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-06-09 00:53:29,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-06-09 00:53:29,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-06-09 00:53:29,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-06-09 00:53:29,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-06-09 00:53:29,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-06-09 00:53:29,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-06-09 00:53:29,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-06-09 00:53:29,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-06-09 00:53:29,378 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0022721660362024225); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-06-09 00:53:29,378 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-06-09 00:53:29,378 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=3.4747285913202955E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0022721660362024225); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-06-09 00:53:29,626 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 343 ms to try 5000 different iterations.  Found a solution that moves 34 regions; Going from a computed imbalance of 3.4747285913202955E-5 to a new imbalance of 6.982142142270099E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014982219165849825); MoveCostFunction : (multiplier=7.0, imbalance=0.003777777777777778); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-06-09 00:53:29,626 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1129930137:83 , srv1133536892:83 , srv1404961423:83 , srv2108677063:83 , srv230748383:83 , srv238551452:83 , srv960173609:83 , srv1006081422:84 , srv1014280211:84 , srv1025046304:84 , srv1105983853:84 , srv110809370:84 , srv1119098830:84 , srv1172137741:84 , srv1183245545:84 , srv1209803467:84 , srv1241934280:84 , srv1242379342:84 , srv1244727080:84 , srv1288607774:84 , srv1292177631:84 , srv1303206426:84 , srv1369684749:84 , srv13802485:84 , srv1391247135:84 , srv1402889246:84 , srv1500327631:84 , srv150581828:84 , srv1510591999:84 , srv1523609382:84 , srv1547880109:84 , srv1560702829:84 , srv1578153985:84 , srv1592985327:84 , srv1596797633:84 , srv1629192883:84 , srv1635245361:84 , srv1715833586:84 , srv1757146683:84 , srv1764961895:84 , srv1785950514:84 , srv1801319023:84 , srv1849970540:84 , srv187297441:84 , srv1880240514:84 , srv1925344646:84 , srv1962669311:84 , srv198185660:84 , srv2001849705:84 , srv2090470656:84 , srv2114816147:84 , srv2122952766:84 , srv2133222991:84 , srv217266395:84 , srv220760533:84 , srv22224363:84 , srv267834147:84 , srv267870017:84 , srv282589150:84 , srv30315701:84 , srv308517780:84 , srv355680809:84 , srv374122059:84 , srv400162849:84 , srv412938499:84 , srv42180415:84 , srv424135393:84 , srv429957175:84 , srv431029837:84 , srv431250979:84 , srv447225947:84 , srv457178097:84 , srv467795023:84 , srv490636060:84 , srv496666519:84 , srv578584745:84 , srv585338884:84 , srv592247240:84 , srv671372659:84 , srv671801291:84 , srv685056029:84 , srv685099205:84 , srv706961929:84 , srv723000814:84 , srv733285437:84 , srv757002485:84 , srv819078330:84 , srv856436470:84 , srv902172616:84 , srv934882412:84 , srv935115015:84 , srv996055457:84 , srv1145859290:85 , srv1224765165:85 , srv1437740946:85 , srv1676471201:85 , srv339837298:85 , srv451198092:85 , srv6431931:85 , srv430205911:684 }
2023-06-09 00:53:29,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-06-09 00:53:29,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2133222991=53, srv447225947=75, srv451198092=76, srv1145859290=8, srv1764961895=39, srv2001849705=48, srv960173609=98, srv339837298=64, srv1757146683=38, srv6431931=84, srv1437740946=24, srv1801319023=41, srv1025046304=2, srv412938499=68, srv1172137741=9, srv267834147=59, srv1105983853=3, srv1560702829=30, srv1133536892=7, srv496666519=80, srv585338884=82, srv355680809=65, srv1404961423=23, srv457178097=77, srv671372659=85, srv1849970540=42, srv1676471201=36, srv110809370=4, srv217266395=54, srv856436470=94, srv1500327631=25, srv198185660=47, srv187297441=43, srv2114816147=51, srv592247240=83, srv723000814=90, srv733285437=91, srv1119098830=5, srv308517780=63, srv1129930137=6, srv13802485=20, srv467795023=78, srv1402889246=22, srv1523609382=28, srv1242379342=14, srv1578153985=31, srv400162849=67, srv1596797633=33, srv1014280211=1, srv1715833586=37, srv1183245545=10, srv374122059=66, srv1925344646=45, srv935115015=97, srv424135393=70, srv429957175=71, srv902172616=95, srv1880240514=44, srv2122952766=52, srv1288607774=16, srv1592985327=32, srv578584745=81, srv1006081422=0, srv685056029=87, srv1224765165=12, srv1510591999=27, srv220760533=55, srv934882412=96, srv819078330=93, srv1629192883=34, srv2108677063=50, srv150581828=26, srv42180415=69, srv267870017=60, srv1244727080=15, srv2090470656=49, srv30315701=62, srv430205911=72, srv671801291=86, srv685099205=88, srv1785950514=40, srv1962669311=46, srv1369684749=19, srv431250979=74, srv431029837=73, srv282589150=61, srv996055457=99, srv1391247135=21, srv1547880109=29, srv706961929=89, srv1303206426=18, srv490636060=79, srv238551452=58, srv22224363=56, srv1241934280=13, srv757002485=92, srv1209803467=11, srv1292177631=17, srv1635245361=35, srv230748383=57} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-06-09 00:53:29,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-06-09 00:53:29,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-06-09 00:53:29,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-06-09 00:53:29,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-06-09 00:53:29,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-06-09 00:53:29,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-06-09 00:53:29,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-06-09 00:53:29,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-06-09 00:53:29,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-06-09 00:53:29,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-06-09 00:53:29,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-06-09 00:53:29,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-06-09 00:53:29,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-06-09 00:53:29,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-06-09 00:53:29,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-06-09 00:53:29,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-06-09 00:53:29,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-06-09 00:53:29,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-06-09 00:53:29,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-06-09 00:53:29,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-06-09 00:53:29,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-06-09 00:53:29,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-06-09 00:53:29,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-06-09 00:53:29,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-06-09 00:53:29,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-06-09 00:53:29,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-06-09 00:53:29,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-06-09 00:53:29,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-06-09 00:53:29,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-06-09 00:53:29,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-06-09 00:53:29,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-06-09 00:53:29,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-06-09 00:53:29,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-06-09 00:53:29,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-06-09 00:53:29,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-06-09 00:53:29,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-06-09 00:53:29,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-06-09 00:53:29,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-06-09 00:53:29,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-06-09 00:53:29,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-06-09 00:53:29,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-06-09 00:53:29,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-06-09 00:53:29,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-06-09 00:53:29,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-06-09 00:53:29,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-06-09 00:53:29,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-06-09 00:53:29,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-06-09 00:53:29,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-06-09 00:53:29,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-06-09 00:53:29,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-06-09 00:53:29,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-06-09 00:53:29,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-06-09 00:53:29,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-06-09 00:53:29,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-06-09 00:53:29,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-06-09 00:53:29,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-06-09 00:53:29,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-06-09 00:53:29,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-06-09 00:53:29,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-06-09 00:53:29,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-06-09 00:53:29,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-06-09 00:53:29,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-06-09 00:53:29,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-06-09 00:53:29,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-06-09 00:53:29,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-06-09 00:53:29,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-06-09 00:53:29,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-06-09 00:53:29,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-06-09 00:53:29,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-06-09 00:53:29,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-06-09 00:53:29,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-06-09 00:53:29,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-06-09 00:53:29,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-06-09 00:53:29,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-06-09 00:53:29,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-06-09 00:53:29,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-06-09 00:53:29,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-06-09 00:53:29,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-06-09 00:53:29,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-06-09 00:53:29,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-06-09 00:53:29,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-06-09 00:53:29,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-06-09 00:53:29,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-06-09 00:53:29,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-06-09 00:53:29,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-06-09 00:53:29,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-06-09 00:53:29,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-06-09 00:53:29,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-06-09 00:53:29,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-06-09 00:53:29,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-06-09 00:53:29,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-06-09 00:53:29,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-06-09 00:53:29,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-06-09 00:53:29,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-06-09 00:53:29,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-06-09 00:53:29,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-06-09 00:53:29,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-06-09 00:53:29,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-06-09 00:53:29,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-06-09 00:53:29,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-06-09 00:53:29,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-06-09 00:53:29,756 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=6.744069053831948E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014982219165849825); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-06-09 00:53:29,756 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1129930137:83 , srv1133536892:83 , srv1404961423:83 , srv2108677063:83 , srv230748383:83 , srv238551452:83 , srv960173609:83 , srv1006081422:84 , srv1014280211:84 , srv1025046304:84 , srv1105983853:84 , srv110809370:84 , srv1119098830:84 , srv1172137741:84 , srv1183245545:84 , srv1209803467:84 , srv1241934280:84 , srv1242379342:84 , srv1244727080:84 , srv1288607774:84 , srv1292177631:84 , srv1303206426:84 , srv1369684749:84 , srv13802485:84 , srv1391247135:84 , srv1402889246:84 , srv1500327631:84 , srv150581828:84 , srv1510591999:84 , srv1523609382:84 , srv1547880109:84 , srv1560702829:84 , srv1578153985:84 , srv1592985327:84 , srv1596797633:84 , srv1629192883:84 , srv1635245361:84 , srv1715833586:84 , srv1757146683:84 , srv1764961895:84 , srv1785950514:84 , srv1801319023:84 , srv1849970540:84 , srv187297441:84 , srv1880240514:84 , srv1925344646:84 , srv1962669311:84 , srv198185660:84 , srv2001849705:84 , srv2090470656:84 , srv2114816147:84 , srv2122952766:84 , srv2133222991:84 , srv217266395:84 , srv220760533:84 , srv22224363:84 , srv267834147:84 , srv267870017:84 , srv282589150:84 , srv30315701:84 , srv308517780:84 , srv355680809:84 , srv374122059:84 , srv400162849:84 , srv412938499:84 , srv42180415:84 , srv424135393:84 , srv429957175:84 , srv431029837:84 , srv431250979:84 , srv447225947:84 , srv457178097:84 , srv467795023:84 , srv490636060:84 , srv496666519:84 , srv578584745:84 , srv585338884:84 , srv592247240:84 , srv671372659:84 , srv671801291:84 , srv685056029:84 , srv685099205:84 , srv706961929:84 , srv723000814:84 , srv733285437:84 , srv757002485:84 , srv819078330:84 , srv856436470:84 , srv902172616:84 , srv934882412:84 , srv935115015:84 , srv996055457:84 , srv1145859290:85 , srv1224765165:85 , srv1437740946:85 , srv1676471201:85 , srv339837298:85 , srv451198092:85 , srv6431931:85 , srv430205911:684 }
2023-06-09 00:53:29,779 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=294 (was 294), ProcessCount=172 (was 172), AvailableMemoryMB=11000 (was 11494)
2023-06-09 00:53:29,786 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=294, ProcessCount=172, AvailableMemoryMB=10999
2023-06-09 00:53:29,787 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-06-09 00:53:29,787 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-06-09 00:53:29,799 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1007813726:84 , srv1127219221:84 , srv1132789768:84 , srv1137536266:84 , srv1228667052:84 , srv1259083249:84 , srv1264685232:84 , srv1295503888:84 , srv1323614984:84 , srv1590723529:84 , srv1632773181:84 , srv1644271546:84 , srv1786580248:84 , srv1989375382:84 , srv2038256273:84 , srv2041376752:84 , srv299321076:84 , srv342710160:84 , srv407998219:84 , srv409203948:84 , srv428415824:84 , srv477816420:84 , srv574374884:84 , srv59963759:84 , srv615314056:84 , srv727432362:84 , srv896401608:84 , srv935408532:84 , srv993233121:84 , srv1069406834:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-06-09 00:53:29,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-06-09 00:53:29,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv428415824=21, srv1989375382=14, srv896401608=27, srv1228667052=5, srv1323614984=9, srv1132789768=3, srv1644271546=12, srv342710160=18, srv1786580248=13, srv1632773181=11, srv1137536266=4, srv935408532=28, srv409203948=20, srv727432362=26, srv1127219221=2, srv1590723529=10, srv477816420=22, srv574374884=23, srv2038256273=15, srv1259083249=6, srv993233121=29, srv1007813726=0, srv2041376752=16, srv407998219=19, srv1264685232=7, srv59963759=24, srv1069406834=1, srv299321076=17, srv615314056=25, srv1295503888=8} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-06-09 00:53:29,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-06-09 00:53:29,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-06-09 00:53:29,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-06-09 00:53:29,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-06-09 00:53:29,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-06-09 00:53:29,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-06-09 00:53:29,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-06-09 00:53:29,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-06-09 00:53:29,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-06-09 00:53:29,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-06-09 00:53:29,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-06-09 00:53:29,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-06-09 00:53:29,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-06-09 00:53:29,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-06-09 00:53:29,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-06-09 00:53:29,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-06-09 00:53:29,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-06-09 00:53:29,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-06-09 00:53:29,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-06-09 00:53:29,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-06-09 00:53:29,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-06-09 00:53:29,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-06-09 00:53:29,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-06-09 00:53:29,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-06-09 00:53:29,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-06-09 00:53:29,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-06-09 00:53:29,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-06-09 00:53:29,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-06-09 00:53:29,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-06-09 00:53:29,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-06-09 00:53:29,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-06-09 00:53:29,836 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0895569797988154, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-06-09 00:53:29,836 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912475234383322, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0895569797988154, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-06-09 00:55:29,818 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5636481 different iterations.  Found a solution that moves 1859 regions; Going from a computed imbalance of 0.9912475234383322 to a new imbalance of 4.338998739279625E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6885185185185185, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-06-09 00:55:29,825 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1007813726:90 , srv1069406834:90 , srv1127219221:90 , srv1132789768:90 , srv1137536266:90 , srv1228667052:90 , srv1259083249:90 , srv1264685232:90 , srv1295503888:90 , srv1323614984:90 , srv1590723529:90 , srv1632773181:90 , srv1644271546:90 , srv1786580248:90 , srv1989375382:90 , srv2038256273:90 , srv2041376752:90 , srv299321076:90 , srv342710160:90 , srv407998219:90 , srv409203948:90 , srv428415824:90 , srv477816420:90 , srv574374884:90 , srv59963759:90 , srv615314056:90 , srv727432362:90 , srv896401608:90 , srv935408532:90 , srv993233121:90 }
2023-06-09 00:55:29,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-06-09 00:55:29,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv428415824=21, srv1989375382=14, srv896401608=27, srv1228667052=5, srv1323614984=9, srv1132789768=3, srv1644271546=12, srv342710160=18, srv1786580248=13, srv1632773181=11, srv1137536266=4, srv935408532=28, srv409203948=20, srv727432362=26, srv1127219221=2, srv1590723529=10, srv477816420=22, srv574374884=23, srv2038256273=15, srv1259083249=6, srv993233121=29, srv1007813726=0, srv2041376752=16, srv407998219=19, srv1264685232=7, srv59963759=24, srv1069406834=1, srv299321076=17, srv615314056=25, srv1295503888=8} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-06-09 00:55:29,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-06-09 00:55:29,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-06-09 00:55:29,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-06-09 00:55:29,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-06-09 00:55:29,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-06-09 00:55:29,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-06-09 00:55:29,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-06-09 00:55:29,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-06-09 00:55:29,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-06-09 00:55:29,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-06-09 00:55:29,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-06-09 00:55:29,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-06-09 00:55:29,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-06-09 00:55:29,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-06-09 00:55:29,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-06-09 00:55:29,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-06-09 00:55:29,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-06-09 00:55:29,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-06-09 00:55:29,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-06-09 00:55:29,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-06-09 00:55:29,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-06-09 00:55:29,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-06-09 00:55:29,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-06-09 00:55:29,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-06-09 00:55:29,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-06-09 00:55:29,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-06-09 00:55:29,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-06-09 00:55:29,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-06-09 00:55:29,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-06-09 00:55:29,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-06-09 00:55:29,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-06-09 00:55:29,844 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-06-09 00:55:29,844 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1007813726:90 , srv1069406834:90 , srv1127219221:90 , srv1132789768:90 , srv1137536266:90 , srv1228667052:90 , srv1259083249:90 , srv1264685232:90 , srv1295503888:90 , srv1323614984:90 , srv1590723529:90 , srv1632773181:90 , srv1644271546:90 , srv1786580248:90 , srv1989375382:90 , srv2038256273:90 , srv2041376752:90 , srv299321076:90 , srv342710160:90 , srv407998219:90 , srv409203948:90 , srv428415824:90 , srv477816420:90 , srv574374884:90 , srv59963759:90 , srv615314056:90 , srv727432362:90 , srv896401608:90 , srv935408532:90 , srv993233121:90 }
2023-06-09 00:55:29,856 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=264 (was 294), ProcessCount=172 (was 172), AvailableMemoryMB=10159 (was 10999)