2023-11-15 14:55:16,673 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-11-15 14:55:16,946 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-11-15 14:55:17,057 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-11-15 14:55:17,122 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-11-15 14:55:17,129 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-11-15 14:55:17,142 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=117, ProcessCount=174, AvailableMemoryMB=1731
2023-11-15 14:55:17,144 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-11-15 14:55:17,144 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-11-15 14:55:17,257 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv100594892:84 , srv1017599903:84 , srv102440500:84 , srv1035191426:84 , srv1060674762:84 , srv1061585520:84 , srv1063674866:84 , srv1083635991:84 , srv1086864023:84 , srv1090574289:84 , srv1143345375:84 , srv1177971578:84 , srv1218231872:84 , srv1257164930:84 , srv1273458076:84 , srv1309621180:84 , srv1332203109:84 , srv1360751892:84 , srv1375769659:84 , srv1378805269:84 , srv1413991048:84 , srv1440033420:84 , srv1466858782:84 , srv1511877706:84 , srv1535844864:84 , srv1573376948:84 , srv1578874748:84 , srv1582338772:84 , srv159925020:84 , srv164081537:84 , srv1650816911:84 , srv168072156:84 , srv168319858:84 , srv1698803584:84 , srv1805262208:84 , srv1807720391:84 , srv1817946193:84 , srv1826891693:84 , srv1829295084:84 , srv1859535819:84 , srv1859604288:84 , srv1889051085:84 , srv1891147303:84 , srv1899014892:84 , srv19222026:84 , srv1947538684:84 , srv1955486960:84 , srv1974172723:84 , srv197745166:84 , srv1990398623:84 , srv1991438514:84 , srv2000098444:84 , srv201595022:84 , srv2017621773:84 , srv2034154598:84 , srv20359130:84 , srv2104668481:84 , srv2114303295:84 , srv2121807740:84 , srv216732564:84 , srv320072267:84 , srv325781732:84 , srv364810989:84 , srv366271195:84 , srv393325290:84 , srv396547652:84 , srv413960264:84 , srv426743181:84 , srv445386515:84 , srv473256590:84 , srv478839145:84 , srv486258762:84 , srv499054368:84 , srv500095306:84 , srv520484579:84 , srv543145161:84 , srv551258159:84 , srv552915709:84 , srv563872554:84 , srv565488212:84 , srv572658380:84 , srv589911340:84 , srv631459648:84 , srv646396013:84 , srv683739958:84 , srv690734465:84 , srv694570372:84 , srv723115866:84 , srv751139593:84 , srv778527970:84 , srv815827575:84 , srv827247313:84 , srv86248973:84 , srv877009047:84 , srv931089375:84 , srv936194432:84 , srv941888478:84 , srv991498858:84 , srv995182464:84 , srv1993063148:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-11-15 14:55:17,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-15 14:55:17,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv565488212=80, srv572658380=81, srv1859535819=39, srv563872554=79, srv393325290=65, srv991498858=98, srv723115866=88, srv1807720391=35, srv164081537=29, srv1990398623=49, srv1899014892=43, srv364810989=63, srv1573376948=25, srv2104668481=57, srv473256590=70, srv1466858782=22, srv320072267=61, srv413960264=67, srv877009047=94, srv1413991048=20, srv1829295084=38, srv995182464=99, srv1086864023=8, srv520484579=75, srv1218231872=12, srv1063674866=6, srv931089375=95, srv86248973=93, srv2017621773=54, srv1017599903=1, srv325781732=62, srv1578874748=26, srv936194432=96, srv1143345375=10, srv1257164930=13, srv2034154598=55, srv426743181=68, srv1650816911=30, srv1889051085=41, srv2000098444=52, srv1060674762=4, srv1974172723=47, srv1360751892=17, srv396547652=66, srv1332203109=16, srv551258159=77, srv552915709=78, srv197745166=48, srv1083635991=7, srv168072156=31, srv366271195=64, srv751139593=89, srv1947538684=45, srv1805262208=34, srv2114303295=58, srv1817946193=36, srv1582338772=27, srv1378805269=19, srv543145161=76, srv102440500=2, srv1511877706=23, srv1859604288=40, srv1177971578=11, srv1375769659=18, srv646396013=84, srv1826891693=37, srv1955486960=46, srv20359130=56, srv778527970=90, srv1035191426=3, srv1061585520=5, srv589911340=82, srv683739958=85, srv1440033420=21, srv1698803584=33, srv1273458076=14, srv631459648=83, srv1993063148=51, srv201595022=53, srv1891147303=42, srv478839145=71, srv1991438514=50, srv486258762=72, srv827247313=92, srv694570372=87, srv216732564=60, srv1535844864=24, srv815827575=91, srv19222026=44, srv2121807740=59, srv445386515=69, srv159925020=28, srv1090574289=9, srv690734465=86, srv100594892=0, srv499054368=73, srv941888478=97, srv168319858=32, srv500095306=74, srv1309621180=15} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-15 14:55:17,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-15 14:55:17,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-15 14:55:17,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-15 14:55:17,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-15 14:55:17,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-15 14:55:17,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-15 14:55:17,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-15 14:55:17,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-15 14:55:17,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-15 14:55:17,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-15 14:55:17,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-15 14:55:17,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-15 14:55:17,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-15 14:55:17,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-15 14:55:17,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-15 14:55:17,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-15 14:55:17,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-15 14:55:17,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-15 14:55:17,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-15 14:55:17,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-15 14:55:17,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-15 14:55:17,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-15 14:55:17,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-15 14:55:17,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-15 14:55:17,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-15 14:55:17,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-15 14:55:17,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-15 14:55:17,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-15 14:55:17,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-15 14:55:17,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-15 14:55:17,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-15 14:55:17,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-15 14:55:17,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-15 14:55:17,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-15 14:55:17,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-15 14:55:17,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-15 14:55:17,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-15 14:55:17,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-15 14:55:17,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-15 14:55:17,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-15 14:55:17,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-15 14:55:17,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-15 14:55:17,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-15 14:55:17,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-15 14:55:17,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-15 14:55:17,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-15 14:55:17,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-15 14:55:17,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-15 14:55:17,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-15 14:55:17,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-15 14:55:17,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-15 14:55:17,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-15 14:55:17,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-15 14:55:17,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-15 14:55:17,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-15 14:55:17,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-15 14:55:17,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-15 14:55:17,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-15 14:55:17,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-15 14:55:17,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-15 14:55:17,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-15 14:55:17,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-15 14:55:17,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-15 14:55:17,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-15 14:55:17,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-15 14:55:17,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-15 14:55:17,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-15 14:55:17,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-15 14:55:17,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-15 14:55:17,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-15 14:55:17,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-15 14:55:17,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-15 14:55:17,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-15 14:55:17,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-15 14:55:17,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-15 14:55:17,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-15 14:55:17,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-15 14:55:17,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-15 14:55:17,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-15 14:55:17,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-15 14:55:17,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-15 14:55:17,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-15 14:55:17,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-15 14:55:17,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-15 14:55:17,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-15 14:55:17,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-15 14:55:17,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-15 14:55:17,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-15 14:55:17,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-15 14:55:17,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-15 14:55:17,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-15 14:55:17,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-15 14:55:17,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-15 14:55:17,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-15 14:55:17,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-15 14:55:17,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-15 14:55:17,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-15 14:55:17,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-15 14:55:17,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-15 14:55:17,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-15 14:55:17,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-15 14:55:17,553 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-15 14:55:17,553 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-15 14:55:17,553 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-15 14:55:17,919 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 543 ms to try 5000 different iterations.  Found a solution that moves 4699 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.1769125397557922. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.042049679939214726, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.056192310484404866, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5221111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.042049679939214726, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17175, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24216666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-15 14:55:17,929 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1061585520:82 , srv1378805269:82 , srv1413991048:82 , srv751139593:82 , srv1218231872:83 , srv1360751892:83 , srv201595022:83 , srv20359130:83 , srv366271195:83 , srv500095306:83 , srv683739958:83 , srv778527970:83 , srv1257164930:84 , srv1309621180:84 , srv1826891693:84 , srv1891147303:84 , srv19222026:84 , srv1955486960:84 , srv393325290:84 , srv445386515:84 , srv551258159:84 , srv827247313:84 , srv877009047:84 , srv941888478:84 , srv1086864023:85 , srv1375769659:85 , srv159925020:85 , srv1805262208:85 , srv197745166:85 , srv2114303295:85 , srv473256590:85 , srv478839145:85 , srv543145161:85 , srv563872554:85 , srv646396013:85 , srv694570372:85 , srv723115866:85 , srv1017599903:86 , srv102440500:86 , srv1063674866:86 , srv1143345375:86 , srv1573376948:86 , srv164081537:86 , srv1807720391:86 , srv1829295084:86 , srv1899014892:86 , srv1990398623:86 , srv2000098444:86 , srv2104668481:86 , srv364810989:86 , srv413960264:86 , srv426743181:86 , srv499054368:86 , srv565488212:86 , srv572658380:86 , srv936194432:86 , srv1035191426:87 , srv1060674762:87 , srv1083635991:87 , srv1090574289:87 , srv1177971578:87 , srv1440033420:87 , srv1511877706:87 , srv1578874748:87 , srv1582338772:87 , srv1698803584:87 , srv1889051085:87 , srv2034154598:87 , srv325781732:87 , srv486258762:87 , srv552915709:87 , srv589911340:87 , srv1273458076:88 , srv1466858782:88 , srv1859604288:88 , srv1947538684:88 , srv1991438514:88 , srv2121807740:88 , srv216732564:88 , srv320072267:88 , srv631459648:88 , srv690734465:88 , srv815827575:88 , srv931089375:88 , srv100594892:89 , srv1650816911:89 , srv1817946193:89 , srv2017621773:89 , srv520484579:89 , srv86248973:89 , srv1535844864:90 , srv168072156:90 , srv1974172723:90 , srv396547652:90 , srv995182464:90 , srv168319858:91 , srv1859535819:91 , srv991498858:91 , srv1332203109:92 , srv1993063148:464 }
2023-11-15 14:55:17,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-15 14:55:17,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv565488212=80, srv572658380=81, srv1859535819=39, srv563872554=79, srv393325290=65, srv991498858=98, srv723115866=88, srv1807720391=35, srv164081537=29, srv1990398623=49, srv1899014892=43, srv364810989=63, srv1573376948=25, srv2104668481=57, srv473256590=70, srv1466858782=22, srv320072267=61, srv413960264=67, srv877009047=94, srv1413991048=20, srv1829295084=38, srv995182464=99, srv1086864023=8, srv520484579=75, srv1218231872=12, srv1063674866=6, srv931089375=95, srv86248973=93, srv2017621773=54, srv1017599903=1, srv325781732=62, srv1578874748=26, srv936194432=96, srv1143345375=10, srv1257164930=13, srv2034154598=55, srv426743181=68, srv1650816911=30, srv1889051085=41, srv2000098444=52, srv1060674762=4, srv1974172723=47, srv1360751892=17, srv396547652=66, srv1332203109=16, srv551258159=77, srv552915709=78, srv197745166=48, srv1083635991=7, srv168072156=31, srv366271195=64, srv751139593=89, srv1947538684=45, srv1805262208=34, srv2114303295=58, srv1817946193=36, srv1582338772=27, srv1378805269=19, srv543145161=76, srv102440500=2, srv1511877706=23, srv1859604288=40, srv1177971578=11, srv1375769659=18, srv646396013=84, srv1826891693=37, srv1955486960=46, srv20359130=56, srv778527970=90, srv1035191426=3, srv1061585520=5, srv589911340=82, srv683739958=85, srv1440033420=21, srv1698803584=33, srv1273458076=14, srv631459648=83, srv1993063148=51, srv201595022=53, srv1891147303=42, srv478839145=71, srv1991438514=50, srv486258762=72, srv827247313=92, srv694570372=87, srv216732564=60, srv1535844864=24, srv815827575=91, srv19222026=44, srv2121807740=59, srv445386515=69, srv159925020=28, srv1090574289=9, srv690734465=86, srv100594892=0, srv499054368=73, srv941888478=97, srv168319858=32, srv500095306=74, srv1309621180=15} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-15 14:55:17,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-15 14:55:17,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-15 14:55:17,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-15 14:55:17,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-15 14:55:17,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-15 14:55:17,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-15 14:55:17,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-15 14:55:17,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-15 14:55:17,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-15 14:55:17,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-15 14:55:17,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-15 14:55:17,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-15 14:55:17,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-15 14:55:17,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-15 14:55:17,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-15 14:55:17,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-15 14:55:17,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-15 14:55:17,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-15 14:55:17,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-15 14:55:17,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-15 14:55:17,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-15 14:55:17,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-15 14:55:17,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-15 14:55:17,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-15 14:55:17,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-15 14:55:17,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-15 14:55:17,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-15 14:55:17,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-15 14:55:17,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-15 14:55:17,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-15 14:55:17,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-15 14:55:17,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-15 14:55:17,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-15 14:55:17,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-15 14:55:17,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-15 14:55:17,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-15 14:55:17,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-15 14:55:17,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-15 14:55:17,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-15 14:55:17,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-15 14:55:17,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-15 14:55:17,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-15 14:55:17,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-15 14:55:17,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-15 14:55:17,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-15 14:55:17,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-15 14:55:17,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-15 14:55:17,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-15 14:55:17,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-15 14:55:17,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-15 14:55:17,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-15 14:55:17,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-15 14:55:17,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-15 14:55:17,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-15 14:55:17,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-15 14:55:17,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-15 14:55:17,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-15 14:55:17,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-15 14:55:17,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-15 14:55:17,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-15 14:55:17,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-15 14:55:17,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-15 14:55:17,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-15 14:55:17,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-15 14:55:17,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-15 14:55:17,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-15 14:55:17,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-15 14:55:17,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-15 14:55:17,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-15 14:55:17,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-15 14:55:17,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-15 14:55:17,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-15 14:55:17,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-15 14:55:17,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-15 14:55:17,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-15 14:55:17,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-15 14:55:17,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-15 14:55:17,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-15 14:55:17,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-15 14:55:17,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-15 14:55:17,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-15 14:55:17,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-15 14:55:17,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-15 14:55:17,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-15 14:55:17,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-15 14:55:17,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-15 14:55:17,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-15 14:55:17,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-15 14:55:17,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-15 14:55:17,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-15 14:55:17,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-15 14:55:17,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-15 14:55:17,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-15 14:55:17,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-15 14:55:17,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-15 14:55:17,955 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-15 14:55:17,955 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-15 14:55:17,955 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-15 14:55:17,955 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-15 14:55:17,955 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-15 14:55:17,955 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-15 14:55:18,068 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.042049679939214726, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.056192310484404866, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.042049679939214726, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17175, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24216666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-15 14:55:18,069 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-15 14:55:18,069 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.1768796366545401, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.042049679939214726, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.056192310484404866, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.042049679939214726, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17175, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24216666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-15 14:55:18,341 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 371 ms to try 5000 different iterations.  Found a solution that moves 2656 regions; Going from a computed imbalance of 0.1768796366545401 to a new imbalance of 0.013268063226567681. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023287057955289115); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03350461046720171, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2951111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023287057955289115); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04425, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-15 14:55:18,351 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1332203109:79 , srv168072156:81 , srv2017621773:81 , srv991498858:81 , srv1535844864:82 , srv1859604288:82 , srv1974172723:82 , srv690734465:82 , srv931089375:82 , srv1060674762:83 , srv1650816911:83 , srv1817946193:83 , srv1859535819:83 , srv1991438514:83 , srv2034154598:83 , srv396547652:83 , srv520484579:83 , srv631459648:83 , srv102440500:84 , srv1083635991:84 , srv1090574289:84 , srv1143345375:84 , srv1273458076:84 , srv1440033420:84 , srv1578874748:84 , srv168319858:84 , srv1698803584:84 , srv1990398623:84 , srv2000098444:84 , srv2121807740:84 , srv216732564:84 , srv320072267:84 , srv325781732:84 , srv486258762:84 , srv552915709:84 , srv86248973:84 , srv995182464:84 , srv100594892:85 , srv1063674866:85 , srv1177971578:85 , srv1466858782:85 , srv1511877706:85 , srv164081537:85 , srv1899014892:85 , srv364810989:85 , srv413960264:85 , srv543145161:85 , srv589911340:85 , srv1035191426:86 , srv1309621180:86 , srv1807720391:86 , srv1889051085:86 , srv19222026:86 , srv1947538684:86 , srv393325290:86 , srv426743181:86 , srv445386515:86 , srv473256590:86 , srv565488212:86 , srv694570372:86 , srv815827575:86 , srv936194432:86 , srv1218231872:87 , srv1375769659:87 , srv1573376948:87 , srv1582338772:87 , srv1805262208:87 , srv1955486960:87 , srv2104668481:87 , srv2114303295:87 , srv366271195:87 , srv478839145:87 , srv563872554:87 , srv572658380:87 , srv723115866:87 , srv877009047:87 , srv941888478:87 , srv1086864023:88 , srv1360751892:88 , srv159925020:88 , srv1829295084:88 , srv197745166:88 , srv500095306:88 , srv551258159:88 , srv646396013:88 , srv827247313:88 , srv1017599903:89 , srv1257164930:89 , srv1413991048:89 , srv20359130:89 , srv683739958:89 , srv778527970:89 , srv201595022:90 , srv499054368:90 , srv751139593:90 , srv1826891693:91 , srv1891147303:91 , srv1061585520:93 , srv1378805269:93 , srv1993063148:517 }
2023-11-15 14:55:18,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-15 14:55:18,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv565488212=80, srv572658380=81, srv1859535819=39, srv563872554=79, srv393325290=65, srv991498858=98, srv723115866=88, srv1807720391=35, srv164081537=29, srv1990398623=49, srv1899014892=43, srv364810989=63, srv1573376948=25, srv2104668481=57, srv473256590=70, srv1466858782=22, srv320072267=61, srv413960264=67, srv877009047=94, srv1413991048=20, srv1829295084=38, srv995182464=99, srv1086864023=8, srv520484579=75, srv1218231872=12, srv1063674866=6, srv931089375=95, srv86248973=93, srv2017621773=54, srv1017599903=1, srv325781732=62, srv1578874748=26, srv936194432=96, srv1143345375=10, srv1257164930=13, srv2034154598=55, srv426743181=68, srv1650816911=30, srv1889051085=41, srv2000098444=52, srv1060674762=4, srv1974172723=47, srv1360751892=17, srv396547652=66, srv1332203109=16, srv551258159=77, srv552915709=78, srv197745166=48, srv1083635991=7, srv168072156=31, srv366271195=64, srv751139593=89, srv1947538684=45, srv1805262208=34, srv2114303295=58, srv1817946193=36, srv1582338772=27, srv1378805269=19, srv543145161=76, srv102440500=2, srv1511877706=23, srv1859604288=40, srv1177971578=11, srv1375769659=18, srv646396013=84, srv1826891693=37, srv1955486960=46, srv20359130=56, srv778527970=90, srv1035191426=3, srv1061585520=5, srv589911340=82, srv683739958=85, srv1440033420=21, srv1698803584=33, srv1273458076=14, srv631459648=83, srv1993063148=51, srv201595022=53, srv1891147303=42, srv478839145=71, srv1991438514=50, srv486258762=72, srv827247313=92, srv694570372=87, srv216732564=60, srv1535844864=24, srv815827575=91, srv19222026=44, srv2121807740=59, srv445386515=69, srv159925020=28, srv1090574289=9, srv690734465=86, srv100594892=0, srv499054368=73, srv941888478=97, srv168319858=32, srv500095306=74, srv1309621180=15} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-15 14:55:18,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-15 14:55:18,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-15 14:55:18,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-15 14:55:18,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-15 14:55:18,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-15 14:55:18,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-15 14:55:18,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-15 14:55:18,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-15 14:55:18,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-15 14:55:18,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-15 14:55:18,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-15 14:55:18,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-15 14:55:18,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-15 14:55:18,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-15 14:55:18,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-15 14:55:18,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-15 14:55:18,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-15 14:55:18,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-15 14:55:18,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-15 14:55:18,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-15 14:55:18,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-15 14:55:18,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-15 14:55:18,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-15 14:55:18,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-15 14:55:18,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-15 14:55:18,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-15 14:55:18,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-15 14:55:18,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-15 14:55:18,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-15 14:55:18,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-15 14:55:18,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-15 14:55:18,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-15 14:55:18,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-15 14:55:18,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-15 14:55:18,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-15 14:55:18,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-15 14:55:18,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-15 14:55:18,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-15 14:55:18,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-15 14:55:18,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-15 14:55:18,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-15 14:55:18,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-15 14:55:18,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-15 14:55:18,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-15 14:55:18,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-15 14:55:18,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-15 14:55:18,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-15 14:55:18,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-15 14:55:18,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-15 14:55:18,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-15 14:55:18,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-15 14:55:18,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-15 14:55:18,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-15 14:55:18,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-15 14:55:18,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-15 14:55:18,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-15 14:55:18,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-15 14:55:18,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-15 14:55:18,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-15 14:55:18,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-15 14:55:18,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-15 14:55:18,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-15 14:55:18,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-15 14:55:18,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-15 14:55:18,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-15 14:55:18,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-15 14:55:18,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-15 14:55:18,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-15 14:55:18,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-15 14:55:18,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-15 14:55:18,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-15 14:55:18,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-15 14:55:18,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-15 14:55:18,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-15 14:55:18,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-15 14:55:18,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-15 14:55:18,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-15 14:55:18,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-15 14:55:18,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-15 14:55:18,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-15 14:55:18,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-15 14:55:18,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-15 14:55:18,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-15 14:55:18,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-15 14:55:18,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-15 14:55:18,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-15 14:55:18,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-15 14:55:18,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-15 14:55:18,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-15 14:55:18,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-15 14:55:18,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-15 14:55:18,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-15 14:55:18,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-15 14:55:18,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-15 14:55:18,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-15 14:55:18,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-15 14:55:18,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-15 14:55:18,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-15 14:55:18,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-15 14:55:18,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-15 14:55:18,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-15 14:55:18,483 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023287057955289115); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03350461046720171, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023287057955289115); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04425, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-15 14:55:18,483 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-15 14:55:18,483 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.013249465517070865, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023287057955289115); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03350461046720171, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023287057955289115); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04425, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-15 14:55:18,730 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 343 ms to try 5000 different iterations.  Found a solution that moves 964 regions; Going from a computed imbalance of 0.013249465517070865 to a new imbalance of 9.598592193214197E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006207534371868385); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.01009494767567595); MoveCostFunction : (multiplier=7.0, imbalance=0.10711111111111112, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006207534371868385); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.0E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00475); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-15 14:55:18,733 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv168319858:82 , srv1826891693:82 , srv499054368:82 , srv1017599903:83 , srv1061585520:83 , srv1378805269:83 , srv1582338772:83 , srv1829295084:83 , srv1859535819:83 , srv995182464:83 , srv100594892:84 , srv1035191426:84 , srv1086864023:84 , srv1466858782:84 , srv1573376948:84 , srv159925020:84 , srv1889051085:84 , srv1891147303:84 , srv1947538684:84 , srv197745166:84 , srv201595022:84 , srv2104668481:84 , srv396547652:84 , srv572658380:84 , srv86248973:84 , srv1257164930:85 , srv1375769659:85 , srv1511877706:85 , srv1535844864:85 , srv1807720391:85 , srv1817946193:85 , srv1974172723:85 , srv20359130:85 , srv2114303295:85 , srv216732564:85 , srv320072267:85 , srv478839145:85 , srv520484579:85 , srv646396013:85 , srv683739958:85 , srv751139593:85 , srv815827575:85 , srv827247313:85 , srv936194432:85 , srv991498858:85 , srv1090574289:86 , srv1177971578:86 , srv1273458076:86 , srv1332203109:86 , srv1360751892:86 , srv1440033420:86 , srv1578874748:86 , srv164081537:86 , srv1650816911:86 , srv1698803584:86 , srv1805262208:86 , srv1899014892:86 , srv1955486960:86 , srv2121807740:86 , srv413960264:86 , srv426743181:86 , srv473256590:86 , srv551258159:86 , srv552915709:86 , srv563872554:86 , srv565488212:86 , srv589911340:86 , srv631459648:86 , srv694570372:86 , srv723115866:86 , srv778527970:86 , srv102440500:87 , srv1060674762:87 , srv1063674866:87 , srv1143345375:87 , srv1309621180:87 , srv1413991048:87 , srv168072156:87 , srv1859604288:87 , srv1991438514:87 , srv2034154598:87 , srv325781732:87 , srv364810989:87 , srv366271195:87 , srv393325290:87 , srv486258762:87 , srv500095306:87 , srv543145161:87 , srv690734465:87 , srv877009047:87 , srv941888478:87 , srv1218231872:88 , srv19222026:88 , srv1990398623:88 , srv2000098444:88 , srv2017621773:88 , srv445386515:88 , srv931089375:88 , srv1083635991:89 , srv1993063148:532 }
2023-11-15 14:55:18,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-15 14:55:18,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv565488212=80, srv572658380=81, srv1859535819=39, srv563872554=79, srv393325290=65, srv991498858=98, srv723115866=88, srv1807720391=35, srv164081537=29, srv1990398623=49, srv1899014892=43, srv364810989=63, srv1573376948=25, srv2104668481=57, srv473256590=70, srv1466858782=22, srv320072267=61, srv413960264=67, srv877009047=94, srv1413991048=20, srv1829295084=38, srv995182464=99, srv1086864023=8, srv520484579=75, srv1218231872=12, srv1063674866=6, srv931089375=95, srv86248973=93, srv2017621773=54, srv1017599903=1, srv325781732=62, srv1578874748=26, srv936194432=96, srv1143345375=10, srv1257164930=13, srv2034154598=55, srv426743181=68, srv1650816911=30, srv1889051085=41, srv2000098444=52, srv1060674762=4, srv1974172723=47, srv1360751892=17, srv396547652=66, srv1332203109=16, srv551258159=77, srv552915709=78, srv197745166=48, srv1083635991=7, srv168072156=31, srv366271195=64, srv751139593=89, srv1947538684=45, srv1805262208=34, srv2114303295=58, srv1817946193=36, srv1582338772=27, srv1378805269=19, srv543145161=76, srv102440500=2, srv1511877706=23, srv1859604288=40, srv1177971578=11, srv1375769659=18, srv646396013=84, srv1826891693=37, srv1955486960=46, srv20359130=56, srv778527970=90, srv1035191426=3, srv1061585520=5, srv589911340=82, srv683739958=85, srv1440033420=21, srv1698803584=33, srv1273458076=14, srv631459648=83, srv1993063148=51, srv201595022=53, srv1891147303=42, srv478839145=71, srv1991438514=50, srv486258762=72, srv827247313=92, srv694570372=87, srv216732564=60, srv1535844864=24, srv815827575=91, srv19222026=44, srv2121807740=59, srv445386515=69, srv159925020=28, srv1090574289=9, srv690734465=86, srv100594892=0, srv499054368=73, srv941888478=97, srv168319858=32, srv500095306=74, srv1309621180=15} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-15 14:55:18,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-15 14:55:18,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-15 14:55:18,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-15 14:55:18,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-15 14:55:18,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-15 14:55:18,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-15 14:55:18,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-15 14:55:18,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-15 14:55:18,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-15 14:55:18,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-15 14:55:18,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-15 14:55:18,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-15 14:55:18,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-15 14:55:18,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-15 14:55:18,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-15 14:55:18,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-15 14:55:18,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-15 14:55:18,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-15 14:55:18,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-15 14:55:18,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-15 14:55:18,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-15 14:55:18,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-15 14:55:18,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-15 14:55:18,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-15 14:55:18,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-15 14:55:18,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-15 14:55:18,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-15 14:55:18,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-15 14:55:18,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-15 14:55:18,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-15 14:55:18,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-15 14:55:18,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-15 14:55:18,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-15 14:55:18,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-15 14:55:18,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-15 14:55:18,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-15 14:55:18,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-15 14:55:18,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-15 14:55:18,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-15 14:55:18,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-15 14:55:18,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-15 14:55:18,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-15 14:55:18,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-15 14:55:18,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-15 14:55:18,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-15 14:55:18,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-15 14:55:18,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-15 14:55:18,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-15 14:55:18,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-15 14:55:18,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-15 14:55:18,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-15 14:55:18,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-15 14:55:18,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-15 14:55:18,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-15 14:55:18,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-15 14:55:18,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-15 14:55:18,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-15 14:55:18,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-15 14:55:18,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-15 14:55:18,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-15 14:55:18,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-15 14:55:18,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-15 14:55:18,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-15 14:55:18,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-15 14:55:18,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-15 14:55:18,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-15 14:55:18,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-15 14:55:18,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-15 14:55:18,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-15 14:55:18,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-15 14:55:18,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-15 14:55:18,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-15 14:55:18,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-15 14:55:18,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-15 14:55:18,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-15 14:55:18,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-15 14:55:18,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-15 14:55:18,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-15 14:55:18,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-15 14:55:18,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-15 14:55:18,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-15 14:55:18,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-15 14:55:18,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-15 14:55:18,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-15 14:55:18,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-15 14:55:18,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-15 14:55:18,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-15 14:55:18,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-15 14:55:18,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-15 14:55:18,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-15 14:55:18,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-15 14:55:18,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-15 14:55:18,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-15 14:55:18,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-15 14:55:18,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-15 14:55:18,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-15 14:55:18,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-15 14:55:18,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-15 14:55:18,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-15 14:55:18,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-15 14:55:18,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-15 14:55:18,904 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006207534371868385); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.01009494767567595); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006207534371868385); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.0E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00475); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-15 14:55:18,904 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-15 14:55:18,904 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=9.531091470492322E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006207534371868385); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.01009494767567595); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006207534371868385); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.0E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00475); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-15 14:55:19,285 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 504 ms to try 5000 different iterations.  Found a solution that moves 242 regions; Going from a computed imbalance of 9.531091470492322E-4 to a new imbalance of 3.36016765069643E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0016412198797244363); MoveCostFunction : (multiplier=7.0, imbalance=0.02688888888888889, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-15 14:55:19,286 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1083635991:82 , srv778527970:83 , srv815827575:83 , srv931089375:83 , srv100594892:84 , srv1017599903:84 , srv1060674762:84 , srv1061585520:84 , srv1063674866:84 , srv1177971578:84 , srv1218231872:84 , srv1257164930:84 , srv1273458076:84 , srv1309621180:84 , srv1378805269:84 , srv1413991048:84 , srv1650816911:84 , srv168072156:84 , srv168319858:84 , srv1805262208:84 , srv1891147303:84 , srv19222026:84 , srv1991438514:84 , srv2000098444:84 , srv2017621773:84 , srv2034154598:84 , srv2121807740:84 , srv325781732:84 , srv364810989:84 , srv445386515:84 , srv486258762:84 , srv500095306:84 , srv520484579:84 , srv551258159:84 , srv563872554:84 , srv565488212:84 , srv589911340:84 , srv646396013:84 , srv723115866:84 , srv877009047:84 , srv941888478:84 , srv102440500:85 , srv1035191426:85 , srv1086864023:85 , srv1143345375:85 , srv1332203109:85 , srv1360751892:85 , srv1375769659:85 , srv1440033420:85 , srv1466858782:85 , srv1511877706:85 , srv1535844864:85 , srv1573376948:85 , srv1578874748:85 , srv1582338772:85 , srv159925020:85 , srv164081537:85 , srv1698803584:85 , srv1807720391:85 , srv1817946193:85 , srv1826891693:85 , srv1829295084:85 , srv1859535819:85 , srv1859604288:85 , srv1889051085:85 , srv1899014892:85 , srv1947538684:85 , srv1955486960:85 , srv1974172723:85 , srv197745166:85 , srv1990398623:85 , srv201595022:85 , srv20359130:85 , srv2104668481:85 , srv2114303295:85 , srv216732564:85 , srv320072267:85 , srv366271195:85 , srv393325290:85 , srv396547652:85 , srv413960264:85 , srv426743181:85 , srv473256590:85 , srv478839145:85 , srv499054368:85 , srv543145161:85 , srv552915709:85 , srv572658380:85 , srv631459648:85 , srv690734465:85 , srv694570372:85 , srv751139593:85 , srv827247313:85 , srv86248973:85 , srv936194432:85 , srv991498858:85 , srv995182464:85 , srv1090574289:86 , srv683739958:86 , srv1993063148:629 }
2023-11-15 14:55:19,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-15 14:55:19,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv565488212=80, srv572658380=81, srv1859535819=39, srv563872554=79, srv393325290=65, srv991498858=98, srv723115866=88, srv1807720391=35, srv164081537=29, srv1990398623=49, srv1899014892=43, srv364810989=63, srv1573376948=25, srv2104668481=57, srv473256590=70, srv1466858782=22, srv320072267=61, srv413960264=67, srv877009047=94, srv1413991048=20, srv1829295084=38, srv995182464=99, srv1086864023=8, srv520484579=75, srv1218231872=12, srv1063674866=6, srv931089375=95, srv86248973=93, srv2017621773=54, srv1017599903=1, srv325781732=62, srv1578874748=26, srv936194432=96, srv1143345375=10, srv1257164930=13, srv2034154598=55, srv426743181=68, srv1650816911=30, srv1889051085=41, srv2000098444=52, srv1060674762=4, srv1974172723=47, srv1360751892=17, srv396547652=66, srv1332203109=16, srv551258159=77, srv552915709=78, srv197745166=48, srv1083635991=7, srv168072156=31, srv366271195=64, srv751139593=89, srv1947538684=45, srv1805262208=34, srv2114303295=58, srv1817946193=36, srv1582338772=27, srv1378805269=19, srv543145161=76, srv102440500=2, srv1511877706=23, srv1859604288=40, srv1177971578=11, srv1375769659=18, srv646396013=84, srv1826891693=37, srv1955486960=46, srv20359130=56, srv778527970=90, srv1035191426=3, srv1061585520=5, srv589911340=82, srv683739958=85, srv1440033420=21, srv1698803584=33, srv1273458076=14, srv631459648=83, srv1993063148=51, srv201595022=53, srv1891147303=42, srv478839145=71, srv1991438514=50, srv486258762=72, srv827247313=92, srv694570372=87, srv216732564=60, srv1535844864=24, srv815827575=91, srv19222026=44, srv2121807740=59, srv445386515=69, srv159925020=28, srv1090574289=9, srv690734465=86, srv100594892=0, srv499054368=73, srv941888478=97, srv168319858=32, srv500095306=74, srv1309621180=15} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-15 14:55:19,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-15 14:55:19,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-15 14:55:19,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-15 14:55:19,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-15 14:55:19,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-15 14:55:19,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-15 14:55:19,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-15 14:55:19,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-15 14:55:19,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-15 14:55:19,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-15 14:55:19,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-15 14:55:19,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-15 14:55:19,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-15 14:55:19,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-15 14:55:19,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-15 14:55:19,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-15 14:55:19,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-15 14:55:19,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-15 14:55:19,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-15 14:55:19,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-15 14:55:19,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-15 14:55:19,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-15 14:55:19,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-15 14:55:19,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-15 14:55:19,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-15 14:55:19,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-15 14:55:19,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-15 14:55:19,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-15 14:55:19,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-15 14:55:19,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-15 14:55:19,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-15 14:55:19,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-15 14:55:19,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-15 14:55:19,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-15 14:55:19,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-15 14:55:19,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-15 14:55:19,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-15 14:55:19,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-15 14:55:19,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-15 14:55:19,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-15 14:55:19,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-15 14:55:19,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-15 14:55:19,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-15 14:55:19,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-15 14:55:19,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-15 14:55:19,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-15 14:55:19,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-15 14:55:19,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-15 14:55:19,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-15 14:55:19,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-15 14:55:19,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-15 14:55:19,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-15 14:55:19,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-15 14:55:19,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-15 14:55:19,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-15 14:55:19,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-15 14:55:19,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-15 14:55:19,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-15 14:55:19,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-15 14:55:19,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-15 14:55:19,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-15 14:55:19,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-15 14:55:19,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-15 14:55:19,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-15 14:55:19,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-15 14:55:19,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-15 14:55:19,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-15 14:55:19,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-15 14:55:19,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-15 14:55:19,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-15 14:55:19,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-15 14:55:19,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-15 14:55:19,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-15 14:55:19,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-15 14:55:19,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-15 14:55:19,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-15 14:55:19,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-15 14:55:19,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-15 14:55:19,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-15 14:55:19,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-15 14:55:19,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-15 14:55:19,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-15 14:55:19,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-15 14:55:19,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-15 14:55:19,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-15 14:55:19,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-15 14:55:19,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-15 14:55:19,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-15 14:55:19,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-15 14:55:19,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-15 14:55:19,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-15 14:55:19,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-15 14:55:19,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-15 14:55:19,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-15 14:55:19,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-15 14:55:19,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-15 14:55:19,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-15 14:55:19,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-15 14:55:19,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-15 14:55:19,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-15 14:55:19,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-15 14:55:19,416 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0016412198797244363); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-15 14:55:19,416 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-15 14:55:19,416 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=3.190715628925747E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0016412198797244363); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-15 14:55:19,660 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 346 ms to try 5000 different iterations.  Found a solution that moves 23 regions; Going from a computed imbalance of 3.190715628925747E-5 to a new imbalance of 6.193128181907117E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0013400504203456161); MoveCostFunction : (multiplier=7.0, imbalance=0.0025555555555555557); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-15 14:55:19,660 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1090574289:83 , srv1891147303:83 , srv1947538684:83 , srv1990398623:83 , srv426743181:83 , srv499054368:83 , srv683739958:83 , srv100594892:84 , srv1017599903:84 , srv102440500:84 , srv1035191426:84 , srv1061585520:84 , srv1063674866:84 , srv1083635991:84 , srv1086864023:84 , srv1143345375:84 , srv1177971578:84 , srv1218231872:84 , srv1257164930:84 , srv1273458076:84 , srv1332203109:84 , srv1360751892:84 , srv1375769659:84 , srv1378805269:84 , srv1413991048:84 , srv1440033420:84 , srv1466858782:84 , srv1511877706:84 , srv1535844864:84 , srv1573376948:84 , srv1578874748:84 , srv1582338772:84 , srv159925020:84 , srv164081537:84 , srv1650816911:84 , srv168072156:84 , srv1698803584:84 , srv1805262208:84 , srv1807720391:84 , srv1817946193:84 , srv1826891693:84 , srv1829295084:84 , srv1859535819:84 , srv1859604288:84 , srv1889051085:84 , srv1899014892:84 , srv19222026:84 , srv1955486960:84 , srv1974172723:84 , srv197745166:84 , srv1991438514:84 , srv2000098444:84 , srv201595022:84 , srv2017621773:84 , srv20359130:84 , srv2104668481:84 , srv2114303295:84 , srv2121807740:84 , srv216732564:84 , srv320072267:84 , srv325781732:84 , srv364810989:84 , srv366271195:84 , srv393325290:84 , srv396547652:84 , srv413960264:84 , srv445386515:84 , srv473256590:84 , srv478839145:84 , srv486258762:84 , srv500095306:84 , srv543145161:84 , srv551258159:84 , srv552915709:84 , srv563872554:84 , srv565488212:84 , srv572658380:84 , srv589911340:84 , srv631459648:84 , srv646396013:84 , srv690734465:84 , srv694570372:84 , srv723115866:84 , srv751139593:84 , srv815827575:84 , srv827247313:84 , srv86248973:84 , srv877009047:84 , srv936194432:84 , srv941888478:84 , srv991498858:84 , srv995182464:84 , srv1060674762:85 , srv1309621180:85 , srv168319858:85 , srv2034154598:85 , srv520484579:85 , srv778527970:85 , srv931089375:85 , srv1993063148:684 }
2023-11-15 14:55:19,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-15 14:55:19,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv565488212=80, srv572658380=81, srv1859535819=39, srv563872554=79, srv393325290=65, srv991498858=98, srv723115866=88, srv1807720391=35, srv164081537=29, srv1990398623=49, srv1899014892=43, srv364810989=63, srv1573376948=25, srv2104668481=57, srv473256590=70, srv1466858782=22, srv320072267=61, srv413960264=67, srv877009047=94, srv1413991048=20, srv1829295084=38, srv995182464=99, srv1086864023=8, srv520484579=75, srv1218231872=12, srv1063674866=6, srv931089375=95, srv86248973=93, srv2017621773=54, srv1017599903=1, srv325781732=62, srv1578874748=26, srv936194432=96, srv1143345375=10, srv1257164930=13, srv2034154598=55, srv426743181=68, srv1650816911=30, srv1889051085=41, srv2000098444=52, srv1060674762=4, srv1974172723=47, srv1360751892=17, srv396547652=66, srv1332203109=16, srv551258159=77, srv552915709=78, srv197745166=48, srv1083635991=7, srv168072156=31, srv366271195=64, srv751139593=89, srv1947538684=45, srv1805262208=34, srv2114303295=58, srv1817946193=36, srv1582338772=27, srv1378805269=19, srv543145161=76, srv102440500=2, srv1511877706=23, srv1859604288=40, srv1177971578=11, srv1375769659=18, srv646396013=84, srv1826891693=37, srv1955486960=46, srv20359130=56, srv778527970=90, srv1035191426=3, srv1061585520=5, srv589911340=82, srv683739958=85, srv1440033420=21, srv1698803584=33, srv1273458076=14, srv631459648=83, srv1993063148=51, srv201595022=53, srv1891147303=42, srv478839145=71, srv1991438514=50, srv486258762=72, srv827247313=92, srv694570372=87, srv216732564=60, srv1535844864=24, srv815827575=91, srv19222026=44, srv2121807740=59, srv445386515=69, srv159925020=28, srv1090574289=9, srv690734465=86, srv100594892=0, srv499054368=73, srv941888478=97, srv168319858=32, srv500095306=74, srv1309621180=15} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-15 14:55:19,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-15 14:55:19,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-15 14:55:19,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-15 14:55:19,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-15 14:55:19,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-15 14:55:19,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-15 14:55:19,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-15 14:55:19,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-15 14:55:19,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-15 14:55:19,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-15 14:55:19,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-15 14:55:19,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-15 14:55:19,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-15 14:55:19,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-15 14:55:19,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-15 14:55:19,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-15 14:55:19,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-15 14:55:19,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-15 14:55:19,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-15 14:55:19,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-15 14:55:19,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-15 14:55:19,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-15 14:55:19,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-15 14:55:19,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-15 14:55:19,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-15 14:55:19,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-15 14:55:19,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-15 14:55:19,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-15 14:55:19,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-15 14:55:19,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-15 14:55:19,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-15 14:55:19,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-15 14:55:19,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-15 14:55:19,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-15 14:55:19,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-15 14:55:19,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-15 14:55:19,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-15 14:55:19,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-15 14:55:19,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-15 14:55:19,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-15 14:55:19,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-15 14:55:19,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-15 14:55:19,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-15 14:55:19,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-15 14:55:19,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-15 14:55:19,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-15 14:55:19,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-15 14:55:19,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-15 14:55:19,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-15 14:55:19,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-15 14:55:19,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-15 14:55:19,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-15 14:55:19,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-15 14:55:19,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-15 14:55:19,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-15 14:55:19,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-15 14:55:19,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-15 14:55:19,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-15 14:55:19,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-15 14:55:19,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-15 14:55:19,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-15 14:55:19,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-15 14:55:19,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-15 14:55:19,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-15 14:55:19,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-15 14:55:19,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-15 14:55:19,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-15 14:55:19,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-15 14:55:19,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-15 14:55:19,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-15 14:55:19,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-15 14:55:19,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-15 14:55:19,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-15 14:55:19,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-15 14:55:19,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-15 14:55:19,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-15 14:55:19,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-15 14:55:19,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-15 14:55:19,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-15 14:55:19,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-15 14:55:19,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-15 14:55:19,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-15 14:55:19,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-15 14:55:19,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-15 14:55:19,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-15 14:55:19,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-15 14:55:19,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-15 14:55:19,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-15 14:55:19,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-15 14:55:19,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-15 14:55:19,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-15 14:55:19,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-15 14:55:19,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-15 14:55:19,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-15 14:55:19,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-15 14:55:19,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-15 14:55:19,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-15 14:55:19,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-15 14:55:19,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-15 14:55:19,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-15 14:55:19,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-15 14:55:19,786 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=6.032078739728369E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0013400504203456161); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-15 14:55:19,786 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1090574289:83 , srv1891147303:83 , srv1947538684:83 , srv1990398623:83 , srv426743181:83 , srv499054368:83 , srv683739958:83 , srv100594892:84 , srv1017599903:84 , srv102440500:84 , srv1035191426:84 , srv1061585520:84 , srv1063674866:84 , srv1083635991:84 , srv1086864023:84 , srv1143345375:84 , srv1177971578:84 , srv1218231872:84 , srv1257164930:84 , srv1273458076:84 , srv1332203109:84 , srv1360751892:84 , srv1375769659:84 , srv1378805269:84 , srv1413991048:84 , srv1440033420:84 , srv1466858782:84 , srv1511877706:84 , srv1535844864:84 , srv1573376948:84 , srv1578874748:84 , srv1582338772:84 , srv159925020:84 , srv164081537:84 , srv1650816911:84 , srv168072156:84 , srv1698803584:84 , srv1805262208:84 , srv1807720391:84 , srv1817946193:84 , srv1826891693:84 , srv1829295084:84 , srv1859535819:84 , srv1859604288:84 , srv1889051085:84 , srv1899014892:84 , srv19222026:84 , srv1955486960:84 , srv1974172723:84 , srv197745166:84 , srv1991438514:84 , srv2000098444:84 , srv201595022:84 , srv2017621773:84 , srv20359130:84 , srv2104668481:84 , srv2114303295:84 , srv2121807740:84 , srv216732564:84 , srv320072267:84 , srv325781732:84 , srv364810989:84 , srv366271195:84 , srv393325290:84 , srv396547652:84 , srv413960264:84 , srv445386515:84 , srv473256590:84 , srv478839145:84 , srv486258762:84 , srv500095306:84 , srv543145161:84 , srv551258159:84 , srv552915709:84 , srv563872554:84 , srv565488212:84 , srv572658380:84 , srv589911340:84 , srv631459648:84 , srv646396013:84 , srv690734465:84 , srv694570372:84 , srv723115866:84 , srv751139593:84 , srv815827575:84 , srv827247313:84 , srv86248973:84 , srv877009047:84 , srv936194432:84 , srv941888478:84 , srv991498858:84 , srv995182464:84 , srv1060674762:85 , srv1309621180:85 , srv168319858:85 , srv2034154598:85 , srv520484579:85 , srv778527970:85 , srv931089375:85 , srv1993063148:684 }
2023-11-15 14:55:19,812 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=164 (was 117) - SystemLoadAverage LEAK? -, ProcessCount=172 (was 174), AvailableMemoryMB=1249 (was 1731)
2023-11-15 14:55:19,821 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=164, ProcessCount=172, AvailableMemoryMB=1249
2023-11-15 14:55:19,821 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-11-15 14:55:19,822 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-11-15 14:55:19,835 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1041527323:84 , srv1049097559:84 , srv1062441434:84 , srv1072219370:84 , srv111842458:84 , srv117445676:84 , srv1187448442:84 , srv1244773809:84 , srv1283978043:84 , srv1439469495:84 , srv1486459654:84 , srv1575393604:84 , srv1587283506:84 , srv1656420206:84 , srv1824164059:84 , srv1841160315:84 , srv1842014036:84 , srv185744523:84 , srv2057019102:84 , srv271075680:84 , srv279916684:84 , srv318894412:84 , srv387797714:84 , srv483707021:84 , srv639129434:84 , srv729921462:84 , srv767297019:84 , srv911345170:84 , srv934548598:84 , srv706359938:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-11-15 14:55:19,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-15 14:55:19,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv279916684=20, srv271075680=19, srv1841160315=15, srv706359938=25, srv318894412=21, srv1049097559=1, srv767297019=27, srv1041527323=0, srv729921462=26, srv483707021=23, srv117445676=5, srv1587283506=12, srv111842458=4, srv1072219370=3, srv1656420206=13, srv185744523=17, srv639129434=24, srv1187448442=6, srv2057019102=18, srv1842014036=16, srv1575393604=11, srv1244773809=7, srv387797714=22, srv1824164059=14, srv1062441434=2, srv1283978043=8, srv911345170=28, srv1439469495=9, srv934548598=29, srv1486459654=10} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-15 14:55:19,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-15 14:55:19,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-15 14:55:19,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-15 14:55:19,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-15 14:55:19,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-15 14:55:19,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-15 14:55:19,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-15 14:55:19,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-15 14:55:19,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-15 14:55:19,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-15 14:55:19,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-15 14:55:19,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-15 14:55:19,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-15 14:55:19,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-15 14:55:19,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-15 14:55:19,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-15 14:55:19,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-15 14:55:19,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-15 14:55:19,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-15 14:55:19,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-15 14:55:19,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-15 14:55:19,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-15 14:55:19,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-15 14:55:19,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-15 14:55:19,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-15 14:55:19,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-15 14:55:19,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-15 14:55:19,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-15 14:55:19,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-15 14:55:19,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-15 14:55:19,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-11-15 14:55:19,878 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1586383661452209, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-15 14:55:19,879 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912692907575983, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1586383661452209, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-11-15 14:57:19,857 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5746284 different iterations.  Found a solution that moves 1856 regions; Going from a computed imbalance of 0.9912692907575983 to a new imbalance of 4.3319965896196796E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6874074074074074, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-15 14:57:19,865 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1041527323:90 , srv1049097559:90 , srv1062441434:90 , srv1072219370:90 , srv111842458:90 , srv117445676:90 , srv1187448442:90 , srv1244773809:90 , srv1283978043:90 , srv1439469495:90 , srv1486459654:90 , srv1575393604:90 , srv1587283506:90 , srv1656420206:90 , srv1824164059:90 , srv1841160315:90 , srv1842014036:90 , srv185744523:90 , srv2057019102:90 , srv271075680:90 , srv279916684:90 , srv318894412:90 , srv387797714:90 , srv483707021:90 , srv639129434:90 , srv706359938:90 , srv729921462:90 , srv767297019:90 , srv911345170:90 , srv934548598:90 }
2023-11-15 14:57:19,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-15 14:57:19,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv279916684=20, srv271075680=19, srv1841160315=15, srv706359938=25, srv318894412=21, srv1049097559=1, srv767297019=27, srv1041527323=0, srv729921462=26, srv483707021=23, srv117445676=5, srv1587283506=12, srv111842458=4, srv1072219370=3, srv1656420206=13, srv185744523=17, srv639129434=24, srv1187448442=6, srv2057019102=18, srv1842014036=16, srv1575393604=11, srv1244773809=7, srv387797714=22, srv1824164059=14, srv1062441434=2, srv1283978043=8, srv911345170=28, srv1439469495=9, srv934548598=29, srv1486459654=10} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-15 14:57:19,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-15 14:57:19,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-15 14:57:19,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-15 14:57:19,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-15 14:57:19,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-15 14:57:19,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-15 14:57:19,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-15 14:57:19,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-15 14:57:19,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-15 14:57:19,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-15 14:57:19,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-15 14:57:19,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-15 14:57:19,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-15 14:57:19,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-15 14:57:19,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-15 14:57:19,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-15 14:57:19,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-15 14:57:19,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-15 14:57:19,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-15 14:57:19,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-15 14:57:19,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-15 14:57:19,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-15 14:57:19,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-15 14:57:19,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-15 14:57:19,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-15 14:57:19,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-15 14:57:19,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-15 14:57:19,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-15 14:57:19,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-15 14:57:19,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-15 14:57:19,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-11-15 14:57:19,887 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-15 14:57:19,887 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1041527323:90 , srv1049097559:90 , srv1062441434:90 , srv1072219370:90 , srv111842458:90 , srv117445676:90 , srv1187448442:90 , srv1244773809:90 , srv1283978043:90 , srv1439469495:90 , srv1486459654:90 , srv1575393604:90 , srv1587283506:90 , srv1656420206:90 , srv1824164059:90 , srv1841160315:90 , srv1842014036:90 , srv185744523:90 , srv2057019102:90 , srv271075680:90 , srv279916684:90 , srv318894412:90 , srv387797714:90 , srv483707021:90 , srv639129434:90 , srv706359938:90 , srv729921462:90 , srv767297019:90 , srv911345170:90 , srv934548598:90 }
2023-11-15 14:57:19,903 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=136 (was 164), ProcessCount=167 (was 172), AvailableMemoryMB=1438 (was 1249) - AvailableMemoryMB LEAK? -