2023-05-24 14:53:18,273 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-05-24 14:53:18,546 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-05-24 14:53:18,650 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-05-24 14:53:18,707 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-05-24 14:53:18,713 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-05-24 14:53:18,724 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=264, MaxFileDescriptor=60000, SystemLoadAverage=433, ProcessCount=171, AvailableMemoryMB=5457
2023-05-24 14:53:18,726 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-05-24 14:53:18,727 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-05-24 14:53:18,858 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1034382654:84 , srv1034496429:84 , srv104659066:84 , srv1092777774:84 , srv113514778:84 , srv1178959162:84 , srv1186239565:84 , srv1188855174:84 , srv1191946852:84 , srv1206692721:84 , srv1271480586:84 , srv1304187668:84 , srv1349094480:84 , srv1358878082:84 , srv1359425406:84 , srv1369668011:84 , srv1402032997:84 , srv1410110145:84 , srv1436450658:84 , srv1459916823:84 , srv1476337358:84 , srv150744470:84 , srv1511488785:84 , srv152122195:84 , srv160346500:84 , srv1604244458:84 , srv1611255478:84 , srv161314746:84 , srv1630628659:84 , srv1704065806:84 , srv1709054715:84 , srv1726776353:84 , srv1754293643:84 , srv1787185065:84 , srv1794310021:84 , srv1829075913:84 , srv1846831013:84 , srv1847883240:84 , srv1861443118:84 , srv187028475:84 , srv1874031547:84 , srv1897387180:84 , srv1899654679:84 , srv1901005011:84 , srv1954910381:84 , srv1960121481:84 , srv1962832167:84 , srv1979831216:84 , srv1994503940:84 , srv2004105144:84 , srv2016808099:84 , srv2019038453:84 , srv2104151146:84 , srv243023332:84 , srv254575059:84 , srv255778218:84 , srv281149064:84 , srv305526439:84 , srv340112715:84 , srv378934991:84 , srv379259831:84 , srv392344697:84 , srv41617465:84 , srv421425445:84 , srv427451699:84 , srv434353355:84 , srv435684065:84 , srv447643933:84 , srv460610226:84 , srv485498115:84 , srv515925696:84 , srv516578977:84 , srv519888274:84 , srv544384773:84 , srv567505007:84 , srv575561574:84 , srv57594138:84 , srv580240094:84 , srv582757768:84 , srv594098439:84 , srv609641908:84 , srv675910592:84 , srv69264541:84 , srv696600431:84 , srv702264446:84 , srv73474718:84 , srv749060258:84 , srv775302469:84 , srv802705035:84 , srv823017456:84 , srv83561236:84 , srv889897785:84 , srv896650450:84 , srv91796242:84 , srv919712776:84 , srv92241904:84 , srv923706737:84 , srv94234526:84 , srv960967364:84 , srv32507445:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-05-24 14:53:18,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-24 14:53:18,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv94234526=98, srv802705035=89, srv1901005011=43, srv2019038453=51, srv889897785=92, srv1897387180=41, srv896650450=93, srv1794310021=34, srv1954910381=44, srv1191946852=8, srv1092777774=3, srv150744470=21, srv696600431=84, srv1829075913=35, srv255778218=55, srv516578977=72, srv243023332=53, srv1436450658=18, srv1349094480=12, srv702264446=85, srv960967364=99, srv2104151146=52, srv434353355=66, srv580240094=78, srv1630628659=28, srv1726776353=31, srv113514778=4, srv749060258=87, srv427451699=65, srv1304187668=11, srv1704065806=29, srv392344697=62, srv1962832167=46, srv1402032997=16, srv594098439=80, srv254575059=54, srv519888274=73, srv1899654679=42, srv1960121481=45, srv1034496429=1, srv69264541=83, srv823017456=90, srv2016808099=50, srv305526439=57, srv91796242=94, srv160346500=24, srv675910592=82, srv1994503940=48, srv1846831013=36, srv485498115=70, srv544384773=74, srv1979831216=47, srv1511488785=22, srv83561236=91, srv152122195=23, srv340112715=59, srv1206692721=9, srv1358878082=13, srv1410110145=17, srv1611255478=26, srv1709054715=30, srv187028475=39, srv1034382654=0, srv460610226=69, srv575561574=76, srv1754293643=32, srv32507445=58, srv919712776=95, srv1369668011=15, srv378934991=60, srv435684065=67, srv161314746=27, srv281149064=56, srv104659066=2, srv923706737=97, srv1271480586=10, srv1459916823=19, srv2004105144=49, srv515925696=71, srv567505007=75, srv609641908=81, srv73474718=86, srv447643933=68, srv582757768=79, srv775302469=88, srv379259831=61, srv57594138=77, srv92241904=96, srv1847883240=37, srv1186239565=6, srv1604244458=25, srv1359425406=14, srv1476337358=20, srv1861443118=38, srv1787185065=33, srv1188855174=7, srv41617465=63, srv1178959162=5, srv421425445=64, srv1874031547=40} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-24 14:53:18,938 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-24 14:53:18,938 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-24 14:53:18,938 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-24 14:53:18,938 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-24 14:53:18,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-24 14:53:18,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-24 14:53:18,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-24 14:53:18,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-24 14:53:18,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-24 14:53:18,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-24 14:53:18,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-24 14:53:18,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-24 14:53:18,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-24 14:53:18,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-24 14:53:18,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-24 14:53:18,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-24 14:53:18,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-24 14:53:18,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-24 14:53:18,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-24 14:53:18,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-24 14:53:18,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-24 14:53:18,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-24 14:53:18,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-24 14:53:18,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-24 14:53:18,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-24 14:53:18,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-24 14:53:18,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-24 14:53:18,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-24 14:53:18,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-24 14:53:18,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-24 14:53:18,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-24 14:53:18,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-24 14:53:18,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-24 14:53:18,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-24 14:53:18,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-24 14:53:18,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-24 14:53:18,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-24 14:53:18,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-24 14:53:18,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-24 14:53:18,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-24 14:53:18,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-24 14:53:18,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-24 14:53:18,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-24 14:53:18,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-24 14:53:18,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-24 14:53:18,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-24 14:53:18,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-24 14:53:18,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-24 14:53:18,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-24 14:53:18,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-24 14:53:18,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-24 14:53:18,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-24 14:53:18,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-24 14:53:18,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-24 14:53:18,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-24 14:53:18,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-24 14:53:18,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-24 14:53:18,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-24 14:53:18,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-24 14:53:18,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-24 14:53:18,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-24 14:53:18,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-24 14:53:18,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-24 14:53:18,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-24 14:53:18,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-24 14:53:18,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-24 14:53:18,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-24 14:53:18,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-24 14:53:18,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-24 14:53:18,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-24 14:53:18,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-24 14:53:18,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-24 14:53:18,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-24 14:53:18,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-24 14:53:18,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-24 14:53:18,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-24 14:53:18,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-24 14:53:18,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-24 14:53:18,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-24 14:53:18,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-24 14:53:18,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-24 14:53:18,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-24 14:53:18,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-24 14:53:18,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-24 14:53:18,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-24 14:53:18,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-24 14:53:18,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-24 14:53:18,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-24 14:53:18,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-24 14:53:18,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-24 14:53:18,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-24 14:53:18,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-24 14:53:18,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-24 14:53:18,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-24 14:53:18,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-24 14:53:18,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-24 14:53:18,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-24 14:53:18,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-24 14:53:18,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-24 14:53:18,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-24 14:53:18,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-24 14:53:19,107 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-24 14:53:19,107 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-24 14:53:19,107 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-24 14:53:19,599 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 628 ms to try 5000 different iterations.  Found a solution that moves 4667 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18273731506374427. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04062487349736172, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.055097098251089736, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5185555555555555, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04062487349736172, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17816666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24283333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-24 14:53:19,618 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1604244458:81 , srv1630628659:81 , srv582757768:81 , srv1402032997:82 , srv1787185065:82 , srv41617465:82 , srv435684065:82 , srv69264541:82 , srv896650450:82 , srv1092777774:83 , srv152122195:83 , srv2004105144:83 , srv379259831:83 , srv427451699:83 , srv485498115:83 , srv889897785:83 , srv1846831013:84 , srv1899654679:84 , srv378934991:84 , srv609641908:84 , srv73474718:84 , srv113514778:85 , srv1178959162:85 , srv1271480586:85 , srv1304187668:85 , srv1410110145:85 , srv1704065806:85 , srv1709054715:85 , srv1726776353:85 , srv1874031547:85 , srv340112715:85 , srv392344697:85 , srv421425445:85 , srv516578977:85 , srv519888274:85 , srv696600431:85 , srv702264446:85 , srv923706737:85 , srv1034382654:86 , srv1188855174:86 , srv1206692721:86 , srv1349094480:86 , srv1359425406:86 , srv161314746:86 , srv1794310021:86 , srv1954910381:86 , srv1979831216:86 , srv567505007:86 , srv802705035:86 , srv83561236:86 , srv919712776:86 , srv960967364:86 , srv104659066:87 , srv1186239565:87 , srv1369668011:87 , srv1459916823:87 , srv1476337358:87 , srv160346500:87 , srv1754293643:87 , srv1829075913:87 , srv1861443118:87 , srv2104151146:87 , srv281149064:87 , srv460610226:87 , srv515925696:87 , srv544384773:87 , srv594098439:87 , srv675910592:87 , srv91796242:87 , srv1191946852:88 , srv150744470:88 , srv1847883240:88 , srv1962832167:88 , srv1994503940:88 , srv243023332:88 , srv255778218:88 , srv305526439:88 , srv434353355:88 , srv447643933:88 , srv1034496429:89 , srv1897387180:89 , srv2019038453:89 , srv254575059:89 , srv580240094:89 , srv775302469:89 , srv1358878082:90 , srv187028475:90 , srv2016808099:90 , srv575561574:90 , srv57594138:90 , srv823017456:90 , srv92241904:90 , srv1436450658:91 , srv1511488785:91 , srv1611255478:91 , srv1960121481:91 , srv94234526:91 , srv749060258:92 , srv1901005011:94 , srv32507445:451 }
2023-05-24 14:53:19,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-24 14:53:19,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv94234526=98, srv802705035=89, srv1901005011=43, srv2019038453=51, srv889897785=92, srv1897387180=41, srv896650450=93, srv1794310021=34, srv1954910381=44, srv1191946852=8, srv1092777774=3, srv150744470=21, srv696600431=84, srv1829075913=35, srv255778218=55, srv516578977=72, srv243023332=53, srv1436450658=18, srv1349094480=12, srv702264446=85, srv960967364=99, srv2104151146=52, srv434353355=66, srv580240094=78, srv1630628659=28, srv1726776353=31, srv113514778=4, srv749060258=87, srv427451699=65, srv1304187668=11, srv1704065806=29, srv392344697=62, srv1962832167=46, srv1402032997=16, srv594098439=80, srv254575059=54, srv519888274=73, srv1899654679=42, srv1960121481=45, srv1034496429=1, srv69264541=83, srv823017456=90, srv2016808099=50, srv305526439=57, srv91796242=94, srv160346500=24, srv675910592=82, srv1994503940=48, srv1846831013=36, srv485498115=70, srv544384773=74, srv1979831216=47, srv1511488785=22, srv83561236=91, srv152122195=23, srv340112715=59, srv1206692721=9, srv1358878082=13, srv1410110145=17, srv1611255478=26, srv1709054715=30, srv187028475=39, srv1034382654=0, srv460610226=69, srv575561574=76, srv1754293643=32, srv32507445=58, srv919712776=95, srv1369668011=15, srv378934991=60, srv435684065=67, srv161314746=27, srv281149064=56, srv104659066=2, srv923706737=97, srv1271480586=10, srv1459916823=19, srv2004105144=49, srv515925696=71, srv567505007=75, srv609641908=81, srv73474718=86, srv447643933=68, srv582757768=79, srv775302469=88, srv379259831=61, srv57594138=77, srv92241904=96, srv1847883240=37, srv1186239565=6, srv1604244458=25, srv1359425406=14, srv1476337358=20, srv1861443118=38, srv1787185065=33, srv1188855174=7, srv41617465=63, srv1178959162=5, srv421425445=64, srv1874031547=40} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-24 14:53:19,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-24 14:53:19,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-24 14:53:19,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-24 14:53:19,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-24 14:53:19,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-24 14:53:19,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-24 14:53:19,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-24 14:53:19,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-24 14:53:19,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-24 14:53:19,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-24 14:53:19,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-24 14:53:19,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-24 14:53:19,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-24 14:53:19,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-24 14:53:19,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-24 14:53:19,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-24 14:53:19,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-24 14:53:19,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-24 14:53:19,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-24 14:53:19,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-24 14:53:19,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-24 14:53:19,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-24 14:53:19,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-24 14:53:19,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-24 14:53:19,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-24 14:53:19,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-24 14:53:19,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-24 14:53:19,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-24 14:53:19,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-24 14:53:19,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-24 14:53:19,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-24 14:53:19,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-24 14:53:19,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-24 14:53:19,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-24 14:53:19,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-24 14:53:19,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-24 14:53:19,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-24 14:53:19,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-24 14:53:19,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-24 14:53:19,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-24 14:53:19,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-24 14:53:19,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-24 14:53:19,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-24 14:53:19,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-24 14:53:19,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-24 14:53:19,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-24 14:53:19,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-24 14:53:19,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-24 14:53:19,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-24 14:53:19,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-24 14:53:19,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-24 14:53:19,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-24 14:53:19,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-24 14:53:19,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-24 14:53:19,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-24 14:53:19,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-24 14:53:19,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-24 14:53:19,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-24 14:53:19,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-24 14:53:19,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-24 14:53:19,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-24 14:53:19,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-24 14:53:19,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-24 14:53:19,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-24 14:53:19,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-24 14:53:19,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-24 14:53:19,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-24 14:53:19,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-24 14:53:19,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-24 14:53:19,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-24 14:53:19,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-24 14:53:19,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-24 14:53:19,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-24 14:53:19,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-24 14:53:19,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-24 14:53:19,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-24 14:53:19,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-24 14:53:19,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-24 14:53:19,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-24 14:53:19,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-24 14:53:19,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-24 14:53:19,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-24 14:53:19,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-24 14:53:19,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-24 14:53:19,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-24 14:53:19,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-24 14:53:19,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-24 14:53:19,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-24 14:53:19,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-24 14:53:19,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-24 14:53:19,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-24 14:53:19,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-24 14:53:19,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-24 14:53:19,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-24 14:53:19,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-24 14:53:19,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-24 14:53:19,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-24 14:53:19,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-24 14:53:19,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-24 14:53:19,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-24 14:53:19,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-24 14:53:19,753 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04062487349736172, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.055097098251089736, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04062487349736172, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17816666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24283333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-24 14:53:19,753 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-24 14:53:19,753 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.1827046360312813, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04062487349736172, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.055097098251089736, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04062487349736172, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17816666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24283333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-24 14:53:19,949 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 277 ms to try 5000 different iterations.  Found a solution that moves 2685 regions; Going from a computed imbalance of 0.1827046360312813 to a new imbalance of 0.0165888373641779. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023179709124074285); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03296428703881753, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29833333333333334, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023179709124074285); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013583333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04533333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-24 14:53:19,959 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1901005011:77 , srv94234526:78 , srv575561574:80 , srv1186239565:81 , srv1358878082:81 , srv1960121481:81 , srv823017456:81 , srv1436450658:82 , srv1611255478:82 , srv1897387180:82 , srv254575059:82 , srv305526439:82 , srv434353355:82 , srv447643933:82 , srv57594138:82 , srv580240094:82 , srv749060258:82 , srv1191946852:83 , srv187028475:83 , srv1962832167:83 , srv2019038453:83 , srv544384773:83 , srv594098439:83 , srv775302469:83 , srv92241904:83 , srv104659066:84 , srv150744470:84 , srv1511488785:84 , srv1829075913:84 , srv2016808099:84 , srv243023332:84 , srv255778218:84 , srv281149064:84 , srv515925696:84 , srv696600431:84 , srv702264446:84 , srv1034496429:85 , srv1304187668:85 , srv1349094480:85 , srv1459916823:85 , srv1476337358:85 , srv1847883240:85 , srv1899654679:85 , srv1954910381:85 , srv1994503940:85 , srv421425445:85 , srv567505007:85 , srv675910592:85 , srv83561236:85 , srv960967364:85 , srv1034382654:86 , srv1188855174:86 , srv1369668011:86 , srv161314746:86 , srv1709054715:86 , srv1726776353:86 , srv1794310021:86 , srv1861443118:86 , srv2104151146:86 , srv519888274:86 , srv91796242:86 , srv919712776:86 , srv113514778:87 , srv1271480586:87 , srv152122195:87 , srv160346500:87 , srv1754293643:87 , srv1979831216:87 , srv460610226:87 , srv889897785:87 , srv1092777774:88 , srv1178959162:88 , srv1206692721:88 , srv1410110145:88 , srv1704065806:88 , srv1846831013:88 , srv1874031547:88 , srv378934991:88 , srv392344697:88 , srv516578977:88 , srv1359425406:89 , srv1787185065:89 , srv340112715:89 , srv379259831:89 , srv41617465:89 , srv485498115:89 , srv609641908:89 , srv69264541:89 , srv1630628659:90 , srv2004105144:90 , srv435684065:90 , srv582757768:90 , srv73474718:90 , srv802705035:90 , srv923706737:90 , srv1402032997:91 , srv1604244458:91 , srv427451699:91 , srv896650450:91 , srv32507445:529 }
2023-05-24 14:53:19,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-24 14:53:19,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv94234526=98, srv802705035=89, srv1901005011=43, srv2019038453=51, srv889897785=92, srv1897387180=41, srv896650450=93, srv1794310021=34, srv1954910381=44, srv1191946852=8, srv1092777774=3, srv150744470=21, srv696600431=84, srv1829075913=35, srv255778218=55, srv516578977=72, srv243023332=53, srv1436450658=18, srv1349094480=12, srv702264446=85, srv960967364=99, srv2104151146=52, srv434353355=66, srv580240094=78, srv1630628659=28, srv1726776353=31, srv113514778=4, srv749060258=87, srv427451699=65, srv1304187668=11, srv1704065806=29, srv392344697=62, srv1962832167=46, srv1402032997=16, srv594098439=80, srv254575059=54, srv519888274=73, srv1899654679=42, srv1960121481=45, srv1034496429=1, srv69264541=83, srv823017456=90, srv2016808099=50, srv305526439=57, srv91796242=94, srv160346500=24, srv675910592=82, srv1994503940=48, srv1846831013=36, srv485498115=70, srv544384773=74, srv1979831216=47, srv1511488785=22, srv83561236=91, srv152122195=23, srv340112715=59, srv1206692721=9, srv1358878082=13, srv1410110145=17, srv1611255478=26, srv1709054715=30, srv187028475=39, srv1034382654=0, srv460610226=69, srv575561574=76, srv1754293643=32, srv32507445=58, srv919712776=95, srv1369668011=15, srv378934991=60, srv435684065=67, srv161314746=27, srv281149064=56, srv104659066=2, srv923706737=97, srv1271480586=10, srv1459916823=19, srv2004105144=49, srv515925696=71, srv567505007=75, srv609641908=81, srv73474718=86, srv447643933=68, srv582757768=79, srv775302469=88, srv379259831=61, srv57594138=77, srv92241904=96, srv1847883240=37, srv1186239565=6, srv1604244458=25, srv1359425406=14, srv1476337358=20, srv1861443118=38, srv1787185065=33, srv1188855174=7, srv41617465=63, srv1178959162=5, srv421425445=64, srv1874031547=40} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-24 14:53:19,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-24 14:53:19,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-24 14:53:19,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-24 14:53:19,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-24 14:53:19,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-24 14:53:19,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-24 14:53:19,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-24 14:53:19,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-24 14:53:19,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-24 14:53:19,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-24 14:53:19,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-24 14:53:19,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-24 14:53:19,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-24 14:53:19,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-24 14:53:19,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-24 14:53:19,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-24 14:53:19,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-24 14:53:19,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-24 14:53:19,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-24 14:53:19,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-24 14:53:19,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-24 14:53:19,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-24 14:53:19,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-24 14:53:19,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-24 14:53:19,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-24 14:53:19,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-24 14:53:19,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-24 14:53:19,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-24 14:53:19,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-24 14:53:19,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-24 14:53:19,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-24 14:53:19,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-24 14:53:19,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-24 14:53:19,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-24 14:53:19,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-24 14:53:19,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-24 14:53:19,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-24 14:53:19,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-24 14:53:19,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-24 14:53:19,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-24 14:53:19,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-24 14:53:19,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-24 14:53:19,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-24 14:53:19,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-24 14:53:19,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-24 14:53:19,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-24 14:53:19,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-24 14:53:19,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-24 14:53:19,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-24 14:53:19,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-24 14:53:19,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-24 14:53:19,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-24 14:53:19,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-24 14:53:19,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-24 14:53:19,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-24 14:53:19,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-24 14:53:19,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-24 14:53:19,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-24 14:53:19,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-24 14:53:19,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-24 14:53:19,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-24 14:53:19,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-24 14:53:19,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-24 14:53:19,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-24 14:53:19,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-24 14:53:19,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-24 14:53:19,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-24 14:53:19,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-24 14:53:19,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-24 14:53:19,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-24 14:53:19,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-24 14:53:19,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-24 14:53:19,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-24 14:53:19,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-24 14:53:19,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-24 14:53:19,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-24 14:53:19,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-24 14:53:19,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-24 14:53:19,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-24 14:53:19,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-24 14:53:19,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-24 14:53:19,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-24 14:53:19,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-24 14:53:19,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-24 14:53:19,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-24 14:53:19,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-24 14:53:19,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-24 14:53:19,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-24 14:53:19,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-24 14:53:19,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-24 14:53:19,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-24 14:53:19,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-24 14:53:19,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-24 14:53:19,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-24 14:53:19,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-24 14:53:19,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-24 14:53:19,996 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-24 14:53:19,996 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-24 14:53:19,996 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-24 14:53:19,996 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-24 14:53:19,996 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-24 14:53:20,096 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023179709124074285); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03296428703881753, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023179709124074285); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013583333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04533333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-24 14:53:20,096 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-24 14:53:20,097 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.016570036592340947, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023179709124074285); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03296428703881753, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023179709124074285); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013583333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04533333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-24 14:53:20,256 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 239 ms to try 5000 different iterations.  Found a solution that moves 1034 regions; Going from a computed imbalance of 0.016570036592340947 to a new imbalance of 4.5173543124710214E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006430535708627831); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006865715340592496); MoveCostFunction : (multiplier=7.0, imbalance=0.11488888888888889, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006430535708627831); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003416666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-24 14:53:20,257 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1206692721:83 , srv1359425406:83 , srv1511488785:83 , srv160346500:83 , srv2016808099:83 , srv427451699:83 , srv460610226:83 , srv73474718:83 , srv802705035:83 , srv923706737:83 , srv1034496429:84 , srv1178959162:84 , srv1369668011:84 , srv1436450658:84 , srv1754293643:84 , srv1847883240:84 , srv1861443118:84 , srv1874031547:84 , srv1979831216:84 , srv340112715:84 , srv392344697:84 , srv435684065:84 , srv516578977:84 , srv749060258:84 , srv896650450:84 , srv1034382654:85 , srv1188855174:85 , srv1271480586:85 , srv1402032997:85 , srv1410110145:85 , srv1459916823:85 , srv150744470:85 , srv1604244458:85 , srv161314746:85 , srv1704065806:85 , srv1794310021:85 , srv1846831013:85 , srv187028475:85 , srv1960121481:85 , srv1994503940:85 , srv2004105144:85 , srv2019038453:85 , srv2104151146:85 , srv243023332:85 , srv255778218:85 , srv485498115:85 , srv57594138:85 , srv609641908:85 , srv919712776:85 , srv92241904:85 , srv104659066:86 , srv1092777774:86 , srv113514778:86 , srv1349094480:86 , srv1358878082:86 , srv1476337358:86 , srv1611255478:86 , srv1726776353:86 , srv1897387180:86 , srv1901005011:86 , srv1954910381:86 , srv1962832167:86 , srv254575059:86 , srv281149064:86 , srv378934991:86 , srv379259831:86 , srv41617465:86 , srv515925696:86 , srv519888274:86 , srv580240094:86 , srv582757768:86 , srv675910592:86 , srv69264541:86 , srv775302469:86 , srv91796242:86 , srv960967364:86 , srv1191946852:87 , srv1304187668:87 , srv1630628659:87 , srv1709054715:87 , srv1787185065:87 , srv1829075913:87 , srv421425445:87 , srv434353355:87 , srv447643933:87 , srv567505007:87 , srv575561574:87 , srv594098439:87 , srv823017456:87 , srv83561236:87 , srv889897785:87 , srv152122195:88 , srv305526439:88 , srv696600431:88 , srv1186239565:89 , srv1899654679:89 , srv544384773:89 , srv702264446:89 , srv94234526:89 , srv32507445:535 }
2023-05-24 14:53:20,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-24 14:53:20,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv94234526=98, srv802705035=89, srv1901005011=43, srv2019038453=51, srv889897785=92, srv1897387180=41, srv896650450=93, srv1794310021=34, srv1954910381=44, srv1191946852=8, srv1092777774=3, srv150744470=21, srv696600431=84, srv1829075913=35, srv255778218=55, srv516578977=72, srv243023332=53, srv1436450658=18, srv1349094480=12, srv702264446=85, srv960967364=99, srv2104151146=52, srv434353355=66, srv580240094=78, srv1630628659=28, srv1726776353=31, srv113514778=4, srv749060258=87, srv427451699=65, srv1304187668=11, srv1704065806=29, srv392344697=62, srv1962832167=46, srv1402032997=16, srv594098439=80, srv254575059=54, srv519888274=73, srv1899654679=42, srv1960121481=45, srv1034496429=1, srv69264541=83, srv823017456=90, srv2016808099=50, srv305526439=57, srv91796242=94, srv160346500=24, srv675910592=82, srv1994503940=48, srv1846831013=36, srv485498115=70, srv544384773=74, srv1979831216=47, srv1511488785=22, srv83561236=91, srv152122195=23, srv340112715=59, srv1206692721=9, srv1358878082=13, srv1410110145=17, srv1611255478=26, srv1709054715=30, srv187028475=39, srv1034382654=0, srv460610226=69, srv575561574=76, srv1754293643=32, srv32507445=58, srv919712776=95, srv1369668011=15, srv378934991=60, srv435684065=67, srv161314746=27, srv281149064=56, srv104659066=2, srv923706737=97, srv1271480586=10, srv1459916823=19, srv2004105144=49, srv515925696=71, srv567505007=75, srv609641908=81, srv73474718=86, srv447643933=68, srv582757768=79, srv775302469=88, srv379259831=61, srv57594138=77, srv92241904=96, srv1847883240=37, srv1186239565=6, srv1604244458=25, srv1359425406=14, srv1476337358=20, srv1861443118=38, srv1787185065=33, srv1188855174=7, srv41617465=63, srv1178959162=5, srv421425445=64, srv1874031547=40} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-24 14:53:20,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-24 14:53:20,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-24 14:53:20,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-24 14:53:20,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-24 14:53:20,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-24 14:53:20,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-24 14:53:20,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-24 14:53:20,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-24 14:53:20,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-24 14:53:20,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-24 14:53:20,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-24 14:53:20,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-24 14:53:20,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-24 14:53:20,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-24 14:53:20,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-24 14:53:20,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-24 14:53:20,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-24 14:53:20,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-24 14:53:20,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-24 14:53:20,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-24 14:53:20,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-24 14:53:20,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-24 14:53:20,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-24 14:53:20,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-24 14:53:20,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-24 14:53:20,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-24 14:53:20,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-24 14:53:20,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-24 14:53:20,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-24 14:53:20,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-24 14:53:20,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-24 14:53:20,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-24 14:53:20,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-24 14:53:20,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-24 14:53:20,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-24 14:53:20,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-24 14:53:20,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-24 14:53:20,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-24 14:53:20,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-24 14:53:20,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-24 14:53:20,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-24 14:53:20,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-24 14:53:20,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-24 14:53:20,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-24 14:53:20,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-24 14:53:20,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-24 14:53:20,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-24 14:53:20,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-24 14:53:20,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-24 14:53:20,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-24 14:53:20,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-24 14:53:20,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-24 14:53:20,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-24 14:53:20,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-24 14:53:20,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-24 14:53:20,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-24 14:53:20,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-24 14:53:20,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-24 14:53:20,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-24 14:53:20,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-24 14:53:20,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-24 14:53:20,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-24 14:53:20,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-24 14:53:20,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-24 14:53:20,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-24 14:53:20,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-24 14:53:20,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-24 14:53:20,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-24 14:53:20,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-24 14:53:20,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-24 14:53:20,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-24 14:53:20,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-24 14:53:20,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-24 14:53:20,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-24 14:53:20,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-24 14:53:20,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-24 14:53:20,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-24 14:53:20,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-24 14:53:20,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-24 14:53:20,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-24 14:53:20,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-24 14:53:20,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-24 14:53:20,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-24 14:53:20,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-24 14:53:20,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-24 14:53:20,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-24 14:53:20,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-24 14:53:20,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-24 14:53:20,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-24 14:53:20,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-24 14:53:20,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-24 14:53:20,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-24 14:53:20,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-24 14:53:20,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-24 14:53:20,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-24 14:53:20,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-24 14:53:20,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-24 14:53:20,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-24 14:53:20,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-24 14:53:20,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-24 14:53:20,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-24 14:53:20,419 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006430535708627831); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006865715340592496); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006430535708627831); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003416666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-24 14:53:20,420 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-24 14:53:20,420 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=4.444952084987184E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006430535708627831); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006865715340592496); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006430535708627831); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003416666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-24 14:53:20,637 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 336 ms to try 5000 different iterations.  Found a solution that moves 252 regions; Going from a computed imbalance of 4.444952084987184E-4 to a new imbalance of 1.939797645560124E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.028, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-24 14:53:20,638 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1611255478:83 , srv544384773:83 , srv823017456:83 , srv91796242:83 , srv1034496429:84 , srv104659066:84 , srv113514778:84 , srv1191946852:84 , srv1359425406:84 , srv1402032997:84 , srv1410110145:84 , srv1476337358:84 , srv1511488785:84 , srv152122195:84 , srv1704065806:84 , srv1709054715:84 , srv1726776353:84 , srv1754293643:84 , srv1829075913:84 , srv187028475:84 , srv1899654679:84 , srv1962832167:84 , srv1979831216:84 , srv2004105144:84 , srv255778218:84 , srv305526439:84 , srv340112715:84 , srv378934991:84 , srv379259831:84 , srv515925696:84 , srv609641908:84 , srv675910592:84 , srv696600431:84 , srv702264446:84 , srv749060258:84 , srv775302469:84 , srv802705035:84 , srv83561236:84 , srv92241904:84 , srv923706737:84 , srv94234526:84 , srv1034382654:85 , srv1092777774:85 , srv1178959162:85 , srv1186239565:85 , srv1188855174:85 , srv1206692721:85 , srv1271480586:85 , srv1304187668:85 , srv1349094480:85 , srv1358878082:85 , srv1369668011:85 , srv1436450658:85 , srv1459916823:85 , srv150744470:85 , srv160346500:85 , srv1604244458:85 , srv161314746:85 , srv1630628659:85 , srv1787185065:85 , srv1794310021:85 , srv1846831013:85 , srv1847883240:85 , srv1861443118:85 , srv1874031547:85 , srv1897387180:85 , srv1901005011:85 , srv1954910381:85 , srv1960121481:85 , srv1994503940:85 , srv2016808099:85 , srv2019038453:85 , srv2104151146:85 , srv243023332:85 , srv254575059:85 , srv281149064:85 , srv392344697:85 , srv41617465:85 , srv421425445:85 , srv427451699:85 , srv434353355:85 , srv447643933:85 , srv460610226:85 , srv485498115:85 , srv516578977:85 , srv519888274:85 , srv567505007:85 , srv575561574:85 , srv57594138:85 , srv580240094:85 , srv582757768:85 , srv594098439:85 , srv69264541:85 , srv896650450:85 , srv919712776:85 , srv960967364:85 , srv435684065:86 , srv73474718:86 , srv889897785:86 , srv32507445:627 }
2023-05-24 14:53:20,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-24 14:53:20,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv94234526=98, srv802705035=89, srv1901005011=43, srv2019038453=51, srv889897785=92, srv1897387180=41, srv896650450=93, srv1794310021=34, srv1954910381=44, srv1191946852=8, srv1092777774=3, srv150744470=21, srv696600431=84, srv1829075913=35, srv255778218=55, srv516578977=72, srv243023332=53, srv1436450658=18, srv1349094480=12, srv702264446=85, srv960967364=99, srv2104151146=52, srv434353355=66, srv580240094=78, srv1630628659=28, srv1726776353=31, srv113514778=4, srv749060258=87, srv427451699=65, srv1304187668=11, srv1704065806=29, srv392344697=62, srv1962832167=46, srv1402032997=16, srv594098439=80, srv254575059=54, srv519888274=73, srv1899654679=42, srv1960121481=45, srv1034496429=1, srv69264541=83, srv823017456=90, srv2016808099=50, srv305526439=57, srv91796242=94, srv160346500=24, srv675910592=82, srv1994503940=48, srv1846831013=36, srv485498115=70, srv544384773=74, srv1979831216=47, srv1511488785=22, srv83561236=91, srv152122195=23, srv340112715=59, srv1206692721=9, srv1358878082=13, srv1410110145=17, srv1611255478=26, srv1709054715=30, srv187028475=39, srv1034382654=0, srv460610226=69, srv575561574=76, srv1754293643=32, srv32507445=58, srv919712776=95, srv1369668011=15, srv378934991=60, srv435684065=67, srv161314746=27, srv281149064=56, srv104659066=2, srv923706737=97, srv1271480586=10, srv1459916823=19, srv2004105144=49, srv515925696=71, srv567505007=75, srv609641908=81, srv73474718=86, srv447643933=68, srv582757768=79, srv775302469=88, srv379259831=61, srv57594138=77, srv92241904=96, srv1847883240=37, srv1186239565=6, srv1604244458=25, srv1359425406=14, srv1476337358=20, srv1861443118=38, srv1787185065=33, srv1188855174=7, srv41617465=63, srv1178959162=5, srv421425445=64, srv1874031547=40} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-24 14:53:20,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-24 14:53:20,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-24 14:53:20,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-24 14:53:20,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-24 14:53:20,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-24 14:53:20,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-24 14:53:20,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-24 14:53:20,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-24 14:53:20,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-24 14:53:20,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-24 14:53:20,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-24 14:53:20,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-24 14:53:20,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-24 14:53:20,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-24 14:53:20,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-24 14:53:20,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-24 14:53:20,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-24 14:53:20,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-24 14:53:20,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-24 14:53:20,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-24 14:53:20,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-24 14:53:20,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-24 14:53:20,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-24 14:53:20,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-24 14:53:20,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-24 14:53:20,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-24 14:53:20,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-24 14:53:20,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-24 14:53:20,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-24 14:53:20,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-24 14:53:20,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-24 14:53:20,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-24 14:53:20,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-24 14:53:20,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-24 14:53:20,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-24 14:53:20,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-24 14:53:20,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-24 14:53:20,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-24 14:53:20,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-24 14:53:20,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-24 14:53:20,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-24 14:53:20,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-24 14:53:20,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-24 14:53:20,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-24 14:53:20,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-24 14:53:20,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-24 14:53:20,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-24 14:53:20,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-24 14:53:20,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-24 14:53:20,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-24 14:53:20,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-24 14:53:20,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-24 14:53:20,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-24 14:53:20,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-24 14:53:20,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-24 14:53:20,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-24 14:53:20,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-24 14:53:20,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-24 14:53:20,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-24 14:53:20,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-24 14:53:20,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-24 14:53:20,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-24 14:53:20,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-24 14:53:20,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-24 14:53:20,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-24 14:53:20,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-24 14:53:20,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-24 14:53:20,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-24 14:53:20,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-24 14:53:20,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-24 14:53:20,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-24 14:53:20,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-24 14:53:20,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-24 14:53:20,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-24 14:53:20,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-24 14:53:20,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-24 14:53:20,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-24 14:53:20,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-24 14:53:20,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-24 14:53:20,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-24 14:53:20,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-24 14:53:20,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-24 14:53:20,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-24 14:53:20,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-24 14:53:20,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-24 14:53:20,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-24 14:53:20,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-24 14:53:20,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-24 14:53:20,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-24 14:53:20,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-24 14:53:20,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-24 14:53:20,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-24 14:53:20,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-24 14:53:20,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-24 14:53:20,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-24 14:53:20,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-24 14:53:20,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-24 14:53:20,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-24 14:53:20,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-24 14:53:20,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-24 14:53:20,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-24 14:53:20,791 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=1.7633434741294947E-5 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-24 14:53:20,792 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1611255478:83 , srv544384773:83 , srv823017456:83 , srv91796242:83 , srv1034496429:84 , srv104659066:84 , srv113514778:84 , srv1191946852:84 , srv1359425406:84 , srv1402032997:84 , srv1410110145:84 , srv1476337358:84 , srv1511488785:84 , srv152122195:84 , srv1704065806:84 , srv1709054715:84 , srv1726776353:84 , srv1754293643:84 , srv1829075913:84 , srv187028475:84 , srv1899654679:84 , srv1962832167:84 , srv1979831216:84 , srv2004105144:84 , srv255778218:84 , srv305526439:84 , srv340112715:84 , srv378934991:84 , srv379259831:84 , srv515925696:84 , srv609641908:84 , srv675910592:84 , srv696600431:84 , srv702264446:84 , srv749060258:84 , srv775302469:84 , srv802705035:84 , srv83561236:84 , srv92241904:84 , srv923706737:84 , srv94234526:84 , srv1034382654:85 , srv1092777774:85 , srv1178959162:85 , srv1186239565:85 , srv1188855174:85 , srv1206692721:85 , srv1271480586:85 , srv1304187668:85 , srv1349094480:85 , srv1358878082:85 , srv1369668011:85 , srv1436450658:85 , srv1459916823:85 , srv150744470:85 , srv160346500:85 , srv1604244458:85 , srv161314746:85 , srv1630628659:85 , srv1787185065:85 , srv1794310021:85 , srv1846831013:85 , srv1847883240:85 , srv1861443118:85 , srv1874031547:85 , srv1897387180:85 , srv1901005011:85 , srv1954910381:85 , srv1960121481:85 , srv1994503940:85 , srv2016808099:85 , srv2019038453:85 , srv2104151146:85 , srv243023332:85 , srv254575059:85 , srv281149064:85 , srv392344697:85 , srv41617465:85 , srv421425445:85 , srv427451699:85 , srv434353355:85 , srv447643933:85 , srv460610226:85 , srv485498115:85 , srv516578977:85 , srv519888274:85 , srv567505007:85 , srv575561574:85 , srv57594138:85 , srv580240094:85 , srv582757768:85 , srv594098439:85 , srv69264541:85 , srv896650450:85 , srv919712776:85 , srv960967364:85 , srv435684065:86 , srv73474718:86 , srv889897785:86 , srv32507445:627 }
2023-05-24 14:53:20,826 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=264 (was 264), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=433 (was 433), ProcessCount=171 (was 171), AvailableMemoryMB=4893 (was 5457)
2023-05-24 14:53:20,833 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=264, MaxFileDescriptor=60000, SystemLoadAverage=433, ProcessCount=171, AvailableMemoryMB=4890
2023-05-24 14:53:20,834 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-05-24 14:53:20,834 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-05-24 14:53:20,846 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1007643586:84 , srv1035262583:84 , srv103802626:84 , srv1068606284:84 , srv1075080154:84 , srv113056281:84 , srv1148596615:84 , srv1197502697:84 , srv1233991587:84 , srv1273649408:84 , srv1281467968:84 , srv1358375727:84 , srv1451516023:84 , srv1485773402:84 , srv1706269586:84 , srv1713205233:84 , srv1865610733:84 , srv1919110383:84 , srv1941946569:84 , srv2086957817:84 , srv229238250:84 , srv23478407:84 , srv243365409:84 , srv295765808:84 , srv306127902:84 , srv477710669:84 , srv511583174:84 , srv964415450:84 , srv967612206:84 , srv1582865657:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-05-24 14:53:20,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-24 14:53:20,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv477710669=26, srv967612206=29, srv306127902=25, srv1281467968=10, srv113056281=5, srv1451516023=12, srv1068606284=3, srv1941946569=19, srv23478407=22, srv1713205233=16, srv964415450=28, srv1706269586=15, srv1035262583=1, srv1919110383=18, srv295765808=24, srv1582865657=14, srv1197502697=7, srv103802626=2, srv1485773402=13, srv229238250=21, srv511583174=27, srv1148596615=6, srv1358375727=11, srv1007643586=0, srv243365409=23, srv1075080154=4, srv1273649408=9, srv2086957817=20, srv1233991587=8, srv1865610733=17} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-24 14:53:20,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-24 14:53:20,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-24 14:53:20,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-24 14:53:20,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-24 14:53:20,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-24 14:53:20,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-24 14:53:20,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-24 14:53:20,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-24 14:53:20,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-24 14:53:20,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-24 14:53:20,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-24 14:53:20,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-24 14:53:20,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-24 14:53:20,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-24 14:53:20,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-24 14:53:20,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-24 14:53:20,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-24 14:53:20,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-24 14:53:20,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-24 14:53:20,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-24 14:53:20,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-24 14:53:20,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-24 14:53:20,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-24 14:53:20,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-24 14:53:20,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-24 14:53:20,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-24 14:53:20,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-24 14:53:20,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-24 14:53:20,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-24 14:53:20,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-24 14:53:20,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-05-24 14:53:20,884 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0731705622465875, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-24 14:53:20,885 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912423601316681, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0731705622465875, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-05-24 14:55:20,867 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 10278575 different iterations.  Found a solution that moves 1841 regions; Going from a computed imbalance of 0.9912423601316681 to a new imbalance of 4.296985841319951E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6818518518518518, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-24 14:55:20,874 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1007643586:90 , srv1035262583:90 , srv103802626:90 , srv1068606284:90 , srv1075080154:90 , srv113056281:90 , srv1148596615:90 , srv1197502697:90 , srv1233991587:90 , srv1273649408:90 , srv1281467968:90 , srv1358375727:90 , srv1451516023:90 , srv1485773402:90 , srv1582865657:90 , srv1706269586:90 , srv1713205233:90 , srv1865610733:90 , srv1919110383:90 , srv1941946569:90 , srv2086957817:90 , srv229238250:90 , srv23478407:90 , srv243365409:90 , srv295765808:90 , srv306127902:90 , srv477710669:90 , srv511583174:90 , srv964415450:90 , srv967612206:90 }
2023-05-24 14:55:20,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-24 14:55:20,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv477710669=26, srv967612206=29, srv306127902=25, srv1281467968=10, srv113056281=5, srv1451516023=12, srv1068606284=3, srv1941946569=19, srv23478407=22, srv1713205233=16, srv964415450=28, srv1706269586=15, srv1035262583=1, srv1919110383=18, srv295765808=24, srv1582865657=14, srv1197502697=7, srv103802626=2, srv1485773402=13, srv229238250=21, srv511583174=27, srv1148596615=6, srv1358375727=11, srv1007643586=0, srv243365409=23, srv1075080154=4, srv1273649408=9, srv2086957817=20, srv1233991587=8, srv1865610733=17} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-24 14:55:20,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-24 14:55:20,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-24 14:55:20,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-24 14:55:20,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-24 14:55:20,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-24 14:55:20,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-24 14:55:20,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-24 14:55:20,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-24 14:55:20,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-24 14:55:20,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-24 14:55:20,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-24 14:55:20,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-24 14:55:20,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-24 14:55:20,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-24 14:55:20,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-24 14:55:20,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-24 14:55:20,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-24 14:55:20,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-24 14:55:20,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-24 14:55:20,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-24 14:55:20,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-24 14:55:20,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-24 14:55:20,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-24 14:55:20,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-24 14:55:20,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-24 14:55:20,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-24 14:55:20,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-24 14:55:20,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-24 14:55:20,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-24 14:55:20,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-24 14:55:20,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-05-24 14:55:20,890 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-24 14:55:20,890 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1007643586:90 , srv1035262583:90 , srv103802626:90 , srv1068606284:90 , srv1075080154:90 , srv113056281:90 , srv1148596615:90 , srv1197502697:90 , srv1233991587:90 , srv1273649408:90 , srv1281467968:90 , srv1358375727:90 , srv1451516023:90 , srv1485773402:90 , srv1582865657:90 , srv1706269586:90 , srv1713205233:90 , srv1865610733:90 , srv1919110383:90 , srv1941946569:90 , srv2086957817:90 , srv229238250:90 , srv23478407:90 , srv243365409:90 , srv295765808:90 , srv306127902:90 , srv477710669:90 , srv511583174:90 , srv964415450:90 , srv967612206:90 }
2023-05-24 14:55:20,901 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=264 (was 264), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=284 (was 433), ProcessCount=173 (was 171) - ProcessCount LEAK? -, AvailableMemoryMB=4539 (was 4890)