2023-10-02 10:53:25,009 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-10-02 10:53:25,293 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-10-02 10:53:25,400 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-10-02 10:53:25,464 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-02 10:53:25,471 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-10-02 10:53:25,484 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=361, ProcessCount=169, AvailableMemoryMB=2643
2023-10-02 10:53:25,486 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-02 10:53:25,487 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-10-02 10:53:25,621 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1020001970:84 , srv1030303015:84 , srv1037038389:84 , srv10435687:84 , srv1065184880:84 , srv1093131943:84 , srv1123638749:84 , srv1130340771:84 , srv1154504292:84 , srv1179231362:84 , srv1183988077:84 , srv122977469:84 , srv1236767913:84 , srv1259981215:84 , srv1292471028:84 , srv1294138457:84 , srv1319018644:84 , srv1343272452:84 , srv134408907:84 , srv1395463549:84 , srv1415393668:84 , srv1444126175:84 , srv1457057684:84 , srv1497148768:84 , srv1497725730:84 , srv1520677653:84 , srv1586853689:84 , srv1595376943:84 , srv1599627502:84 , srv160291477:84 , srv160699414:84 , srv1609933840:84 , srv1614443616:84 , srv1670624805:84 , srv1732035599:84 , srv180011187:84 , srv1809783955:84 , srv1843762316:84 , srv1859220975:84 , srv1873623349:84 , srv1893741785:84 , srv1963981183:84 , srv1972987024:84 , srv1992653703:84 , srv1994591275:84 , srv2004456643:84 , srv2008460183:84 , srv2010419497:84 , srv2039576150:84 , srv2042783912:84 , srv204964697:84 , srv2051301817:84 , srv2070241851:84 , srv2078267377:84 , srv2081977939:84 , srv2104542736:84 , srv213512063:84 , srv23150886:84 , srv245336530:84 , srv261238382:84 , srv266088684:84 , srv275494999:84 , srv338779846:84 , srv343623893:84 , srv392258681:84 , srv394262241:84 , srv451733443:84 , srv455340988:84 , srv468196167:84 , srv478208573:84 , srv523425032:84 , srv539545772:84 , srv542205035:84 , srv555306715:84 , srv61292446:84 , srv620127426:84 , srv621202128:84 , srv659785144:84 , srv719909394:84 , srv759516144:84 , srv759642208:84 , srv759823989:84 , srv766855218:84 , srv769752076:84 , srv775378253:84 , srv781446248:84 , srv786169212:84 , srv794595897:84 , srv796489269:84 , srv810722823:84 , srv841173240:84 , srv851120727:84 , srv856203994:84 , srv883045809:84 , srv888115547:84 , srv906319143:84 , srv937782886:84 , srv953238315:84 , srv96807858:84 , srv1635692455:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-10-02 10:53:25,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-02 10:53:25,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv180011187=36, srv719909394=79, srv1972987024=43, srv810722823=90, srv539545772=72, srv1037038389=2, srv953238315=98, srv1415393668=20, srv1497148768=23, srv1020001970=0, srv888115547=95, srv1444126175=21, srv841173240=91, srv1030303015=1, srv1520677653=25, srv478208573=70, srv781446248=86, srv1319018644=16, srv261238382=60, srv1635692455=33, srv2078267377=54, srv621202128=77, srv766855218=83, srv2104542736=56, srv122977469=11, srv275494999=62, srv392258681=65, srv523425032=71, srv1457057684=22, srv134408907=18, srv796489269=89, srv2008460183=47, srv468196167=69, srv266088684=61, srv1809783955=37, srv61292446=75, srv794595897=88, srv1963981183=42, srv96807858=99, srv1093131943=5, srv851120727=92, srv1236767913=12, srv1497725730=24, srv1732035599=35, srv2051301817=52, srv1130340771=7, srv1873623349=40, srv1259981215=13, srv759516144=80, srv786169212=87, srv2042783912=50, srv160291477=29, srv394262241=66, srv1183988077=10, srv1599627502=28, srv2010419497=48, srv659785144=78, srv1859220975=39, srv1292471028=14, srv775378253=85, srv1343272452=17, srv1994591275=45, srv1123638749=6, srv245336530=59, srv2039576150=49, srv1992653703=44, srv160699414=30, srv2070241851=53, srv883045809=94, srv1179231362=9, srv937782886=97, srv1893741785=41, srv1065184880=4, srv906319143=96, srv1294138457=15, srv1843762316=38, srv769752076=84, srv1595376943=27, srv455340988=68, srv1670624805=34, srv10435687=3, srv23150886=58, srv2081977939=55, srv620127426=76, srv338779846=63, srv759823989=82, srv213512063=57, srv451733443=67, srv759642208=81, srv1609933840=31, srv1614443616=32, srv343623893=64, srv1154504292=8, srv1395463549=19, srv2004456643=46, srv204964697=51, srv856203994=93, srv555306715=74, srv542205035=73, srv1586853689=26} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-02 10:53:25,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-02 10:53:25,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-02 10:53:25,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-02 10:53:25,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-02 10:53:25,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-02 10:53:25,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-02 10:53:25,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-02 10:53:25,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-02 10:53:25,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-02 10:53:25,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-02 10:53:25,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-02 10:53:25,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-02 10:53:25,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-02 10:53:25,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-02 10:53:25,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-02 10:53:25,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-02 10:53:25,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-02 10:53:25,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-02 10:53:25,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-02 10:53:25,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-02 10:53:25,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-02 10:53:25,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-02 10:53:25,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-02 10:53:25,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-02 10:53:25,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-02 10:53:25,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-02 10:53:25,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-02 10:53:25,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-02 10:53:25,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-02 10:53:25,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-02 10:53:25,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-02 10:53:25,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-02 10:53:25,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-02 10:53:25,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-02 10:53:25,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-02 10:53:25,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-02 10:53:25,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-02 10:53:25,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-02 10:53:25,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-02 10:53:25,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-02 10:53:25,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-02 10:53:25,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-02 10:53:25,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-02 10:53:25,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-02 10:53:25,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-02 10:53:25,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-02 10:53:25,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-02 10:53:25,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-02 10:53:25,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-02 10:53:25,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-02 10:53:25,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-02 10:53:25,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-02 10:53:25,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-02 10:53:25,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-02 10:53:25,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-02 10:53:25,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-02 10:53:25,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-02 10:53:25,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-02 10:53:25,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-02 10:53:25,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-02 10:53:25,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-02 10:53:25,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-02 10:53:25,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-02 10:53:25,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-02 10:53:25,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-02 10:53:25,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-02 10:53:25,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-02 10:53:25,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-02 10:53:25,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-02 10:53:25,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-02 10:53:25,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-02 10:53:25,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-02 10:53:25,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-02 10:53:25,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-02 10:53:25,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-02 10:53:25,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-02 10:53:25,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-02 10:53:25,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-02 10:53:25,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-02 10:53:25,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-02 10:53:25,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-02 10:53:25,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-02 10:53:25,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-02 10:53:25,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-02 10:53:25,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-02 10:53:25,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-02 10:53:25,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-02 10:53:25,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-02 10:53:25,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-02 10:53:25,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-02 10:53:25,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-02 10:53:25,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-02 10:53:25,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-02 10:53:25,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-02 10:53:25,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-02 10:53:25,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-02 10:53:25,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-02 10:53:25,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-02 10:53:25,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-02 10:53:25,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-02 10:53:25,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-02 10:53:25,883 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-02 10:53:25,883 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-02 10:53:25,883 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-02 10:53:26,197 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 451 ms to try 5000 different iterations.  Found a solution that moves 4672 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18036130570276493. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.040379173043325195, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05417890304679059, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5191111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.040379173043325195, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17533333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24483333333333332, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-02 10:53:26,209 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv769752076:81 , srv1020001970:82 , srv1994591275:82 , srv1595376943:83 , srv180011187:83 , srv468196167:83 , srv542205035:83 , srv759823989:83 , srv766855218:83 , srv851120727:83 , srv96807858:83 , srv1123638749:84 , srv1294138457:84 , srv1444126175:84 , srv160291477:84 , srv1609933840:84 , srv1963981183:84 , srv275494999:84 , srv338779846:84 , srv621202128:84 , srv1093131943:85 , srv1154504292:85 , srv1179231362:85 , srv1457057684:85 , srv1586853689:85 , srv1670624805:85 , srv1859220975:85 , srv2004456643:85 , srv204964697:85 , srv23150886:85 , srv343623893:85 , srv394262241:85 , srv455340988:85 , srv539545772:85 , srv61292446:85 , srv620127426:85 , srv781446248:85 , srv794595897:85 , srv810722823:85 , srv856203994:85 , srv888115547:85 , srv906319143:85 , srv1037038389:86 , srv1130340771:86 , srv1259981215:86 , srv1395463549:86 , srv1415393668:86 , srv1599627502:86 , srv1972987024:86 , srv1992653703:86 , srv2070241851:86 , srv2104542736:86 , srv245336530:86 , srv759642208:86 , srv786169212:86 , srv796489269:86 , srv953238315:86 , srv1065184880:87 , srv1292471028:87 , srv1343272452:87 , srv2042783912:87 , srv213512063:87 , srv478208573:87 , srv555306715:87 , srv759516144:87 , srv841173240:87 , srv883045809:87 , srv937782886:87 , srv134408907:88 , srv1497725730:88 , srv1893741785:88 , srv2051301817:88 , srv2078267377:88 , srv266088684:88 , srv451733443:88 , srv1183988077:89 , srv1236767913:89 , srv1319018644:89 , srv1520677653:89 , srv160699414:89 , srv1843762316:89 , srv1873623349:89 , srv2039576150:89 , srv2081977939:89 , srv261238382:89 , srv392258681:89 , srv659785144:89 , srv719909394:89 , srv1030303015:90 , srv122977469:90 , srv1497148768:90 , srv1614443616:90 , srv1809783955:90 , srv2010419497:90 , srv523425032:90 , srv10435687:91 , srv1732035599:91 , srv775378253:91 , srv2008460183:93 , srv1635692455:449 }
2023-10-02 10:53:26,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-02 10:53:26,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv180011187=36, srv719909394=79, srv1972987024=43, srv810722823=90, srv539545772=72, srv1037038389=2, srv953238315=98, srv1415393668=20, srv1497148768=23, srv1020001970=0, srv888115547=95, srv1444126175=21, srv841173240=91, srv1030303015=1, srv1520677653=25, srv478208573=70, srv781446248=86, srv1319018644=16, srv261238382=60, srv1635692455=33, srv2078267377=54, srv621202128=77, srv766855218=83, srv2104542736=56, srv122977469=11, srv275494999=62, srv392258681=65, srv523425032=71, srv1457057684=22, srv134408907=18, srv796489269=89, srv2008460183=47, srv468196167=69, srv266088684=61, srv1809783955=37, srv61292446=75, srv794595897=88, srv1963981183=42, srv96807858=99, srv1093131943=5, srv851120727=92, srv1236767913=12, srv1497725730=24, srv1732035599=35, srv2051301817=52, srv1130340771=7, srv1873623349=40, srv1259981215=13, srv759516144=80, srv786169212=87, srv2042783912=50, srv160291477=29, srv394262241=66, srv1183988077=10, srv1599627502=28, srv2010419497=48, srv659785144=78, srv1859220975=39, srv1292471028=14, srv775378253=85, srv1343272452=17, srv1994591275=45, srv1123638749=6, srv245336530=59, srv2039576150=49, srv1992653703=44, srv160699414=30, srv2070241851=53, srv883045809=94, srv1179231362=9, srv937782886=97, srv1893741785=41, srv1065184880=4, srv906319143=96, srv1294138457=15, srv1843762316=38, srv769752076=84, srv1595376943=27, srv455340988=68, srv1670624805=34, srv10435687=3, srv23150886=58, srv2081977939=55, srv620127426=76, srv338779846=63, srv759823989=82, srv213512063=57, srv451733443=67, srv759642208=81, srv1609933840=31, srv1614443616=32, srv343623893=64, srv1154504292=8, srv1395463549=19, srv2004456643=46, srv204964697=51, srv856203994=93, srv555306715=74, srv542205035=73, srv1586853689=26} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-02 10:53:26,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-02 10:53:26,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-02 10:53:26,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-02 10:53:26,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-02 10:53:26,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-02 10:53:26,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-02 10:53:26,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-02 10:53:26,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-02 10:53:26,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-02 10:53:26,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-02 10:53:26,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-02 10:53:26,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-02 10:53:26,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-02 10:53:26,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-02 10:53:26,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-02 10:53:26,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-02 10:53:26,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-02 10:53:26,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-02 10:53:26,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-02 10:53:26,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-02 10:53:26,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-02 10:53:26,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-02 10:53:26,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-02 10:53:26,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-02 10:53:26,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-02 10:53:26,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-02 10:53:26,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-02 10:53:26,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-02 10:53:26,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-02 10:53:26,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-02 10:53:26,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-02 10:53:26,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-02 10:53:26,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-02 10:53:26,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-02 10:53:26,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-02 10:53:26,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-02 10:53:26,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-02 10:53:26,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-02 10:53:26,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-02 10:53:26,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-02 10:53:26,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-02 10:53:26,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-02 10:53:26,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-02 10:53:26,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-02 10:53:26,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-02 10:53:26,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-02 10:53:26,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-02 10:53:26,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-02 10:53:26,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-02 10:53:26,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-02 10:53:26,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-02 10:53:26,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-02 10:53:26,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-02 10:53:26,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-02 10:53:26,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-02 10:53:26,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-02 10:53:26,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-02 10:53:26,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-02 10:53:26,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-02 10:53:26,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-02 10:53:26,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-02 10:53:26,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-02 10:53:26,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-02 10:53:26,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-02 10:53:26,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-02 10:53:26,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-02 10:53:26,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-02 10:53:26,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-02 10:53:26,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-02 10:53:26,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-02 10:53:26,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-02 10:53:26,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-02 10:53:26,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-02 10:53:26,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-02 10:53:26,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-02 10:53:26,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-02 10:53:26,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-02 10:53:26,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-02 10:53:26,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-02 10:53:26,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-02 10:53:26,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-02 10:53:26,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-02 10:53:26,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-02 10:53:26,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-02 10:53:26,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-02 10:53:26,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-02 10:53:26,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-02 10:53:26,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-02 10:53:26,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-02 10:53:26,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-02 10:53:26,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-02 10:53:26,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-02 10:53:26,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-02 10:53:26,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-02 10:53:26,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-02 10:53:26,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-02 10:53:26,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-02 10:53:26,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-02 10:53:26,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-02 10:53:26,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-02 10:53:26,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-02 10:53:26,394 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.040379173043325195, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05417890304679059, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.040379173043325195, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17533333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24483333333333332, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-02 10:53:26,394 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-02 10:53:26,394 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18032859165955367, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.040379173043325195, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05417890304679059, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.040379173043325195, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17533333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24483333333333332, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-02 10:53:26,701 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 443 ms to try 5000 different iterations.  Found a solution that moves 2681 regions; Going from a computed imbalance of 0.18032859165955367 to a new imbalance of 0.015593562723955177. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021843004543496705); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03162987407155247, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29788888888888887, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021843004543496705); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0125); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04525, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-02 10:53:26,710 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv2008460183:78 , srv1520677653:81 , srv1614443616:81 , srv1732035599:81 , srv451733443:81 , srv659785144:81 , srv1030303015:82 , srv10435687:82 , srv1183988077:82 , srv122977469:82 , srv1236767913:82 , srv1497148768:82 , srv1843762316:82 , srv2039576150:82 , srv2081977939:82 , srv523425032:82 , srv775378253:82 , srv1065184880:83 , srv1319018644:83 , srv134408907:83 , srv1809783955:83 , srv1893741785:83 , srv2010419497:83 , srv2078267377:83 , srv392258681:83 , srv478208573:83 , srv759516144:83 , srv1154504292:84 , srv1415393668:84 , srv1497725730:84 , srv1586853689:84 , srv160699414:84 , srv1873623349:84 , srv1992653703:84 , srv2104542736:84 , srv23150886:84 , srv266088684:84 , srv1037038389:85 , srv1259981215:85 , srv1292471028:85 , srv2042783912:85 , srv2051301817:85 , srv261238382:85 , srv394262241:85 , srv620127426:85 , srv719909394:85 , srv781446248:85 , srv796489269:85 , srv1343272452:86 , srv1444126175:86 , srv160291477:86 , srv786169212:86 , srv794595897:86 , srv883045809:86 , srv906319143:86 , srv937782886:86 , srv1093131943:87 , srv1130340771:87 , srv1179231362:87 , srv1670624805:87 , srv1972987024:87 , srv2004456643:87 , srv2070241851:87 , srv213512063:87 , srv275494999:87 , srv343623893:87 , srv455340988:87 , srv61292446:87 , srv856203994:87 , srv1123638749:88 , srv1395463549:88 , srv1457057684:88 , srv1609933840:88 , srv1859220975:88 , srv1994591275:88 , srv204964697:88 , srv245336530:88 , srv338779846:88 , srv555306715:88 , srv621202128:88 , srv759642208:88 , srv810722823:88 , srv841173240:88 , srv851120727:88 , srv888115547:88 , srv953238315:88 , srv1599627502:89 , srv96807858:89 , srv1020001970:90 , srv1294138457:90 , srv180011187:90 , srv468196167:90 , srv542205035:90 , srv759823989:90 , srv1595376943:91 , srv539545772:91 , srv769752076:91 , srv766855218:92 , srv1963981183:93 , srv1635692455:519 }
2023-10-02 10:53:26,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-02 10:53:26,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv180011187=36, srv719909394=79, srv1972987024=43, srv810722823=90, srv539545772=72, srv1037038389=2, srv953238315=98, srv1415393668=20, srv1497148768=23, srv1020001970=0, srv888115547=95, srv1444126175=21, srv841173240=91, srv1030303015=1, srv1520677653=25, srv478208573=70, srv781446248=86, srv1319018644=16, srv261238382=60, srv1635692455=33, srv2078267377=54, srv621202128=77, srv766855218=83, srv2104542736=56, srv122977469=11, srv275494999=62, srv392258681=65, srv523425032=71, srv1457057684=22, srv134408907=18, srv796489269=89, srv2008460183=47, srv468196167=69, srv266088684=61, srv1809783955=37, srv61292446=75, srv794595897=88, srv1963981183=42, srv96807858=99, srv1093131943=5, srv851120727=92, srv1236767913=12, srv1497725730=24, srv1732035599=35, srv2051301817=52, srv1130340771=7, srv1873623349=40, srv1259981215=13, srv759516144=80, srv786169212=87, srv2042783912=50, srv160291477=29, srv394262241=66, srv1183988077=10, srv1599627502=28, srv2010419497=48, srv659785144=78, srv1859220975=39, srv1292471028=14, srv775378253=85, srv1343272452=17, srv1994591275=45, srv1123638749=6, srv245336530=59, srv2039576150=49, srv1992653703=44, srv160699414=30, srv2070241851=53, srv883045809=94, srv1179231362=9, srv937782886=97, srv1893741785=41, srv1065184880=4, srv906319143=96, srv1294138457=15, srv1843762316=38, srv769752076=84, srv1595376943=27, srv455340988=68, srv1670624805=34, srv10435687=3, srv23150886=58, srv2081977939=55, srv620127426=76, srv338779846=63, srv759823989=82, srv213512063=57, srv451733443=67, srv759642208=81, srv1609933840=31, srv1614443616=32, srv343623893=64, srv1154504292=8, srv1395463549=19, srv2004456643=46, srv204964697=51, srv856203994=93, srv555306715=74, srv542205035=73, srv1586853689=26} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-02 10:53:26,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-02 10:53:26,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-02 10:53:26,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-02 10:53:26,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-02 10:53:26,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-02 10:53:26,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-02 10:53:26,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-02 10:53:26,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-02 10:53:26,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-02 10:53:26,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-02 10:53:26,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-02 10:53:26,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-02 10:53:26,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-02 10:53:26,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-02 10:53:26,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-02 10:53:26,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-02 10:53:26,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-02 10:53:26,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-02 10:53:26,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-02 10:53:26,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-02 10:53:26,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-02 10:53:26,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-02 10:53:26,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-02 10:53:26,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-02 10:53:26,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-02 10:53:26,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-02 10:53:26,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-02 10:53:26,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-02 10:53:26,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-02 10:53:26,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-02 10:53:26,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-02 10:53:26,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-02 10:53:26,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-02 10:53:26,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-02 10:53:26,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-02 10:53:26,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-02 10:53:26,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-02 10:53:26,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-02 10:53:26,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-02 10:53:26,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-02 10:53:26,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-02 10:53:26,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-02 10:53:26,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-02 10:53:26,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-02 10:53:26,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-02 10:53:26,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-02 10:53:26,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-02 10:53:26,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-02 10:53:26,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-02 10:53:26,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-02 10:53:26,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-02 10:53:26,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-02 10:53:26,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-02 10:53:26,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-02 10:53:26,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-02 10:53:26,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-02 10:53:26,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-02 10:53:26,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-02 10:53:26,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-02 10:53:26,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-02 10:53:26,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-02 10:53:26,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-02 10:53:26,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-02 10:53:26,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-02 10:53:26,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-02 10:53:26,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-02 10:53:26,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-02 10:53:26,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-02 10:53:26,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-02 10:53:26,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-02 10:53:26,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-02 10:53:26,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-02 10:53:26,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-02 10:53:26,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-02 10:53:26,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-02 10:53:26,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-02 10:53:26,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-02 10:53:26,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-02 10:53:26,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-02 10:53:26,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-02 10:53:26,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-02 10:53:26,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-02 10:53:26,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-02 10:53:26,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-02 10:53:26,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-02 10:53:26,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-02 10:53:26,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-02 10:53:26,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-02 10:53:26,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-02 10:53:26,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-02 10:53:26,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-02 10:53:26,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-02 10:53:26,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-02 10:53:26,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-02 10:53:26,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-02 10:53:26,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-02 10:53:26,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-02 10:53:26,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-02 10:53:26,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-02 10:53:26,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-02 10:53:26,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-02 10:53:26,886 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021843004543496705); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03162987407155247, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021843004543496705); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0125); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04525, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-02 10:53:26,887 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-02 10:53:26,887 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.015574789960716864, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021843004543496705); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03162987407155247, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021843004543496705); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0125); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04525, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-02 10:53:27,318 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 555 ms to try 5000 different iterations.  Found a solution that moves 991 regions; Going from a computed imbalance of 0.015574789960716864 to a new imbalance of 9.350627177344026E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005765937968227551); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006683480480676068); MoveCostFunction : (multiplier=7.0, imbalance=0.11011111111111112, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005765937968227551); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.0E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004666666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-02 10:53:27,320 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1963981183:80 , srv539545772:81 , srv766855218:82 , srv1294138457:83 , srv1599627502:83 , srv213512063:83 , srv245336530:83 , srv555306715:83 , srv719909394:83 , srv841173240:83 , srv953238315:83 , srv10435687:84 , srv1343272452:84 , srv1395463549:84 , srv1595376943:84 , srv160699414:84 , srv1972987024:84 , srv2010419497:84 , srv204964697:84 , srv2051301817:84 , srv2070241851:84 , srv468196167:84 , srv542205035:84 , srv759823989:84 , srv810722823:84 , srv883045809:84 , srv937782886:84 , srv1020001970:85 , srv1030303015:85 , srv1093131943:85 , srv1123638749:85 , srv1130340771:85 , srv1179231362:85 , srv122977469:85 , srv1292471028:85 , srv1457057684:85 , srv1497148768:85 , srv1497725730:85 , srv1670624805:85 , srv1732035599:85 , srv180011187:85 , srv1809783955:85 , srv1859220975:85 , srv1873623349:85 , srv261238382:85 , srv266088684:85 , srv338779846:85 , srv455340988:85 , srv61292446:85 , srv775378253:85 , srv888115547:85 , srv1183988077:86 , srv1236767913:86 , srv1319018644:86 , srv134408907:86 , srv1609933840:86 , srv1893741785:86 , srv2004456643:86 , srv2008460183:86 , srv2039576150:86 , srv2042783912:86 , srv2078267377:86 , srv343623893:86 , srv392258681:86 , srv523425032:86 , srv759642208:86 , srv769752076:86 , srv794595897:86 , srv851120727:86 , srv856203994:86 , srv906319143:86 , srv96807858:86 , srv1037038389:87 , srv1065184880:87 , srv1259981215:87 , srv1415393668:87 , srv1444126175:87 , srv1520677653:87 , srv160291477:87 , srv1614443616:87 , srv1843762316:87 , srv1992653703:87 , srv1994591275:87 , srv2081977939:87 , srv275494999:87 , srv621202128:87 , srv786169212:87 , srv796489269:87 , srv1586853689:88 , srv2104542736:88 , srv23150886:88 , srv394262241:88 , srv451733443:88 , srv478208573:88 , srv620127426:88 , srv659785144:88 , srv759516144:88 , srv1154504292:89 , srv781446248:89 , srv1635692455:541 }
2023-10-02 10:53:27,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-02 10:53:27,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv180011187=36, srv719909394=79, srv1972987024=43, srv810722823=90, srv539545772=72, srv1037038389=2, srv953238315=98, srv1415393668=20, srv1497148768=23, srv1020001970=0, srv888115547=95, srv1444126175=21, srv841173240=91, srv1030303015=1, srv1520677653=25, srv478208573=70, srv781446248=86, srv1319018644=16, srv261238382=60, srv1635692455=33, srv2078267377=54, srv621202128=77, srv766855218=83, srv2104542736=56, srv122977469=11, srv275494999=62, srv392258681=65, srv523425032=71, srv1457057684=22, srv134408907=18, srv796489269=89, srv2008460183=47, srv468196167=69, srv266088684=61, srv1809783955=37, srv61292446=75, srv794595897=88, srv1963981183=42, srv96807858=99, srv1093131943=5, srv851120727=92, srv1236767913=12, srv1497725730=24, srv1732035599=35, srv2051301817=52, srv1130340771=7, srv1873623349=40, srv1259981215=13, srv759516144=80, srv786169212=87, srv2042783912=50, srv160291477=29, srv394262241=66, srv1183988077=10, srv1599627502=28, srv2010419497=48, srv659785144=78, srv1859220975=39, srv1292471028=14, srv775378253=85, srv1343272452=17, srv1994591275=45, srv1123638749=6, srv245336530=59, srv2039576150=49, srv1992653703=44, srv160699414=30, srv2070241851=53, srv883045809=94, srv1179231362=9, srv937782886=97, srv1893741785=41, srv1065184880=4, srv906319143=96, srv1294138457=15, srv1843762316=38, srv769752076=84, srv1595376943=27, srv455340988=68, srv1670624805=34, srv10435687=3, srv23150886=58, srv2081977939=55, srv620127426=76, srv338779846=63, srv759823989=82, srv213512063=57, srv451733443=67, srv759642208=81, srv1609933840=31, srv1614443616=32, srv343623893=64, srv1154504292=8, srv1395463549=19, srv2004456643=46, srv204964697=51, srv856203994=93, srv555306715=74, srv542205035=73, srv1586853689=26} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-02 10:53:27,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-02 10:53:27,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-02 10:53:27,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-02 10:53:27,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-02 10:53:27,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-02 10:53:27,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-02 10:53:27,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-02 10:53:27,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-02 10:53:27,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-02 10:53:27,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-02 10:53:27,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-02 10:53:27,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-02 10:53:27,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-02 10:53:27,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-02 10:53:27,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-02 10:53:27,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-02 10:53:27,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-02 10:53:27,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-02 10:53:27,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-02 10:53:27,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-02 10:53:27,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-02 10:53:27,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-02 10:53:27,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-02 10:53:27,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-02 10:53:27,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-02 10:53:27,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-02 10:53:27,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-02 10:53:27,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-02 10:53:27,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-02 10:53:27,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-02 10:53:27,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-02 10:53:27,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-02 10:53:27,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-02 10:53:27,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-02 10:53:27,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-02 10:53:27,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-02 10:53:27,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-02 10:53:27,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-02 10:53:27,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-02 10:53:27,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-02 10:53:27,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-02 10:53:27,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-02 10:53:27,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-02 10:53:27,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-02 10:53:27,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-02 10:53:27,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-02 10:53:27,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-02 10:53:27,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-02 10:53:27,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-02 10:53:27,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-02 10:53:27,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-02 10:53:27,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-02 10:53:27,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-02 10:53:27,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-02 10:53:27,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-02 10:53:27,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-02 10:53:27,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-02 10:53:27,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-02 10:53:27,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-02 10:53:27,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-02 10:53:27,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-02 10:53:27,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-02 10:53:27,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-02 10:53:27,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-02 10:53:27,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-02 10:53:27,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-02 10:53:27,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-02 10:53:27,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-02 10:53:27,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-02 10:53:27,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-02 10:53:27,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-02 10:53:27,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-02 10:53:27,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-02 10:53:27,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-02 10:53:27,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-02 10:53:27,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-02 10:53:27,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-02 10:53:27,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-02 10:53:27,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-02 10:53:27,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-02 10:53:27,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-02 10:53:27,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-02 10:53:27,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-02 10:53:27,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-02 10:53:27,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-02 10:53:27,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-02 10:53:27,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-02 10:53:27,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-02 10:53:27,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-02 10:53:27,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-02 10:53:27,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-02 10:53:27,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-02 10:53:27,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-02 10:53:27,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-02 10:53:27,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-02 10:53:27,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-02 10:53:27,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-02 10:53:27,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-02 10:53:27,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-02 10:53:27,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-02 10:53:27,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-02 10:53:27,463 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005765937968227551); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006683480480676068); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005765937968227551); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.0E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004666666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-02 10:53:27,464 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-02 10:53:27,464 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=9.281235874213963E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005765937968227551); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006683480480676068); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005765937968227551); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.0E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004666666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-02 10:53:27,822 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 456 ms to try 5000 different iterations.  Found a solution that moves 231 regions; Going from a computed imbalance of 9.281235874213963E-4 to a new imbalance of 7.147678544564459E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.025666666666666667, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=6.666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-02 10:53:27,823 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv759642208:82 , srv261238382:83 , srv621202128:83 , srv775378253:83 , srv781446248:83 , srv786169212:83 , srv888115547:83 , srv1037038389:84 , srv1093131943:84 , srv1130340771:84 , srv1154504292:84 , srv1259981215:84 , srv1319018644:84 , srv1395463549:84 , srv1457057684:84 , srv1595376943:84 , srv1599627502:84 , srv160291477:84 , srv160699414:84 , srv1609933840:84 , srv1614443616:84 , srv180011187:84 , srv1809783955:84 , srv1843762316:84 , srv1859220975:84 , srv1893741785:84 , srv2004456643:84 , srv2042783912:84 , srv204964697:84 , srv2081977939:84 , srv2104542736:84 , srv275494999:84 , srv343623893:84 , srv392258681:84 , srv394262241:84 , srv478208573:84 , srv523425032:84 , srv542205035:84 , srv555306715:84 , srv620127426:84 , srv659785144:84 , srv769752076:84 , srv796489269:84 , srv841173240:84 , srv856203994:84 , srv1020001970:85 , srv1030303015:85 , srv10435687:85 , srv1065184880:85 , srv1123638749:85 , srv1183988077:85 , srv122977469:85 , srv1236767913:85 , srv1294138457:85 , srv1343272452:85 , srv134408907:85 , srv1415393668:85 , srv1444126175:85 , srv1497148768:85 , srv1497725730:85 , srv1520677653:85 , srv1586853689:85 , srv1670624805:85 , srv1732035599:85 , srv1873623349:85 , srv1963981183:85 , srv1972987024:85 , srv1994591275:85 , srv2008460183:85 , srv2010419497:85 , srv2039576150:85 , srv2070241851:85 , srv2078267377:85 , srv213512063:85 , srv23150886:85 , srv245336530:85 , srv266088684:85 , srv338779846:85 , srv451733443:85 , srv455340988:85 , srv468196167:85 , srv539545772:85 , srv61292446:85 , srv719909394:85 , srv759516144:85 , srv759823989:85 , srv766855218:85 , srv794595897:85 , srv810722823:85 , srv851120727:85 , srv883045809:85 , srv906319143:85 , srv937782886:85 , srv953238315:85 , srv96807858:85 , srv1179231362:86 , srv1292471028:86 , srv1992653703:86 , srv2051301817:86 , srv1635692455:634 }
2023-10-02 10:53:27,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-02 10:53:27,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv180011187=36, srv719909394=79, srv1972987024=43, srv810722823=90, srv539545772=72, srv1037038389=2, srv953238315=98, srv1415393668=20, srv1497148768=23, srv1020001970=0, srv888115547=95, srv1444126175=21, srv841173240=91, srv1030303015=1, srv1520677653=25, srv478208573=70, srv781446248=86, srv1319018644=16, srv261238382=60, srv1635692455=33, srv2078267377=54, srv621202128=77, srv766855218=83, srv2104542736=56, srv122977469=11, srv275494999=62, srv392258681=65, srv523425032=71, srv1457057684=22, srv134408907=18, srv796489269=89, srv2008460183=47, srv468196167=69, srv266088684=61, srv1809783955=37, srv61292446=75, srv794595897=88, srv1963981183=42, srv96807858=99, srv1093131943=5, srv851120727=92, srv1236767913=12, srv1497725730=24, srv1732035599=35, srv2051301817=52, srv1130340771=7, srv1873623349=40, srv1259981215=13, srv759516144=80, srv786169212=87, srv2042783912=50, srv160291477=29, srv394262241=66, srv1183988077=10, srv1599627502=28, srv2010419497=48, srv659785144=78, srv1859220975=39, srv1292471028=14, srv775378253=85, srv1343272452=17, srv1994591275=45, srv1123638749=6, srv245336530=59, srv2039576150=49, srv1992653703=44, srv160699414=30, srv2070241851=53, srv883045809=94, srv1179231362=9, srv937782886=97, srv1893741785=41, srv1065184880=4, srv906319143=96, srv1294138457=15, srv1843762316=38, srv769752076=84, srv1595376943=27, srv455340988=68, srv1670624805=34, srv10435687=3, srv23150886=58, srv2081977939=55, srv620127426=76, srv338779846=63, srv759823989=82, srv213512063=57, srv451733443=67, srv759642208=81, srv1609933840=31, srv1614443616=32, srv343623893=64, srv1154504292=8, srv1395463549=19, srv2004456643=46, srv204964697=51, srv856203994=93, srv555306715=74, srv542205035=73, srv1586853689=26} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-02 10:53:27,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-02 10:53:27,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-02 10:53:27,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-02 10:53:27,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-02 10:53:27,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-02 10:53:27,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-02 10:53:27,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-02 10:53:27,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-02 10:53:27,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-02 10:53:27,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-02 10:53:27,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-02 10:53:27,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-02 10:53:27,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-02 10:53:27,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-02 10:53:27,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-02 10:53:27,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-02 10:53:27,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-02 10:53:27,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-02 10:53:27,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-02 10:53:27,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-02 10:53:27,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-02 10:53:27,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-02 10:53:27,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-02 10:53:27,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-02 10:53:27,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-02 10:53:27,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-02 10:53:27,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-02 10:53:27,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-02 10:53:27,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-02 10:53:27,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-02 10:53:27,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-02 10:53:27,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-02 10:53:27,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-02 10:53:27,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-02 10:53:27,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-02 10:53:27,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-02 10:53:27,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-02 10:53:27,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-02 10:53:27,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-02 10:53:27,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-02 10:53:27,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-02 10:53:27,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-02 10:53:27,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-02 10:53:27,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-02 10:53:27,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-02 10:53:27,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-02 10:53:27,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-02 10:53:27,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-02 10:53:27,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-02 10:53:27,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-02 10:53:27,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-02 10:53:27,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-02 10:53:27,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-02 10:53:27,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-02 10:53:27,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-02 10:53:27,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-02 10:53:27,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-02 10:53:27,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-02 10:53:27,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-02 10:53:27,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-02 10:53:27,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-02 10:53:27,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-02 10:53:27,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-02 10:53:27,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-02 10:53:27,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-02 10:53:27,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-02 10:53:27,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-02 10:53:27,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-02 10:53:27,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-02 10:53:27,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-02 10:53:27,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-02 10:53:27,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-02 10:53:27,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-02 10:53:27,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-02 10:53:27,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-02 10:53:27,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-02 10:53:27,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-02 10:53:27,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-02 10:53:27,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-02 10:53:27,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-02 10:53:27,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-02 10:53:27,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-02 10:53:27,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-02 10:53:27,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-02 10:53:27,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-02 10:53:27,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-02 10:53:27,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-02 10:53:27,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-02 10:53:27,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-02 10:53:27,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-02 10:53:27,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-02 10:53:27,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-02 10:53:27,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-02 10:53:27,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-02 10:53:27,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-02 10:53:27,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-02 10:53:27,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-02 10:53:27,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-02 10:53:27,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-02 10:53:27,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-02 10:53:27,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-02 10:53:27,997 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=6.666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-02 10:53:27,997 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-02 10:53:27,998 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=6.985928887419717E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=6.666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-02 10:53:28,308 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 434 ms to try 5000 different iterations.  Found a solution that moves 29 regions; Going from a computed imbalance of 6.985928887419717E-5 to a new imbalance of 6.947131393970371E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014982219165849825); MoveCostFunction : (multiplier=7.0, imbalance=0.0032222222222222222); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-02 10:53:28,308 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1179231362:83 , srv1292471028:83 , srv1873623349:83 , srv1992653703:83 , srv2051301817:83 , srv759516144:83 , srv96807858:83 , srv1020001970:84 , srv1030303015:84 , srv1037038389:84 , srv10435687:84 , srv1065184880:84 , srv1123638749:84 , srv1130340771:84 , srv1154504292:84 , srv1183988077:84 , srv122977469:84 , srv1236767913:84 , srv1259981215:84 , srv1294138457:84 , srv1319018644:84 , srv1343272452:84 , srv134408907:84 , srv1395463549:84 , srv1415393668:84 , srv1444126175:84 , srv1457057684:84 , srv1497148768:84 , srv1497725730:84 , srv1520677653:84 , srv1586853689:84 , srv1595376943:84 , srv1599627502:84 , srv1609933840:84 , srv1614443616:84 , srv1670624805:84 , srv1732035599:84 , srv180011187:84 , srv1809783955:84 , srv1843762316:84 , srv1859220975:84 , srv1963981183:84 , srv1972987024:84 , srv1994591275:84 , srv2004456643:84 , srv2008460183:84 , srv2010419497:84 , srv2039576150:84 , srv2042783912:84 , srv2070241851:84 , srv2078267377:84 , srv2081977939:84 , srv2104542736:84 , srv213512063:84 , srv23150886:84 , srv245336530:84 , srv261238382:84 , srv266088684:84 , srv275494999:84 , srv338779846:84 , srv343623893:84 , srv392258681:84 , srv394262241:84 , srv451733443:84 , srv455340988:84 , srv468196167:84 , srv478208573:84 , srv523425032:84 , srv539545772:84 , srv555306715:84 , srv61292446:84 , srv620127426:84 , srv621202128:84 , srv659785144:84 , srv719909394:84 , srv759642208:84 , srv759823989:84 , srv766855218:84 , srv769752076:84 , srv781446248:84 , srv786169212:84 , srv794595897:84 , srv796489269:84 , srv810722823:84 , srv841173240:84 , srv851120727:84 , srv856203994:84 , srv883045809:84 , srv906319143:84 , srv937782886:84 , srv953238315:84 , srv1093131943:85 , srv160291477:85 , srv160699414:85 , srv1893741785:85 , srv204964697:85 , srv542205035:85 , srv775378253:85 , srv888115547:85 , srv1635692455:683 }
2023-10-02 10:53:28,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-02 10:53:28,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv180011187=36, srv719909394=79, srv1972987024=43, srv810722823=90, srv539545772=72, srv1037038389=2, srv953238315=98, srv1415393668=20, srv1497148768=23, srv1020001970=0, srv888115547=95, srv1444126175=21, srv841173240=91, srv1030303015=1, srv1520677653=25, srv478208573=70, srv781446248=86, srv1319018644=16, srv261238382=60, srv1635692455=33, srv2078267377=54, srv621202128=77, srv766855218=83, srv2104542736=56, srv122977469=11, srv275494999=62, srv392258681=65, srv523425032=71, srv1457057684=22, srv134408907=18, srv796489269=89, srv2008460183=47, srv468196167=69, srv266088684=61, srv1809783955=37, srv61292446=75, srv794595897=88, srv1963981183=42, srv96807858=99, srv1093131943=5, srv851120727=92, srv1236767913=12, srv1497725730=24, srv1732035599=35, srv2051301817=52, srv1130340771=7, srv1873623349=40, srv1259981215=13, srv759516144=80, srv786169212=87, srv2042783912=50, srv160291477=29, srv394262241=66, srv1183988077=10, srv1599627502=28, srv2010419497=48, srv659785144=78, srv1859220975=39, srv1292471028=14, srv775378253=85, srv1343272452=17, srv1994591275=45, srv1123638749=6, srv245336530=59, srv2039576150=49, srv1992653703=44, srv160699414=30, srv2070241851=53, srv883045809=94, srv1179231362=9, srv937782886=97, srv1893741785=41, srv1065184880=4, srv906319143=96, srv1294138457=15, srv1843762316=38, srv769752076=84, srv1595376943=27, srv455340988=68, srv1670624805=34, srv10435687=3, srv23150886=58, srv2081977939=55, srv620127426=76, srv338779846=63, srv759823989=82, srv213512063=57, srv451733443=67, srv759642208=81, srv1609933840=31, srv1614443616=32, srv343623893=64, srv1154504292=8, srv1395463549=19, srv2004456643=46, srv204964697=51, srv856203994=93, srv555306715=74, srv542205035=73, srv1586853689=26} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-02 10:53:28,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-02 10:53:28,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-02 10:53:28,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-02 10:53:28,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-02 10:53:28,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-02 10:53:28,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-02 10:53:28,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-02 10:53:28,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-02 10:53:28,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-02 10:53:28,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-02 10:53:28,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-02 10:53:28,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-02 10:53:28,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-02 10:53:28,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-02 10:53:28,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-02 10:53:28,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-02 10:53:28,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-02 10:53:28,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-02 10:53:28,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-02 10:53:28,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-02 10:53:28,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-02 10:53:28,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-02 10:53:28,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-02 10:53:28,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-02 10:53:28,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-02 10:53:28,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-02 10:53:28,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-02 10:53:28,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-02 10:53:28,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-02 10:53:28,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-02 10:53:28,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-02 10:53:28,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-02 10:53:28,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-02 10:53:28,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-02 10:53:28,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-02 10:53:28,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-02 10:53:28,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-02 10:53:28,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-02 10:53:28,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-02 10:53:28,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-02 10:53:28,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-02 10:53:28,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-02 10:53:28,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-02 10:53:28,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-02 10:53:28,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-02 10:53:28,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-02 10:53:28,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-02 10:53:28,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-02 10:53:28,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-02 10:53:28,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-02 10:53:28,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-02 10:53:28,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-02 10:53:28,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-02 10:53:28,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-02 10:53:28,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-02 10:53:28,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-02 10:53:28,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-02 10:53:28,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-02 10:53:28,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-02 10:53:28,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-02 10:53:28,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-02 10:53:28,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-02 10:53:28,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-02 10:53:28,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-02 10:53:28,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-02 10:53:28,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-02 10:53:28,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-02 10:53:28,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-02 10:53:28,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-02 10:53:28,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-02 10:53:28,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-02 10:53:28,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-02 10:53:28,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-02 10:53:28,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-02 10:53:28,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-02 10:53:28,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-02 10:53:28,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-02 10:53:28,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-02 10:53:28,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-02 10:53:28,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-02 10:53:28,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-02 10:53:28,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-02 10:53:28,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-02 10:53:28,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-02 10:53:28,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-02 10:53:28,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-02 10:53:28,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-02 10:53:28,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-02 10:53:28,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-02 10:53:28,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-02 10:53:28,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-02 10:53:28,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-02 10:53:28,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-02 10:53:28,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-02 10:53:28,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-02 10:53:28,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-02 10:53:28,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-02 10:53:28,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-02 10:53:28,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-02 10:53:28,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-02 10:53:28,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-02 10:53:28,464 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=6.744069053831948E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014982219165849825); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-02 10:53:28,464 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1179231362:83 , srv1292471028:83 , srv1873623349:83 , srv1992653703:83 , srv2051301817:83 , srv759516144:83 , srv96807858:83 , srv1020001970:84 , srv1030303015:84 , srv1037038389:84 , srv10435687:84 , srv1065184880:84 , srv1123638749:84 , srv1130340771:84 , srv1154504292:84 , srv1183988077:84 , srv122977469:84 , srv1236767913:84 , srv1259981215:84 , srv1294138457:84 , srv1319018644:84 , srv1343272452:84 , srv134408907:84 , srv1395463549:84 , srv1415393668:84 , srv1444126175:84 , srv1457057684:84 , srv1497148768:84 , srv1497725730:84 , srv1520677653:84 , srv1586853689:84 , srv1595376943:84 , srv1599627502:84 , srv1609933840:84 , srv1614443616:84 , srv1670624805:84 , srv1732035599:84 , srv180011187:84 , srv1809783955:84 , srv1843762316:84 , srv1859220975:84 , srv1963981183:84 , srv1972987024:84 , srv1994591275:84 , srv2004456643:84 , srv2008460183:84 , srv2010419497:84 , srv2039576150:84 , srv2042783912:84 , srv2070241851:84 , srv2078267377:84 , srv2081977939:84 , srv2104542736:84 , srv213512063:84 , srv23150886:84 , srv245336530:84 , srv261238382:84 , srv266088684:84 , srv275494999:84 , srv338779846:84 , srv343623893:84 , srv392258681:84 , srv394262241:84 , srv451733443:84 , srv455340988:84 , srv468196167:84 , srv478208573:84 , srv523425032:84 , srv539545772:84 , srv555306715:84 , srv61292446:84 , srv620127426:84 , srv621202128:84 , srv659785144:84 , srv719909394:84 , srv759642208:84 , srv759823989:84 , srv766855218:84 , srv769752076:84 , srv781446248:84 , srv786169212:84 , srv794595897:84 , srv796489269:84 , srv810722823:84 , srv841173240:84 , srv851120727:84 , srv856203994:84 , srv883045809:84 , srv906319143:84 , srv937782886:84 , srv953238315:84 , srv1093131943:85 , srv160291477:85 , srv160699414:85 , srv1893741785:85 , srv204964697:85 , srv542205035:85 , srv775378253:85 , srv888115547:85 , srv1635692455:683 }
2023-10-02 10:53:28,495 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=361 (was 361), ProcessCount=169 (was 169), AvailableMemoryMB=2686 (was 2643) - AvailableMemoryMB LEAK? -
2023-10-02 10:53:28,505 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=265, MaxFileDescriptor=60000, SystemLoadAverage=361, ProcessCount=169, AvailableMemoryMB=2684
2023-10-02 10:53:28,505 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-02 10:53:28,506 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-10-02 10:53:28,516 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1047407883:84 , srv1058481465:84 , srv114811075:84 , srv1173861159:84 , srv1323002407:84 , srv1444245009:84 , srv149980097:84 , srv162942239:84 , srv1648233908:84 , srv1722278900:84 , srv1787260939:84 , srv1821203163:84 , srv18375360:84 , srv193648603:84 , srv1938809060:84 , srv1999078581:84 , srv2136985710:84 , srv264842522:84 , srv272522050:84 , srv290701363:84 , srv349754988:84 , srv496090462:84 , srv787011650:84 , srv799930009:84 , srv825455690:84 , srv862879413:84 , srv866933466:84 , srv876842906:84 , srv993270960:84 , srv1810107632:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-10-02 10:53:28,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-02 10:53:28,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv825455690=25, srv1047407883=0, srv18375360=13, srv193648603=14, srv862879413=26, srv2136985710=17, srv162942239=7, srv272522050=19, srv1173861159=3, srv1810107632=11, srv149980097=6, srv1444245009=5, srv1999078581=16, srv799930009=24, srv876842906=28, srv993270960=29, srv1722278900=9, srv290701363=20, srv1323002407=4, srv866933466=27, srv1787260939=10, srv1821203163=12, srv1058481465=1, srv496090462=22, srv1938809060=15, srv264842522=18, srv349754988=21, srv1648233908=8, srv114811075=2, srv787011650=23} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-02 10:53:28,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-02 10:53:28,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-02 10:53:28,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-02 10:53:28,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-02 10:53:28,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-02 10:53:28,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-02 10:53:28,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-02 10:53:28,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-02 10:53:28,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-02 10:53:28,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-02 10:53:28,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-02 10:53:28,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-02 10:53:28,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-02 10:53:28,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-02 10:53:28,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-02 10:53:28,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-02 10:53:28,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-02 10:53:28,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-02 10:53:28,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-02 10:53:28,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-02 10:53:28,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-02 10:53:28,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-02 10:53:28,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-02 10:53:28,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-02 10:53:28,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-02 10:53:28,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-02 10:53:28,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-02 10:53:28,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-02 10:53:28,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-02 10:53:28,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-02 10:53:28,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-10-02 10:53:28,561 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1283906028405308, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-02 10:53:28,561 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912597597861491, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1283906028405308, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-10-02 10:55:28,539 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5318391 different iterations.  Found a solution that moves 1883 regions; Going from a computed imbalance of 0.9912597597861491 to a new imbalance of 4.39501593655919E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6974074074074074, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-02 10:55:28,547 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1047407883:90 , srv1058481465:90 , srv114811075:90 , srv1173861159:90 , srv1323002407:90 , srv1444245009:90 , srv149980097:90 , srv162942239:90 , srv1648233908:90 , srv1722278900:90 , srv1787260939:90 , srv1810107632:90 , srv1821203163:90 , srv18375360:90 , srv193648603:90 , srv1938809060:90 , srv1999078581:90 , srv2136985710:90 , srv264842522:90 , srv272522050:90 , srv290701363:90 , srv349754988:90 , srv496090462:90 , srv787011650:90 , srv799930009:90 , srv825455690:90 , srv862879413:90 , srv866933466:90 , srv876842906:90 , srv993270960:90 }
2023-10-02 10:55:28,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-02 10:55:28,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv825455690=25, srv1047407883=0, srv18375360=13, srv193648603=14, srv862879413=26, srv2136985710=17, srv162942239=7, srv272522050=19, srv1173861159=3, srv1810107632=11, srv149980097=6, srv1444245009=5, srv1999078581=16, srv799930009=24, srv876842906=28, srv993270960=29, srv1722278900=9, srv290701363=20, srv1323002407=4, srv866933466=27, srv1787260939=10, srv1821203163=12, srv1058481465=1, srv496090462=22, srv1938809060=15, srv264842522=18, srv349754988=21, srv1648233908=8, srv114811075=2, srv787011650=23} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-02 10:55:28,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-02 10:55:28,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-02 10:55:28,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-02 10:55:28,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-02 10:55:28,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-02 10:55:28,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-02 10:55:28,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-02 10:55:28,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-02 10:55:28,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-02 10:55:28,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-02 10:55:28,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-02 10:55:28,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-02 10:55:28,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-02 10:55:28,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-02 10:55:28,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-02 10:55:28,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-02 10:55:28,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-02 10:55:28,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-02 10:55:28,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-02 10:55:28,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-02 10:55:28,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-02 10:55:28,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-02 10:55:28,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-02 10:55:28,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-02 10:55:28,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-02 10:55:28,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-02 10:55:28,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-02 10:55:28,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-02 10:55:28,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-02 10:55:28,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-02 10:55:28,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-10-02 10:55:28,568 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-02 10:55:28,568 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1047407883:90 , srv1058481465:90 , srv114811075:90 , srv1173861159:90 , srv1323002407:90 , srv1444245009:90 , srv149980097:90 , srv162942239:90 , srv1648233908:90 , srv1722278900:90 , srv1787260939:90 , srv1810107632:90 , srv1821203163:90 , srv18375360:90 , srv193648603:90 , srv1938809060:90 , srv1999078581:90 , srv2136985710:90 , srv264842522:90 , srv272522050:90 , srv290701363:90 , srv349754988:90 , srv496090462:90 , srv787011650:90 , srv799930009:90 , srv825455690:90 , srv862879413:90 , srv866933466:90 , srv876842906:90 , srv993270960:90 }
2023-10-02 10:55:28,580 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 265), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=248 (was 361), ProcessCount=167 (was 169), AvailableMemoryMB=1439 (was 2684)