2024-02-18 22:53:17,569 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2024-02-18 22:53:17,904 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2024-02-18 22:53:18,024 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2024-02-18 22:53:18,084 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-02-18 22:53:18,091 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-02-18 22:53:18,104 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=262, ProcessCount=167, AvailableMemoryMB=11728
2024-02-18 22:53:18,106 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-02-18 22:53:18,107 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-02-18 22:53:18,250 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1044776793:84 , srv1056433821:84 , srv1072690409:84 , srv1075120760:84 , srv1088468678:84 , srv1097587979:84 , srv1136041010:84 , srv1153167025:84 , srv1160592251:84 , srv1180081751:84 , srv1239532048:84 , srv1254306852:84 , srv1271410710:84 , srv1275569001:84 , srv1279426311:84 , srv128829674:84 , srv1289583756:84 , srv1300499171:84 , srv1318677571:84 , srv1328122584:84 , srv1379841541:84 , srv1390718067:84 , srv1396366671:84 , srv139896317:84 , srv1399582799:84 , srv1414750845:84 , srv1429058411:84 , srv1484422442:84 , srv1488693687:84 , srv1492590538:84 , srv1507376616:84 , srv1513829414:84 , srv1531555500:84 , srv1545447294:84 , srv1547911822:84 , srv1550819878:84 , srv1570947259:84 , srv1589274328:84 , srv1610019048:84 , srv1650946219:84 , srv1677064192:84 , srv1702408974:84 , srv1703936874:84 , srv1747558042:84 , srv1755098785:84 , srv1814783289:84 , srv1821611008:84 , srv1838675863:84 , srv1869031076:84 , srv1879712051:84 , srv1940188650:84 , srv1949029590:84 , srv2019635779:84 , srv205096699:84 , srv2072124548:84 , srv2074642484:84 , srv2076594914:84 , srv2117691986:84 , srv2118699264:84 , srv2132379956:84 , srv2138194177:84 , srv233839881:84 , srv277923439:84 , srv292634073:84 , srv293678257:84 , srv323849191:84 , srv324608597:84 , srv327359924:84 , srv330307171:84 , srv363792045:84 , srv375732628:84 , srv405392249:84 , srv447923462:84 , srv490415257:84 , srv494704674:84 , srv50446618:84 , srv507429499:84 , srv510866128:84 , srv525913674:84 , srv546810539:84 , srv580539013:84 , srv593058757:84 , srv597931318:84 , srv627913892:84 , srv63112688:84 , srv64904477:84 , srv650223541:84 , srv664460157:84 , srv700425364:84 , srv718029413:84 , srv727683315:84 , srv751585941:84 , srv754704863:84 , srv763832632:84 , srv798884546:84 , srv822993754:84 , srv823671357:84 , srv842285066:84 , srv989548948:84 , srv791232980:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2024-02-18 22:53:18,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-18 22:53:18,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1838675863=47, srv405392249=71, srv1814783289=45, srv2076594914=56, srv375732628=70, srv292634073=63, srv1507376616=30, srv727683315=90, srv1300499171=17, srv1097587979=5, srv2019635779=52, srv330307171=68, srv1949029590=51, srv1677064192=40, srv2072124548=54, srv205096699=53, srv1136041010=6, srv507429499=76, srv1289583756=16, srv754704863=92, srv1702408974=41, srv293678257=64, srv763832632=93, srv1703936874=42, srv1153167025=7, srv233839881=61, srv1879712051=49, srv2117691986=57, srv323849191=65, srv1610019048=38, srv1755098785=44, srv700425364=88, srv1239532048=10, srv1869031076=48, srv580539013=80, srv447923462=72, srv1379841541=20, srv1545447294=33, srv1488693687=28, srv64904477=85, srv822993754=96, srv989548948=99, srv1275569001=13, srv2132379956=59, srv1318677571=18, srv1747558042=43, srv1429058411=26, srv1547911822=34, srv751585941=91, srv1088468678=4, srv1531555500=32, srv2138194177=60, srv1254306852=11, srv593058757=81, srv1513829414=31, srv1056433821=1, srv1044776793=0, srv1180081751=9, srv1075120760=3, srv546810539=79, srv627913892=83, srv63112688=84, srv2118699264=58, srv1821611008=46, srv1492590538=29, srv139896317=23, srv363792045=69, srv1570947259=36, srv510866128=77, srv842285066=98, srv798884546=95, srv1550819878=35, srv1414750845=25, srv823671357=97, srv324608597=66, srv1072690409=2, srv664460157=87, srv2074642484=55, srv1390718067=21, srv277923439=62, srv490415257=73, srv128829674=15, srv50446618=75, srv1271410710=12, srv494704674=74, srv1650946219=39, srv1399582799=24, srv1279426311=14, srv1328122584=19, srv525913674=78, srv1484422442=27, srv791232980=94, srv718029413=89, srv1396366671=22, srv1160592251=8, srv597931318=82, srv1589274328=37, srv1940188650=50, srv327359924=67, srv650223541=86} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-18 22:53:18,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-18 22:53:18,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-18 22:53:18,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-18 22:53:18,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-18 22:53:18,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-18 22:53:18,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-18 22:53:18,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-18 22:53:18,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-18 22:53:18,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-18 22:53:18,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-18 22:53:18,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-18 22:53:18,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-18 22:53:18,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-18 22:53:18,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-18 22:53:18,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-18 22:53:18,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-18 22:53:18,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-18 22:53:18,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-18 22:53:18,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-18 22:53:18,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-18 22:53:18,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-18 22:53:18,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-18 22:53:18,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-18 22:53:18,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-18 22:53:18,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-18 22:53:18,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-18 22:53:18,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-18 22:53:18,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-18 22:53:18,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-18 22:53:18,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-18 22:53:18,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-02-18 22:53:18,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-02-18 22:53:18,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-02-18 22:53:18,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-02-18 22:53:18,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-02-18 22:53:18,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-02-18 22:53:18,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-02-18 22:53:18,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-02-18 22:53:18,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-02-18 22:53:18,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-02-18 22:53:18,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-02-18 22:53:18,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-02-18 22:53:18,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-02-18 22:53:18,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-02-18 22:53:18,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-02-18 22:53:18,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-02-18 22:53:18,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-02-18 22:53:18,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-02-18 22:53:18,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-02-18 22:53:18,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-02-18 22:53:18,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-02-18 22:53:18,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-02-18 22:53:18,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-02-18 22:53:18,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-02-18 22:53:18,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-02-18 22:53:18,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-02-18 22:53:18,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-02-18 22:53:18,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-02-18 22:53:18,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-02-18 22:53:18,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-02-18 22:53:18,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-02-18 22:53:18,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-02-18 22:53:18,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-02-18 22:53:18,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-02-18 22:53:18,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-02-18 22:53:18,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-02-18 22:53:18,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-02-18 22:53:18,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-02-18 22:53:18,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-02-18 22:53:18,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-02-18 22:53:18,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-02-18 22:53:18,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-02-18 22:53:18,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-02-18 22:53:18,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-02-18 22:53:18,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-02-18 22:53:18,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-02-18 22:53:18,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-02-18 22:53:18,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-02-18 22:53:18,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-02-18 22:53:18,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-02-18 22:53:18,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-02-18 22:53:18,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-02-18 22:53:18,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-02-18 22:53:18,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-02-18 22:53:18,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-02-18 22:53:18,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-02-18 22:53:18,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-02-18 22:53:18,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-02-18 22:53:18,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-02-18 22:53:18,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-02-18 22:53:18,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-02-18 22:53:18,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-02-18 22:53:18,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-02-18 22:53:18,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-02-18 22:53:18,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-02-18 22:53:18,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-02-18 22:53:18,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-02-18 22:53:18,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-02-18 22:53:18,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-02-18 22:53:18,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-02-18 22:53:18,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-02-18 22:53:18,639 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-18 22:53:18,639 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-02-18 22:53:18,640 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-02-18 22:53:19,123 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 727 ms to try 5000 different iterations.  Found a solution that moves 4695 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17607535415250208. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0392748206247225, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05985016832649107, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5216666666666666, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0392748206247225, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17141666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23616666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-18 22:53:19,141 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1044776793:81 , srv327359924:81 , srv2019635779:82 , srv2118699264:82 , srv324608597:82 , srv1097587979:83 , srv1271410710:83 , srv1399582799:83 , srv1550819878:83 , srv1814783289:83 , srv580539013:83 , srv664460157:83 , srv763832632:83 , srv1088468678:84 , srv1136041010:84 , srv1390718067:84 , srv139896317:84 , srv2117691986:84 , srv293678257:84 , srv546810539:84 , srv700425364:84 , srv1153167025:85 , srv1275569001:85 , srv1318677571:85 , srv1492590538:85 , srv1513829414:85 , srv1610019048:85 , srv205096699:85 , srv2074642484:85 , srv323849191:85 , srv363792045:85 , srv375732628:85 , srv50446618:85 , srv593058757:85 , srv650223541:85 , srv989548948:85 , srv1254306852:86 , srv1379841541:86 , srv1414750845:86 , srv1429058411:86 , srv1531555500:86 , srv1650946219:86 , srv1702408974:86 , srv1703936874:86 , srv1755098785:86 , srv1940188650:86 , srv2138194177:86 , srv233839881:86 , srv292634073:86 , srv507429499:86 , srv64904477:86 , srv754704863:86 , srv823671357:86 , srv842285066:86 , srv1056433821:87 , srv1072690409:87 , srv1279426311:87 , srv128829674:87 , srv1570947259:87 , srv1949029590:87 , srv2072124548:87 , srv2076594914:87 , srv2132379956:87 , srv510866128:87 , srv627913892:87 , srv751585941:87 , srv1180081751:88 , srv1300499171:88 , srv1328122584:88 , srv1396366671:88 , srv1507376616:88 , srv1589274328:88 , srv1821611008:88 , srv1838675863:88 , srv1879712051:88 , srv525913674:88 , srv597931318:88 , srv727683315:88 , srv822993754:88 , srv1160592251:89 , srv1488693687:89 , srv1545447294:89 , srv277923439:89 , srv405392249:89 , srv718029413:89 , srv798884546:89 , srv1075120760:90 , srv1289583756:90 , srv1547911822:90 , srv1677064192:90 , srv490415257:90 , srv63112688:90 , srv1747558042:91 , srv1869031076:91 , srv494704674:91 , srv330307171:92 , srv447923462:92 , srv1239532048:93 , srv1484422442:93 , srv791232980:439 }
2024-02-18 22:53:19,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-18 22:53:19,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1838675863=47, srv405392249=71, srv1814783289=45, srv2076594914=56, srv375732628=70, srv292634073=63, srv1507376616=30, srv727683315=90, srv1300499171=17, srv1097587979=5, srv2019635779=52, srv330307171=68, srv1949029590=51, srv1677064192=40, srv2072124548=54, srv205096699=53, srv1136041010=6, srv507429499=76, srv1289583756=16, srv754704863=92, srv1702408974=41, srv293678257=64, srv763832632=93, srv1703936874=42, srv1153167025=7, srv233839881=61, srv1879712051=49, srv2117691986=57, srv323849191=65, srv1610019048=38, srv1755098785=44, srv700425364=88, srv1239532048=10, srv1869031076=48, srv580539013=80, srv447923462=72, srv1379841541=20, srv1545447294=33, srv1488693687=28, srv64904477=85, srv822993754=96, srv989548948=99, srv1275569001=13, srv2132379956=59, srv1318677571=18, srv1747558042=43, srv1429058411=26, srv1547911822=34, srv751585941=91, srv1088468678=4, srv1531555500=32, srv2138194177=60, srv1254306852=11, srv593058757=81, srv1513829414=31, srv1056433821=1, srv1044776793=0, srv1180081751=9, srv1075120760=3, srv546810539=79, srv627913892=83, srv63112688=84, srv2118699264=58, srv1821611008=46, srv1492590538=29, srv139896317=23, srv363792045=69, srv1570947259=36, srv510866128=77, srv842285066=98, srv798884546=95, srv1550819878=35, srv1414750845=25, srv823671357=97, srv324608597=66, srv1072690409=2, srv664460157=87, srv2074642484=55, srv1390718067=21, srv277923439=62, srv490415257=73, srv128829674=15, srv50446618=75, srv1271410710=12, srv494704674=74, srv1650946219=39, srv1399582799=24, srv1279426311=14, srv1328122584=19, srv525913674=78, srv1484422442=27, srv791232980=94, srv718029413=89, srv1396366671=22, srv1160592251=8, srv597931318=82, srv1589274328=37, srv1940188650=50, srv327359924=67, srv650223541=86} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-18 22:53:19,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-18 22:53:19,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-18 22:53:19,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-18 22:53:19,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-18 22:53:19,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-18 22:53:19,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-18 22:53:19,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-18 22:53:19,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-18 22:53:19,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-18 22:53:19,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-18 22:53:19,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-18 22:53:19,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-18 22:53:19,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-18 22:53:19,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-18 22:53:19,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-18 22:53:19,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-18 22:53:19,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-18 22:53:19,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-18 22:53:19,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-18 22:53:19,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-18 22:53:19,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-18 22:53:19,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-18 22:53:19,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-18 22:53:19,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-18 22:53:19,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-18 22:53:19,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-18 22:53:19,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-18 22:53:19,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-18 22:53:19,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-18 22:53:19,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-18 22:53:19,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-02-18 22:53:19,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-02-18 22:53:19,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-02-18 22:53:19,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-02-18 22:53:19,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-02-18 22:53:19,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-02-18 22:53:19,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-02-18 22:53:19,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-02-18 22:53:19,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-02-18 22:53:19,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-02-18 22:53:19,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-02-18 22:53:19,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-02-18 22:53:19,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-02-18 22:53:19,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-02-18 22:53:19,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-02-18 22:53:19,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-02-18 22:53:19,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-02-18 22:53:19,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-02-18 22:53:19,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-02-18 22:53:19,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-02-18 22:53:19,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-02-18 22:53:19,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-02-18 22:53:19,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-02-18 22:53:19,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-02-18 22:53:19,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-02-18 22:53:19,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-02-18 22:53:19,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-02-18 22:53:19,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-02-18 22:53:19,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-02-18 22:53:19,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-02-18 22:53:19,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-02-18 22:53:19,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-02-18 22:53:19,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-02-18 22:53:19,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-02-18 22:53:19,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-02-18 22:53:19,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-02-18 22:53:19,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-02-18 22:53:19,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-02-18 22:53:19,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-02-18 22:53:19,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-02-18 22:53:19,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-02-18 22:53:19,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-02-18 22:53:19,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-02-18 22:53:19,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-02-18 22:53:19,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-02-18 22:53:19,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-02-18 22:53:19,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-02-18 22:53:19,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-02-18 22:53:19,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-02-18 22:53:19,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-02-18 22:53:19,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-02-18 22:53:19,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-02-18 22:53:19,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-02-18 22:53:19,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-02-18 22:53:19,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-02-18 22:53:19,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-02-18 22:53:19,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-02-18 22:53:19,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-02-18 22:53:19,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-02-18 22:53:19,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-02-18 22:53:19,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-02-18 22:53:19,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-02-18 22:53:19,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-02-18 22:53:19,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-02-18 22:53:19,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-02-18 22:53:19,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-02-18 22:53:19,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-02-18 22:53:19,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-02-18 22:53:19,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-02-18 22:53:19,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-02-18 22:53:19,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-02-18 22:53:19,341 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0392748206247225, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05985016832649107, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0392748206247225, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17141666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23616666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-18 22:53:19,341 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-02-18 22:53:19,341 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17604247905984866, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0392748206247225, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05985016832649107, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0392748206247225, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17141666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23616666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-02-18 22:53:19,624 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 406 ms to try 5000 different iterations.  Found a solution that moves 2684 regions; Going from a computed imbalance of 0.17604247905984866 to a new imbalance of 0.015545310703187749. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021829298410871147); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03758716021189434, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2982222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021829298410871147); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0125); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04441666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-18 22:53:19,634 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1484422442:78 , srv330307171:79 , srv1239532048:80 , srv447923462:80 , srv1869031076:81 , srv525913674:81 , srv63112688:81 , srv1075120760:82 , srv1488693687:82 , srv1545447294:82 , srv1547911822:82 , srv1747558042:82 , srv1821611008:82 , srv277923439:82 , srv490415257:82 , srv718029413:82 , srv798884546:82 , srv1396366671:83 , srv1507376616:83 , srv1589274328:83 , srv2076594914:83 , srv494704674:83 , srv727683315:83 , srv1056433821:84 , srv128829674:84 , srv1289583756:84 , srv1328122584:84 , srv1677064192:84 , srv1703936874:84 , srv1838675863:84 , srv1879712051:84 , srv2138194177:84 , srv405392249:84 , srv751585941:84 , srv842285066:84 , srv1072690409:85 , srv1180081751:85 , srv1300499171:85 , srv1429058411:85 , srv1531555500:85 , srv1610019048:85 , srv1940188650:85 , srv1949029590:85 , srv597931318:85 , srv627913892:85 , srv1088468678:86 , srv1136041010:86 , srv1160592251:86 , srv1254306852:86 , srv1318677571:86 , srv1379841541:86 , srv1390718067:86 , srv1492590538:86 , srv1513829414:86 , srv1570947259:86 , srv2072124548:86 , srv2074642484:86 , srv2132379956:86 , srv293678257:86 , srv375732628:86 , srv507429499:86 , srv754704863:86 , srv823671357:86 , srv1097587979:87 , srv1153167025:87 , srv1275569001:87 , srv1414750845:87 , srv2117691986:87 , srv233839881:87 , srv323849191:87 , srv363792045:87 , srv510866128:87 , srv64904477:87 , srv650223541:87 , srv822993754:87 , srv989548948:87 , srv1279426311:88 , srv1650946219:88 , srv1755098785:88 , srv1814783289:88 , srv205096699:88 , srv292634073:88 , srv324608597:88 , srv50446618:88 , srv580539013:88 , srv700425364:88 , srv139896317:89 , srv1702408974:89 , srv546810539:89 , srv593058757:89 , srv763832632:89 , srv1271410710:90 , srv2019635779:90 , srv664460157:90 , srv1399582799:91 , srv2118699264:91 , srv1550819878:92 , srv1044776793:93 , srv327359924:94 , srv791232980:529 }
2024-02-18 22:53:19,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-18 22:53:19,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1838675863=47, srv405392249=71, srv1814783289=45, srv2076594914=56, srv375732628=70, srv292634073=63, srv1507376616=30, srv727683315=90, srv1300499171=17, srv1097587979=5, srv2019635779=52, srv330307171=68, srv1949029590=51, srv1677064192=40, srv2072124548=54, srv205096699=53, srv1136041010=6, srv507429499=76, srv1289583756=16, srv754704863=92, srv1702408974=41, srv293678257=64, srv763832632=93, srv1703936874=42, srv1153167025=7, srv233839881=61, srv1879712051=49, srv2117691986=57, srv323849191=65, srv1610019048=38, srv1755098785=44, srv700425364=88, srv1239532048=10, srv1869031076=48, srv580539013=80, srv447923462=72, srv1379841541=20, srv1545447294=33, srv1488693687=28, srv64904477=85, srv822993754=96, srv989548948=99, srv1275569001=13, srv2132379956=59, srv1318677571=18, srv1747558042=43, srv1429058411=26, srv1547911822=34, srv751585941=91, srv1088468678=4, srv1531555500=32, srv2138194177=60, srv1254306852=11, srv593058757=81, srv1513829414=31, srv1056433821=1, srv1044776793=0, srv1180081751=9, srv1075120760=3, srv546810539=79, srv627913892=83, srv63112688=84, srv2118699264=58, srv1821611008=46, srv1492590538=29, srv139896317=23, srv363792045=69, srv1570947259=36, srv510866128=77, srv842285066=98, srv798884546=95, srv1550819878=35, srv1414750845=25, srv823671357=97, srv324608597=66, srv1072690409=2, srv664460157=87, srv2074642484=55, srv1390718067=21, srv277923439=62, srv490415257=73, srv128829674=15, srv50446618=75, srv1271410710=12, srv494704674=74, srv1650946219=39, srv1399582799=24, srv1279426311=14, srv1328122584=19, srv525913674=78, srv1484422442=27, srv791232980=94, srv718029413=89, srv1396366671=22, srv1160592251=8, srv597931318=82, srv1589274328=37, srv1940188650=50, srv327359924=67, srv650223541=86} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-18 22:53:19,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-18 22:53:19,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-18 22:53:19,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-18 22:53:19,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-18 22:53:19,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-18 22:53:19,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-18 22:53:19,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-18 22:53:19,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-18 22:53:19,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-18 22:53:19,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-18 22:53:19,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-18 22:53:19,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-18 22:53:19,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-18 22:53:19,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-18 22:53:19,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-18 22:53:19,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-18 22:53:19,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-18 22:53:19,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-18 22:53:19,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-18 22:53:19,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-18 22:53:19,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-18 22:53:19,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-18 22:53:19,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-18 22:53:19,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-18 22:53:19,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-18 22:53:19,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-18 22:53:19,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-18 22:53:19,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-18 22:53:19,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-18 22:53:19,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-18 22:53:19,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-02-18 22:53:19,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-02-18 22:53:19,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-02-18 22:53:19,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-02-18 22:53:19,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-02-18 22:53:19,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-02-18 22:53:19,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-02-18 22:53:19,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-02-18 22:53:19,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-02-18 22:53:19,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-02-18 22:53:19,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-02-18 22:53:19,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-02-18 22:53:19,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-02-18 22:53:19,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-02-18 22:53:19,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-02-18 22:53:19,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-02-18 22:53:19,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-02-18 22:53:19,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-02-18 22:53:19,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-02-18 22:53:19,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-02-18 22:53:19,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-02-18 22:53:19,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-02-18 22:53:19,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-02-18 22:53:19,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-02-18 22:53:19,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-02-18 22:53:19,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-02-18 22:53:19,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-02-18 22:53:19,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-02-18 22:53:19,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-02-18 22:53:19,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-02-18 22:53:19,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-02-18 22:53:19,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-02-18 22:53:19,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-02-18 22:53:19,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-02-18 22:53:19,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-02-18 22:53:19,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-02-18 22:53:19,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-02-18 22:53:19,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-02-18 22:53:19,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-02-18 22:53:19,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-02-18 22:53:19,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-02-18 22:53:19,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-02-18 22:53:19,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-02-18 22:53:19,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-02-18 22:53:19,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-02-18 22:53:19,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-02-18 22:53:19,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-02-18 22:53:19,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-02-18 22:53:19,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-02-18 22:53:19,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-02-18 22:53:19,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-02-18 22:53:19,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-02-18 22:53:19,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-02-18 22:53:19,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-02-18 22:53:19,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-02-18 22:53:19,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-02-18 22:53:19,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-02-18 22:53:19,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-02-18 22:53:19,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-02-18 22:53:19,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-02-18 22:53:19,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-02-18 22:53:19,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-02-18 22:53:19,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-02-18 22:53:19,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-02-18 22:53:19,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-02-18 22:53:19,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-02-18 22:53:19,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-02-18 22:53:19,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-02-18 22:53:19,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-02-18 22:53:19,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-02-18 22:53:19,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-02-18 22:53:19,837 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021829298410871147); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03758716021189434, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021829298410871147); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0125); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04441666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-18 22:53:19,838 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-02-18 22:53:19,838 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.015526516933500455, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021829298410871147); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03758716021189434, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021829298410871147); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0125); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04441666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-02-18 22:53:20,134 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 432 ms to try 5000 different iterations.  Found a solution that moves 973 regions; Going from a computed imbalance of 0.015526516933500455 to a new imbalance of 0.0010155229912559025. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005781057516857846); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00956987416753698); MoveCostFunction : (multiplier=7.0, imbalance=0.10811111111111112, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005781057516857846); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.0E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005416666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-18 22:53:20,136 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1160592251:81 , srv1279426311:82 , srv822993754:82 , srv1044776793:83 , srv1399582799:83 , srv1550819878:83 , srv1677064192:83 , srv1702408974:83 , srv1755098785:83 , srv327359924:83 , srv593058757:83 , srv1271410710:84 , srv1275569001:84 , srv1289583756:84 , srv1570947259:84 , srv1650946219:84 , srv1869031076:84 , srv2072124548:84 , srv2118699264:84 , srv292634073:84 , srv405392249:84 , srv494704674:84 , srv50446618:84 , srv510866128:84 , srv597931318:84 , srv627913892:84 , srv1072690409:85 , srv1153167025:85 , srv1180081751:85 , srv1239532048:85 , srv1300499171:85 , srv1328122584:85 , srv1379841541:85 , srv139896317:85 , srv1414750845:85 , srv1488693687:85 , srv1747558042:85 , srv1879712051:85 , srv1949029590:85 , srv2019635779:85 , srv205096699:85 , srv2132379956:85 , srv233839881:85 , srv546810539:85 , srv64904477:85 , srv650223541:85 , srv664460157:85 , srv700425364:85 , srv763832632:85 , srv989548948:85 , srv1254306852:86 , srv128829674:86 , srv1396366671:86 , srv1429058411:86 , srv1513829414:86 , srv1545447294:86 , srv1547911822:86 , srv1703936874:86 , srv1838675863:86 , srv1940188650:86 , srv2074642484:86 , srv2076594914:86 , srv277923439:86 , srv323849191:86 , srv363792045:86 , srv375732628:86 , srv447923462:86 , srv507429499:86 , srv580539013:86 , srv727683315:86 , srv754704863:86 , srv823671357:86 , srv1056433821:87 , srv1088468678:87 , srv1097587979:87 , srv1136041010:87 , srv1318677571:87 , srv1484422442:87 , srv1492590538:87 , srv1507376616:87 , srv1531555500:87 , srv1589274328:87 , srv1610019048:87 , srv1814783289:87 , srv2117691986:87 , srv293678257:87 , srv324608597:87 , srv330307171:87 , srv490415257:87 , srv63112688:87 , srv718029413:87 , srv751585941:87 , srv798884546:87 , srv1075120760:88 , srv1821611008:88 , srv2138194177:88 , srv842285066:88 , srv525913674:89 , srv1390718067:90 , srv791232980:541 }
2024-02-18 22:53:20,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-18 22:53:20,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1838675863=47, srv405392249=71, srv1814783289=45, srv2076594914=56, srv375732628=70, srv292634073=63, srv1507376616=30, srv727683315=90, srv1300499171=17, srv1097587979=5, srv2019635779=52, srv330307171=68, srv1949029590=51, srv1677064192=40, srv2072124548=54, srv205096699=53, srv1136041010=6, srv507429499=76, srv1289583756=16, srv754704863=92, srv1702408974=41, srv293678257=64, srv763832632=93, srv1703936874=42, srv1153167025=7, srv233839881=61, srv1879712051=49, srv2117691986=57, srv323849191=65, srv1610019048=38, srv1755098785=44, srv700425364=88, srv1239532048=10, srv1869031076=48, srv580539013=80, srv447923462=72, srv1379841541=20, srv1545447294=33, srv1488693687=28, srv64904477=85, srv822993754=96, srv989548948=99, srv1275569001=13, srv2132379956=59, srv1318677571=18, srv1747558042=43, srv1429058411=26, srv1547911822=34, srv751585941=91, srv1088468678=4, srv1531555500=32, srv2138194177=60, srv1254306852=11, srv593058757=81, srv1513829414=31, srv1056433821=1, srv1044776793=0, srv1180081751=9, srv1075120760=3, srv546810539=79, srv627913892=83, srv63112688=84, srv2118699264=58, srv1821611008=46, srv1492590538=29, srv139896317=23, srv363792045=69, srv1570947259=36, srv510866128=77, srv842285066=98, srv798884546=95, srv1550819878=35, srv1414750845=25, srv823671357=97, srv324608597=66, srv1072690409=2, srv664460157=87, srv2074642484=55, srv1390718067=21, srv277923439=62, srv490415257=73, srv128829674=15, srv50446618=75, srv1271410710=12, srv494704674=74, srv1650946219=39, srv1399582799=24, srv1279426311=14, srv1328122584=19, srv525913674=78, srv1484422442=27, srv791232980=94, srv718029413=89, srv1396366671=22, srv1160592251=8, srv597931318=82, srv1589274328=37, srv1940188650=50, srv327359924=67, srv650223541=86} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-18 22:53:20,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-18 22:53:20,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-18 22:53:20,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-18 22:53:20,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-18 22:53:20,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-18 22:53:20,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-18 22:53:20,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-18 22:53:20,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-18 22:53:20,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-18 22:53:20,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-18 22:53:20,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-18 22:53:20,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-18 22:53:20,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-18 22:53:20,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-18 22:53:20,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-18 22:53:20,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-18 22:53:20,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-18 22:53:20,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-18 22:53:20,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-18 22:53:20,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-18 22:53:20,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-18 22:53:20,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-18 22:53:20,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-18 22:53:20,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-18 22:53:20,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-18 22:53:20,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-18 22:53:20,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-18 22:53:20,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-18 22:53:20,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-18 22:53:20,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-18 22:53:20,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-02-18 22:53:20,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-02-18 22:53:20,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-02-18 22:53:20,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-02-18 22:53:20,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-02-18 22:53:20,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-02-18 22:53:20,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-02-18 22:53:20,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-02-18 22:53:20,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-02-18 22:53:20,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-02-18 22:53:20,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-02-18 22:53:20,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-02-18 22:53:20,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-02-18 22:53:20,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-02-18 22:53:20,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-02-18 22:53:20,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-02-18 22:53:20,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-02-18 22:53:20,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-02-18 22:53:20,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-02-18 22:53:20,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-02-18 22:53:20,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-02-18 22:53:20,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-02-18 22:53:20,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-02-18 22:53:20,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-02-18 22:53:20,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-02-18 22:53:20,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-02-18 22:53:20,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-02-18 22:53:20,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-02-18 22:53:20,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-02-18 22:53:20,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-02-18 22:53:20,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-02-18 22:53:20,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-02-18 22:53:20,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-02-18 22:53:20,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-02-18 22:53:20,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-02-18 22:53:20,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-02-18 22:53:20,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-02-18 22:53:20,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-02-18 22:53:20,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-02-18 22:53:20,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-02-18 22:53:20,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-02-18 22:53:20,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-02-18 22:53:20,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-02-18 22:53:20,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-02-18 22:53:20,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-02-18 22:53:20,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-02-18 22:53:20,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-02-18 22:53:20,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-02-18 22:53:20,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-02-18 22:53:20,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-02-18 22:53:20,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-02-18 22:53:20,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-02-18 22:53:20,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-02-18 22:53:20,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-02-18 22:53:20,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-02-18 22:53:20,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-02-18 22:53:20,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-02-18 22:53:20,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-02-18 22:53:20,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-02-18 22:53:20,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-02-18 22:53:20,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-02-18 22:53:20,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-02-18 22:53:20,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-02-18 22:53:20,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-02-18 22:53:20,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-02-18 22:53:20,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-02-18 22:53:20,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-02-18 22:53:20,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-02-18 22:53:20,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-02-18 22:53:20,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-02-18 22:53:20,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-02-18 22:53:20,309 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005781057516857846); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00956987416753698); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005781057516857846); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.0E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005416666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-18 22:53:20,310 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-02-18 22:53:20,310 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.0010087098996367754, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005781057516857846); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00956987416753698); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005781057516857846); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.0E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005416666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-02-18 22:53:20,687 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 499 ms to try 5000 different iterations.  Found a solution that moves 267 regions; Going from a computed imbalance of 0.0010087098996367754 to a new imbalance of 5.9854048736536006E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0023210354127426377); MoveCostFunction : (multiplier=7.0, imbalance=0.029666666666666668, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=5.0E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-18 22:53:20,688 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1075120760:83 , srv1390718067:83 , srv1507376616:83 , srv233839881:83 , srv330307171:83 , srv490415257:83 , srv525913674:83 , srv842285066:83 , srv1056433821:84 , srv1239532048:84 , srv1254306852:84 , srv1279426311:84 , srv1289583756:84 , srv1300499171:84 , srv1318677571:84 , srv1414750845:84 , srv1484422442:84 , srv1531555500:84 , srv1547911822:84 , srv1550819878:84 , srv1589274328:84 , srv1650946219:84 , srv1747558042:84 , srv1814783289:84 , srv1821611008:84 , srv1838675863:84 , srv1940188650:84 , srv205096699:84 , srv2072124548:84 , srv2117691986:84 , srv2132379956:84 , srv2138194177:84 , srv277923439:84 , srv292634073:84 , srv323849191:84 , srv327359924:84 , srv363792045:84 , srv494704674:84 , srv510866128:84 , srv546810539:84 , srv597931318:84 , srv63112688:84 , srv64904477:84 , srv718029413:84 , srv727683315:84 , srv751585941:84 , srv754704863:84 , srv798884546:84 , srv823671357:84 , srv1044776793:85 , srv1072690409:85 , srv1088468678:85 , srv1097587979:85 , srv1136041010:85 , srv1153167025:85 , srv1180081751:85 , srv1271410710:85 , srv128829674:85 , srv1328122584:85 , srv1379841541:85 , srv1396366671:85 , srv139896317:85 , srv1399582799:85 , srv1429058411:85 , srv1492590538:85 , srv1513829414:85 , srv1570947259:85 , srv1610019048:85 , srv1677064192:85 , srv1702408974:85 , srv1755098785:85 , srv1879712051:85 , srv1949029590:85 , srv2019635779:85 , srv2074642484:85 , srv2118699264:85 , srv293678257:85 , srv324608597:85 , srv375732628:85 , srv405392249:85 , srv447923462:85 , srv50446618:85 , srv507429499:85 , srv580539013:85 , srv593058757:85 , srv650223541:85 , srv664460157:85 , srv700425364:85 , srv763832632:85 , srv822993754:85 , srv989548948:85 , srv1275569001:86 , srv1488693687:86 , srv1545447294:86 , srv1703936874:86 , srv1869031076:86 , srv2076594914:86 , srv627913892:86 , srv1160592251:87 , srv791232980:633 }
2024-02-18 22:53:20,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-18 22:53:20,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1838675863=47, srv405392249=71, srv1814783289=45, srv2076594914=56, srv375732628=70, srv292634073=63, srv1507376616=30, srv727683315=90, srv1300499171=17, srv1097587979=5, srv2019635779=52, srv330307171=68, srv1949029590=51, srv1677064192=40, srv2072124548=54, srv205096699=53, srv1136041010=6, srv507429499=76, srv1289583756=16, srv754704863=92, srv1702408974=41, srv293678257=64, srv763832632=93, srv1703936874=42, srv1153167025=7, srv233839881=61, srv1879712051=49, srv2117691986=57, srv323849191=65, srv1610019048=38, srv1755098785=44, srv700425364=88, srv1239532048=10, srv1869031076=48, srv580539013=80, srv447923462=72, srv1379841541=20, srv1545447294=33, srv1488693687=28, srv64904477=85, srv822993754=96, srv989548948=99, srv1275569001=13, srv2132379956=59, srv1318677571=18, srv1747558042=43, srv1429058411=26, srv1547911822=34, srv751585941=91, srv1088468678=4, srv1531555500=32, srv2138194177=60, srv1254306852=11, srv593058757=81, srv1513829414=31, srv1056433821=1, srv1044776793=0, srv1180081751=9, srv1075120760=3, srv546810539=79, srv627913892=83, srv63112688=84, srv2118699264=58, srv1821611008=46, srv1492590538=29, srv139896317=23, srv363792045=69, srv1570947259=36, srv510866128=77, srv842285066=98, srv798884546=95, srv1550819878=35, srv1414750845=25, srv823671357=97, srv324608597=66, srv1072690409=2, srv664460157=87, srv2074642484=55, srv1390718067=21, srv277923439=62, srv490415257=73, srv128829674=15, srv50446618=75, srv1271410710=12, srv494704674=74, srv1650946219=39, srv1399582799=24, srv1279426311=14, srv1328122584=19, srv525913674=78, srv1484422442=27, srv791232980=94, srv718029413=89, srv1396366671=22, srv1160592251=8, srv597931318=82, srv1589274328=37, srv1940188650=50, srv327359924=67, srv650223541=86} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-18 22:53:20,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-18 22:53:20,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-18 22:53:20,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-18 22:53:20,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-18 22:53:20,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-18 22:53:20,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-18 22:53:20,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-18 22:53:20,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-18 22:53:20,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-18 22:53:20,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-18 22:53:20,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-18 22:53:20,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-18 22:53:20,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-18 22:53:20,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-18 22:53:20,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-18 22:53:20,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-18 22:53:20,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-18 22:53:20,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-18 22:53:20,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-18 22:53:20,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-18 22:53:20,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-18 22:53:20,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-18 22:53:20,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-18 22:53:20,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-18 22:53:20,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-18 22:53:20,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-18 22:53:20,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-18 22:53:20,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-18 22:53:20,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-18 22:53:20,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-18 22:53:20,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-02-18 22:53:20,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-02-18 22:53:20,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-02-18 22:53:20,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-02-18 22:53:20,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-02-18 22:53:20,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-02-18 22:53:20,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-02-18 22:53:20,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-02-18 22:53:20,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-02-18 22:53:20,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-02-18 22:53:20,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-02-18 22:53:20,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-02-18 22:53:20,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-02-18 22:53:20,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-02-18 22:53:20,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-02-18 22:53:20,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-02-18 22:53:20,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-02-18 22:53:20,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-02-18 22:53:20,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-02-18 22:53:20,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-02-18 22:53:20,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-02-18 22:53:20,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-02-18 22:53:20,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-02-18 22:53:20,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-02-18 22:53:20,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-02-18 22:53:20,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-02-18 22:53:20,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-02-18 22:53:20,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-02-18 22:53:20,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-02-18 22:53:20,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-02-18 22:53:20,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-02-18 22:53:20,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-02-18 22:53:20,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-02-18 22:53:20,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-02-18 22:53:20,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-02-18 22:53:20,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-02-18 22:53:20,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-02-18 22:53:20,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-02-18 22:53:20,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-02-18 22:53:20,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-02-18 22:53:20,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-02-18 22:53:20,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-02-18 22:53:20,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-02-18 22:53:20,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-02-18 22:53:20,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-02-18 22:53:20,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-02-18 22:53:20,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-02-18 22:53:20,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-02-18 22:53:20,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-02-18 22:53:20,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-02-18 22:53:20,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-02-18 22:53:20,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-02-18 22:53:20,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-02-18 22:53:20,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-02-18 22:53:20,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-02-18 22:53:20,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-02-18 22:53:20,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-02-18 22:53:20,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-02-18 22:53:20,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-02-18 22:53:20,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-02-18 22:53:20,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-02-18 22:53:20,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-02-18 22:53:20,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-02-18 22:53:20,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-02-18 22:53:20,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-02-18 22:53:20,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-02-18 22:53:20,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-02-18 22:53:20,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-02-18 22:53:20,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-02-18 22:53:20,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-02-18 22:53:20,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-02-18 22:53:20,815 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0023210354127426377); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=5.0E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-18 22:53:20,815 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-02-18 22:53:20,816 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=5.798447477733053E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0023210354127426377); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=5.0E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-02-18 22:53:21,070 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 351 ms to try 5000 different iterations.  Found a solution that moves 44 regions; Going from a computed imbalance of 5.798447477733053E-5 to a new imbalance of 7.997516385388388E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.004888888888888889); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-18 22:53:21,070 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1075120760:83 , srv1160592251:83 , srv1180081751:83 , srv1390718067:83 , srv139896317:83 , srv1492590538:83 , srv1545447294:83 , srv1702408974:83 , srv447923462:83 , srv507429499:83 , srv664460157:83 , srv1044776793:84 , srv1056433821:84 , srv1072690409:84 , srv1088468678:84 , srv1097587979:84 , srv1136041010:84 , srv1153167025:84 , srv1239532048:84 , srv1254306852:84 , srv1271410710:84 , srv1275569001:84 , srv128829674:84 , srv1289583756:84 , srv1300499171:84 , srv1318677571:84 , srv1328122584:84 , srv1379841541:84 , srv1396366671:84 , srv1399582799:84 , srv1414750845:84 , srv1429058411:84 , srv1484422442:84 , srv1488693687:84 , srv1513829414:84 , srv1531555500:84 , srv1547911822:84 , srv1550819878:84 , srv1570947259:84 , srv1589274328:84 , srv1610019048:84 , srv1650946219:84 , srv1677064192:84 , srv1703936874:84 , srv1747558042:84 , srv1755098785:84 , srv1814783289:84 , srv1821611008:84 , srv1838675863:84 , srv1869031076:84 , srv1879712051:84 , srv1949029590:84 , srv2019635779:84 , srv205096699:84 , srv2074642484:84 , srv2076594914:84 , srv2117691986:84 , srv2118699264:84 , srv2132379956:84 , srv2138194177:84 , srv292634073:84 , srv293678257:84 , srv323849191:84 , srv324608597:84 , srv327359924:84 , srv363792045:84 , srv375732628:84 , srv405392249:84 , srv490415257:84 , srv494704674:84 , srv50446618:84 , srv510866128:84 , srv546810539:84 , srv580539013:84 , srv593058757:84 , srv627913892:84 , srv63112688:84 , srv64904477:84 , srv650223541:84 , srv700425364:84 , srv718029413:84 , srv751585941:84 , srv754704863:84 , srv763832632:84 , srv798884546:84 , srv822993754:84 , srv823671357:84 , srv989548948:84 , srv1279426311:85 , srv1507376616:85 , srv1940188650:85 , srv2072124548:85 , srv233839881:85 , srv277923439:85 , srv330307171:85 , srv525913674:85 , srv597931318:85 , srv727683315:85 , srv842285066:85 , srv791232980:684 }
2024-02-18 22:53:21,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-18 22:53:21,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1838675863=47, srv405392249=71, srv1814783289=45, srv2076594914=56, srv375732628=70, srv292634073=63, srv1507376616=30, srv727683315=90, srv1300499171=17, srv1097587979=5, srv2019635779=52, srv330307171=68, srv1949029590=51, srv1677064192=40, srv2072124548=54, srv205096699=53, srv1136041010=6, srv507429499=76, srv1289583756=16, srv754704863=92, srv1702408974=41, srv293678257=64, srv763832632=93, srv1703936874=42, srv1153167025=7, srv233839881=61, srv1879712051=49, srv2117691986=57, srv323849191=65, srv1610019048=38, srv1755098785=44, srv700425364=88, srv1239532048=10, srv1869031076=48, srv580539013=80, srv447923462=72, srv1379841541=20, srv1545447294=33, srv1488693687=28, srv64904477=85, srv822993754=96, srv989548948=99, srv1275569001=13, srv2132379956=59, srv1318677571=18, srv1747558042=43, srv1429058411=26, srv1547911822=34, srv751585941=91, srv1088468678=4, srv1531555500=32, srv2138194177=60, srv1254306852=11, srv593058757=81, srv1513829414=31, srv1056433821=1, srv1044776793=0, srv1180081751=9, srv1075120760=3, srv546810539=79, srv627913892=83, srv63112688=84, srv2118699264=58, srv1821611008=46, srv1492590538=29, srv139896317=23, srv363792045=69, srv1570947259=36, srv510866128=77, srv842285066=98, srv798884546=95, srv1550819878=35, srv1414750845=25, srv823671357=97, srv324608597=66, srv1072690409=2, srv664460157=87, srv2074642484=55, srv1390718067=21, srv277923439=62, srv490415257=73, srv128829674=15, srv50446618=75, srv1271410710=12, srv494704674=74, srv1650946219=39, srv1399582799=24, srv1279426311=14, srv1328122584=19, srv525913674=78, srv1484422442=27, srv791232980=94, srv718029413=89, srv1396366671=22, srv1160592251=8, srv597931318=82, srv1589274328=37, srv1940188650=50, srv327359924=67, srv650223541=86} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-18 22:53:21,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-18 22:53:21,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-18 22:53:21,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-18 22:53:21,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-18 22:53:21,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-18 22:53:21,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-18 22:53:21,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-18 22:53:21,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-18 22:53:21,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-18 22:53:21,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-18 22:53:21,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-18 22:53:21,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-18 22:53:21,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-18 22:53:21,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-18 22:53:21,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-18 22:53:21,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-18 22:53:21,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-18 22:53:21,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-18 22:53:21,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-18 22:53:21,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-18 22:53:21,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-18 22:53:21,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-18 22:53:21,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-18 22:53:21,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-18 22:53:21,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-18 22:53:21,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-18 22:53:21,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-18 22:53:21,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-18 22:53:21,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-18 22:53:21,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-18 22:53:21,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-02-18 22:53:21,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-02-18 22:53:21,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-02-18 22:53:21,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-02-18 22:53:21,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-02-18 22:53:21,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-02-18 22:53:21,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-02-18 22:53:21,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-02-18 22:53:21,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-02-18 22:53:21,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-02-18 22:53:21,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-02-18 22:53:21,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-02-18 22:53:21,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-02-18 22:53:21,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-02-18 22:53:21,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-02-18 22:53:21,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-02-18 22:53:21,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-02-18 22:53:21,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-02-18 22:53:21,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-02-18 22:53:21,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-02-18 22:53:21,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-02-18 22:53:21,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-02-18 22:53:21,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-02-18 22:53:21,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-02-18 22:53:21,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-02-18 22:53:21,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-02-18 22:53:21,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-02-18 22:53:21,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-02-18 22:53:21,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-02-18 22:53:21,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-02-18 22:53:21,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-02-18 22:53:21,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-02-18 22:53:21,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-02-18 22:53:21,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-02-18 22:53:21,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-02-18 22:53:21,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-02-18 22:53:21,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-02-18 22:53:21,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-02-18 22:53:21,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-02-18 22:53:21,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-02-18 22:53:21,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-02-18 22:53:21,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-02-18 22:53:21,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-02-18 22:53:21,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-02-18 22:53:21,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-02-18 22:53:21,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-02-18 22:53:21,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-02-18 22:53:21,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-02-18 22:53:21,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-02-18 22:53:21,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-02-18 22:53:21,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-02-18 22:53:21,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-02-18 22:53:21,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-02-18 22:53:21,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-02-18 22:53:21,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-02-18 22:53:21,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-02-18 22:53:21,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-02-18 22:53:21,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-02-18 22:53:21,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-02-18 22:53:21,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-02-18 22:53:21,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-02-18 22:53:21,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-02-18 22:53:21,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-02-18 22:53:21,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-02-18 22:53:21,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-02-18 22:53:21,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-02-18 22:53:21,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-02-18 22:53:21,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-02-18 22:53:21,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-02-18 22:53:21,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-02-18 22:53:21,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-02-18 22:53:21,201 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.689421800350782E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-18 22:53:21,201 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1075120760:83 , srv1160592251:83 , srv1180081751:83 , srv1390718067:83 , srv139896317:83 , srv1492590538:83 , srv1545447294:83 , srv1702408974:83 , srv447923462:83 , srv507429499:83 , srv664460157:83 , srv1044776793:84 , srv1056433821:84 , srv1072690409:84 , srv1088468678:84 , srv1097587979:84 , srv1136041010:84 , srv1153167025:84 , srv1239532048:84 , srv1254306852:84 , srv1271410710:84 , srv1275569001:84 , srv128829674:84 , srv1289583756:84 , srv1300499171:84 , srv1318677571:84 , srv1328122584:84 , srv1379841541:84 , srv1396366671:84 , srv1399582799:84 , srv1414750845:84 , srv1429058411:84 , srv1484422442:84 , srv1488693687:84 , srv1513829414:84 , srv1531555500:84 , srv1547911822:84 , srv1550819878:84 , srv1570947259:84 , srv1589274328:84 , srv1610019048:84 , srv1650946219:84 , srv1677064192:84 , srv1703936874:84 , srv1747558042:84 , srv1755098785:84 , srv1814783289:84 , srv1821611008:84 , srv1838675863:84 , srv1869031076:84 , srv1879712051:84 , srv1949029590:84 , srv2019635779:84 , srv205096699:84 , srv2074642484:84 , srv2076594914:84 , srv2117691986:84 , srv2118699264:84 , srv2132379956:84 , srv2138194177:84 , srv292634073:84 , srv293678257:84 , srv323849191:84 , srv324608597:84 , srv327359924:84 , srv363792045:84 , srv375732628:84 , srv405392249:84 , srv490415257:84 , srv494704674:84 , srv50446618:84 , srv510866128:84 , srv546810539:84 , srv580539013:84 , srv593058757:84 , srv627913892:84 , srv63112688:84 , srv64904477:84 , srv650223541:84 , srv700425364:84 , srv718029413:84 , srv751585941:84 , srv754704863:84 , srv763832632:84 , srv798884546:84 , srv822993754:84 , srv823671357:84 , srv989548948:84 , srv1279426311:85 , srv1507376616:85 , srv1940188650:85 , srv2072124548:85 , srv233839881:85 , srv277923439:85 , srv330307171:85 , srv525913674:85 , srv597931318:85 , srv727683315:85 , srv842285066:85 , srv791232980:684 }
2024-02-18 22:53:21,229 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=262 (was 262), ProcessCount=167 (was 167), AvailableMemoryMB=11002 (was 11728)
2024-02-18 22:53:21,236 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=262, ProcessCount=167, AvailableMemoryMB=11001
2024-02-18 22:53:21,237 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-02-18 22:53:21,237 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2024-02-18 22:53:21,252 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1003634345:84 , srv1037649320:84 , srv108926358:84 , srv1089753029:84 , srv113930941:84 , srv1164594457:84 , srv1408332636:84 , srv144895366:84 , srv1506039721:84 , srv1615726802:84 , srv1673822232:84 , srv1758279409:84 , srv1911791318:84 , srv1917417443:84 , srv1977921982:84 , srv2005589015:84 , srv2141851545:84 , srv262238777:84 , srv317562589:84 , srv410280615:84 , srv422488100:84 , srv472664775:84 , srv48531901:84 , srv552402318:84 , srv772398914:84 , srv816958585:84 , srv824430136:84 , srv870295146:84 , srv884702501:84 , srv198220194:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2024-02-18 22:53:21,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-18 22:53:21,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv410280615=20, srv1615726802=9, srv1911791318=12, srv2005589015=16, srv772398914=25, srv870295146=28, srv108926358=2, srv824430136=27, srv1673822232=10, srv198220194=15, srv317562589=19, srv422488100=21, srv1977921982=14, srv1917417443=13, srv144895366=7, srv1164594457=5, srv1037649320=1, srv113930941=4, srv2141851545=17, srv552402318=24, srv884702501=29, srv472664775=22, srv48531901=23, srv1408332636=6, srv816958585=26, srv1506039721=8, srv262238777=18, srv1758279409=11, srv1003634345=0, srv1089753029=3} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-18 22:53:21,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-18 22:53:21,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-18 22:53:21,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-18 22:53:21,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-18 22:53:21,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-18 22:53:21,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-18 22:53:21,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-18 22:53:21,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-18 22:53:21,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-18 22:53:21,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-18 22:53:21,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-18 22:53:21,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-18 22:53:21,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-18 22:53:21,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-18 22:53:21,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-18 22:53:21,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-18 22:53:21,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-18 22:53:21,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-18 22:53:21,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-18 22:53:21,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-18 22:53:21,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-18 22:53:21,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-18 22:53:21,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-18 22:53:21,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-18 22:53:21,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-18 22:53:21,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-18 22:53:21,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-18 22:53:21,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-18 22:53:21,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-18 22:53:21,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-18 22:53:21,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-02-18 22:53:21,288 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1160560168470215, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-18 22:53:21,288 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912558731983787, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1160560168470215, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2024-02-18 22:55:21,275 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5470895 different iterations.  Found a solution that moves 1861 regions; Going from a computed imbalance of 0.9912558731983787 to a new imbalance of 4.3436668390529226E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6892592592592592, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-18 22:55:21,281 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1003634345:90 , srv1037649320:90 , srv108926358:90 , srv1089753029:90 , srv113930941:90 , srv1164594457:90 , srv1408332636:90 , srv144895366:90 , srv1506039721:90 , srv1615726802:90 , srv1673822232:90 , srv1758279409:90 , srv1911791318:90 , srv1917417443:90 , srv1977921982:90 , srv198220194:90 , srv2005589015:90 , srv2141851545:90 , srv262238777:90 , srv317562589:90 , srv410280615:90 , srv422488100:90 , srv472664775:90 , srv48531901:90 , srv552402318:90 , srv772398914:90 , srv816958585:90 , srv824430136:90 , srv870295146:90 , srv884702501:90 }
2024-02-18 22:55:21,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-18 22:55:21,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv410280615=20, srv1615726802=9, srv1911791318=12, srv2005589015=16, srv772398914=25, srv870295146=28, srv108926358=2, srv824430136=27, srv1673822232=10, srv198220194=15, srv317562589=19, srv422488100=21, srv1977921982=14, srv1917417443=13, srv144895366=7, srv1164594457=5, srv1037649320=1, srv113930941=4, srv2141851545=17, srv552402318=24, srv884702501=29, srv472664775=22, srv48531901=23, srv1408332636=6, srv816958585=26, srv1506039721=8, srv262238777=18, srv1758279409=11, srv1003634345=0, srv1089753029=3} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-18 22:55:21,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-18 22:55:21,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-18 22:55:21,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-18 22:55:21,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-18 22:55:21,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-18 22:55:21,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-18 22:55:21,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-18 22:55:21,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-18 22:55:21,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-18 22:55:21,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-18 22:55:21,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-18 22:55:21,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-18 22:55:21,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-18 22:55:21,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-18 22:55:21,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-18 22:55:21,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-18 22:55:21,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-18 22:55:21,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-18 22:55:21,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-18 22:55:21,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-18 22:55:21,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-18 22:55:21,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-18 22:55:21,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-18 22:55:21,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-18 22:55:21,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-18 22:55:21,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-18 22:55:21,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-18 22:55:21,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-18 22:55:21,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-18 22:55:21,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-18 22:55:21,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-02-18 22:55:21,299 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-18 22:55:21,299 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1003634345:90 , srv1037649320:90 , srv108926358:90 , srv1089753029:90 , srv113930941:90 , srv1164594457:90 , srv1408332636:90 , srv144895366:90 , srv1506039721:90 , srv1615726802:90 , srv1673822232:90 , srv1758279409:90 , srv1911791318:90 , srv1917417443:90 , srv1977921982:90 , srv198220194:90 , srv2005589015:90 , srv2141851545:90 , srv262238777:90 , srv317562589:90 , srv410280615:90 , srv422488100:90 , srv472664775:90 , srv48531901:90 , srv552402318:90 , srv772398914:90 , srv816958585:90 , srv824430136:90 , srv870295146:90 , srv884702501:90 }
2024-02-18 22:55:21,313 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=206 (was 262), ProcessCount=167 (was 167), AvailableMemoryMB=10555 (was 11001)