2024-01-22 01:53:13,634 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2024-01-22 01:53:13,947 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2024-01-22 01:53:14,065 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2024-01-22 01:53:14,138 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-01-22 01:53:14,145 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-01-22 01:53:14,158 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=284, ProcessCount=167, AvailableMemoryMB=18857
2024-01-22 01:53:14,160 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-01-22 01:53:14,160 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-01-22 01:53:14,296 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1003396000:84 , srv1007590337:84 , srv1008930598:84 , srv1034183747:84 , srv1038581892:84 , srv1040103142:84 , srv1042236257:84 , srv1051842574:84 , srv1058803746:84 , srv1082750747:84 , srv108699879:84 , srv1154344160:84 , srv115596009:84 , srv1165352746:84 , srv1167325143:84 , srv1176155195:84 , srv1222535132:84 , srv1235533317:84 , srv125514036:84 , srv1259955960:84 , srv1288655561:84 , srv1308321116:84 , srv1350207999:84 , srv140637165:84 , srv1437809907:84 , srv1466113598:84 , srv1524284078:84 , srv1537389373:84 , srv1548426824:84 , srv1594541497:84 , srv1602437014:84 , srv1610671198:84 , srv165311848:84 , srv1681631062:84 , srv1684445242:84 , srv1694840256:84 , srv1709754450:84 , srv1714952891:84 , srv173267999:84 , srv1745995119:84 , srv1780954740:84 , srv1793292998:84 , srv1819664162:84 , srv1850303835:84 , srv186732250:84 , srv1926697098:84 , srv1954108712:84 , srv196604881:84 , srv1975762344:84 , srv1987686026:84 , srv2000469031:84 , srv201921574:84 , srv2037963635:84 , srv2070903375:84 , srv2079785022:84 , srv2085915110:84 , srv2095448063:84 , srv2130536100:84 , srv233413515:84 , srv240052080:84 , srv248656486:84 , srv273759409:84 , srv28119556:84 , srv297185341:84 , srv311948407:84 , srv312379643:84 , srv319487363:84 , srv343348149:84 , srv345606523:84 , srv391917203:84 , srv398806488:84 , srv407068701:84 , srv408852005:84 , srv434326571:84 , srv455253517:84 , srv470434691:84 , srv516302798:84 , srv526080310:84 , srv529570071:84 , srv539033084:84 , srv608619447:84 , srv610818054:84 , srv632116376:84 , srv657532139:84 , srv712213933:84 , srv71241066:84 , srv716174818:84 , srv753882706:84 , srv765628155:84 , srv771773127:84 , srv779488949:84 , srv796303327:84 , srv818430512:84 , srv885066828:84 , srv896319314:84 , srv905956656:84 , srv921079035:84 , srv928441623:84 , srv954676239:84 , srv754002609:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2024-01-22 01:53:14,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-01-22 01:53:14,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv71241066=85, srv1165352746=13, srv905956656=96, srv1308321116=21, srv1926697098=45, srv319487363=66, srv1745995119=39, srv2085915110=55, srv391917203=69, srv1524284078=26, srv1058803746=8, srv1694840256=35, srv1082750747=9, srv753882706=87, srv1684445242=34, srv28119556=62, srv1437809907=24, srv1003396000=0, srv1222535132=16, srv115596009=12, srv1602437014=30, srv1594541497=29, srv1167325143=14, srv1034183747=3, srv1051842574=7, srv608619447=80, srv108699879=10, srv539033084=79, srv248656486=60, srv407068701=71, srv1975762344=48, srv1537389373=27, srv1042236257=6, srv1040103142=5, srv2037963635=52, srv928441623=98, srv796303327=92, srv1008930598=2, srv311948407=64, srv140637165=23, srv233413515=58, srv818430512=93, srv1288655561=20, srv186732250=44, srv1154344160=11, srv312379643=65, srv896319314=95, srv1780954740=40, srv2079785022=54, srv2000469031=50, srv165311848=32, srv1714952891=37, srv2070903375=53, srv240052080=59, srv196604881=47, srv954676239=99, srv1259955960=19, srv610818054=81, srv1038581892=4, srv526080310=77, srv173267999=38, srv455253517=74, srv779488949=91, srv434326571=73, srv632116376=82, srv516302798=76, srv1350207999=22, srv657532139=83, srv2130536100=57, srv1548426824=28, srv885066828=94, srv921079035=97, srv201921574=51, srv297185341=63, srv345606523=68, srv343348149=67, srv273759409=61, srv1819664162=42, srv2095448063=56, srv1176155195=15, srv716174818=86, srv1610671198=31, srv1681631062=33, srv1793292998=41, srv1954108712=46, srv529570071=78, srv470434691=75, srv398806488=70, srv125514036=18, srv1709754450=36, srv771773127=90, srv712213933=84, srv1987686026=49, srv1850303835=43, srv408852005=72, srv765628155=89, srv1466113598=25, srv1235533317=17, srv754002609=88, srv1007590337=1} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-01-22 01:53:14,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-01-22 01:53:14,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-01-22 01:53:14,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-01-22 01:53:14,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-01-22 01:53:14,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-01-22 01:53:14,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-01-22 01:53:14,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-01-22 01:53:14,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-01-22 01:53:14,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-01-22 01:53:14,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-01-22 01:53:14,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-01-22 01:53:14,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-01-22 01:53:14,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-01-22 01:53:14,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-01-22 01:53:14,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-01-22 01:53:14,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-01-22 01:53:14,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-01-22 01:53:14,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-01-22 01:53:14,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-01-22 01:53:14,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-01-22 01:53:14,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-01-22 01:53:14,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-01-22 01:53:14,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-01-22 01:53:14,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-01-22 01:53:14,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-01-22 01:53:14,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-01-22 01:53:14,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-01-22 01:53:14,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-01-22 01:53:14,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-01-22 01:53:14,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-01-22 01:53:14,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-01-22 01:53:14,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-01-22 01:53:14,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-01-22 01:53:14,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-01-22 01:53:14,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-01-22 01:53:14,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-01-22 01:53:14,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-01-22 01:53:14,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-01-22 01:53:14,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-01-22 01:53:14,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-01-22 01:53:14,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-01-22 01:53:14,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-01-22 01:53:14,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-01-22 01:53:14,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-01-22 01:53:14,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-01-22 01:53:14,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-01-22 01:53:14,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-01-22 01:53:14,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-01-22 01:53:14,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-01-22 01:53:14,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-01-22 01:53:14,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-01-22 01:53:14,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-01-22 01:53:14,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-01-22 01:53:14,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-01-22 01:53:14,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-01-22 01:53:14,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-01-22 01:53:14,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-01-22 01:53:14,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-01-22 01:53:14,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-01-22 01:53:14,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-01-22 01:53:14,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-01-22 01:53:14,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-01-22 01:53:14,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-01-22 01:53:14,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-01-22 01:53:14,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-01-22 01:53:14,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-01-22 01:53:14,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-01-22 01:53:14,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-01-22 01:53:14,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-01-22 01:53:14,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-01-22 01:53:14,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-01-22 01:53:14,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-01-22 01:53:14,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-01-22 01:53:14,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-01-22 01:53:14,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-01-22 01:53:14,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-01-22 01:53:14,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-01-22 01:53:14,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-01-22 01:53:14,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-01-22 01:53:14,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-01-22 01:53:14,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-01-22 01:53:14,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-01-22 01:53:14,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-01-22 01:53:14,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-01-22 01:53:14,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-01-22 01:53:14,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-01-22 01:53:14,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-01-22 01:53:14,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-01-22 01:53:14,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-01-22 01:53:14,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-01-22 01:53:14,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-01-22 01:53:14,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-01-22 01:53:14,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-01-22 01:53:14,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-01-22 01:53:14,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-01-22 01:53:14,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-01-22 01:53:14,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-01-22 01:53:14,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-01-22 01:53:14,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-01-22 01:53:14,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-01-22 01:53:14,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-01-22 01:53:14,679 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-22 01:53:14,679 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-01-22 01:53:14,679 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-01-22 01:53:15,112 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 671 ms to try 5000 different iterations.  Found a solution that moves 4656 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18717605357023892. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.040618733748887505, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05620429306487681, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5173333333333333, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.040618733748887505, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.18275, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24625, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-22 01:53:15,151 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv108699879:79 , srv173267999:79 , srv2085915110:81 , srv608619447:81 , srv765628155:81 , srv2079785022:82 , srv319487363:82 , srv1040103142:83 , srv1051842574:83 , srv1165352746:83 , srv1176155195:83 , srv2000469031:83 , srv407068701:83 , srv539033084:83 , srv610818054:83 , srv71241066:83 , srv1350207999:84 , srv297185341:84 , srv345606523:84 , srv408852005:84 , srv905956656:84 , srv928441623:84 , srv954676239:84 , srv1008930598:85 , srv1235533317:85 , srv1288655561:85 , srv1594541497:85 , srv196604881:85 , srv1975762344:85 , srv312379643:85 , srv779488949:85 , srv896319314:85 , srv115596009:86 , srv1437809907:86 , srv1537389373:86 , srv1709754450:86 , srv1714952891:86 , srv1926697098:86 , srv1954108712:86 , srv273759409:86 , srv657532139:86 , srv712213933:86 , srv753882706:86 , srv796303327:86 , srv1042236257:87 , srv1154344160:87 , srv1259955960:87 , srv140637165:87 , srv1466113598:87 , srv1524284078:87 , srv165311848:87 , srv1681631062:87 , srv1694840256:87 , srv1819664162:87 , srv1850303835:87 , srv186732250:87 , srv201921574:87 , srv2070903375:87 , srv2130536100:87 , srv343348149:87 , srv455253517:87 , srv529570071:87 , srv632116376:87 , srv771773127:87 , srv818430512:87 , srv1007590337:88 , srv1034183747:88 , srv1058803746:88 , srv1082750747:88 , srv1167325143:88 , srv1222535132:88 , srv1308321116:88 , srv1780954740:88 , srv2095448063:88 , srv28119556:88 , srv311948407:88 , srv434326571:88 , srv470434691:88 , srv526080310:88 , srv1038581892:89 , srv1602437014:89 , srv1745995119:89 , srv1793292998:89 , srv1987686026:89 , srv2037963635:89 , srv233413515:89 , srv516302798:89 , srv716174818:89 , srv885066828:89 , srv921079035:89 , srv125514036:90 , srv1684445242:90 , srv248656486:90 , srv391917203:90 , srv398806488:90 , srv1003396000:91 , srv1548426824:91 , srv1610671198:91 , srv240052080:91 , srv754002609:451 }
2024-01-22 01:53:15,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-01-22 01:53:15,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv71241066=85, srv1165352746=13, srv905956656=96, srv1308321116=21, srv1926697098=45, srv319487363=66, srv1745995119=39, srv2085915110=55, srv391917203=69, srv1524284078=26, srv1058803746=8, srv1694840256=35, srv1082750747=9, srv753882706=87, srv1684445242=34, srv28119556=62, srv1437809907=24, srv1003396000=0, srv1222535132=16, srv115596009=12, srv1602437014=30, srv1594541497=29, srv1167325143=14, srv1034183747=3, srv1051842574=7, srv608619447=80, srv108699879=10, srv539033084=79, srv248656486=60, srv407068701=71, srv1975762344=48, srv1537389373=27, srv1042236257=6, srv1040103142=5, srv2037963635=52, srv928441623=98, srv796303327=92, srv1008930598=2, srv311948407=64, srv140637165=23, srv233413515=58, srv818430512=93, srv1288655561=20, srv186732250=44, srv1154344160=11, srv312379643=65, srv896319314=95, srv1780954740=40, srv2079785022=54, srv2000469031=50, srv165311848=32, srv1714952891=37, srv2070903375=53, srv240052080=59, srv196604881=47, srv954676239=99, srv1259955960=19, srv610818054=81, srv1038581892=4, srv526080310=77, srv173267999=38, srv455253517=74, srv779488949=91, srv434326571=73, srv632116376=82, srv516302798=76, srv1350207999=22, srv657532139=83, srv2130536100=57, srv1548426824=28, srv885066828=94, srv921079035=97, srv201921574=51, srv297185341=63, srv345606523=68, srv343348149=67, srv273759409=61, srv1819664162=42, srv2095448063=56, srv1176155195=15, srv716174818=86, srv1610671198=31, srv1681631062=33, srv1793292998=41, srv1954108712=46, srv529570071=78, srv470434691=75, srv398806488=70, srv125514036=18, srv1709754450=36, srv771773127=90, srv712213933=84, srv1987686026=49, srv1850303835=43, srv408852005=72, srv765628155=89, srv1466113598=25, srv1235533317=17, srv754002609=88, srv1007590337=1} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-01-22 01:53:15,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-01-22 01:53:15,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-01-22 01:53:15,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-01-22 01:53:15,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-01-22 01:53:15,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-01-22 01:53:15,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-01-22 01:53:15,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-01-22 01:53:15,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-01-22 01:53:15,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-01-22 01:53:15,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-01-22 01:53:15,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-01-22 01:53:15,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-01-22 01:53:15,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-01-22 01:53:15,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-01-22 01:53:15,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-01-22 01:53:15,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-01-22 01:53:15,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-01-22 01:53:15,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-01-22 01:53:15,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-01-22 01:53:15,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-01-22 01:53:15,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-01-22 01:53:15,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-01-22 01:53:15,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-01-22 01:53:15,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-01-22 01:53:15,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-01-22 01:53:15,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-01-22 01:53:15,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-01-22 01:53:15,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-01-22 01:53:15,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-01-22 01:53:15,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-01-22 01:53:15,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-01-22 01:53:15,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-01-22 01:53:15,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-01-22 01:53:15,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-01-22 01:53:15,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-01-22 01:53:15,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-01-22 01:53:15,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-01-22 01:53:15,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-01-22 01:53:15,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-01-22 01:53:15,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-01-22 01:53:15,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-01-22 01:53:15,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-01-22 01:53:15,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-01-22 01:53:15,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-01-22 01:53:15,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-01-22 01:53:15,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-01-22 01:53:15,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-01-22 01:53:15,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-01-22 01:53:15,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-01-22 01:53:15,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-01-22 01:53:15,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-01-22 01:53:15,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-01-22 01:53:15,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-01-22 01:53:15,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-01-22 01:53:15,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-01-22 01:53:15,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-01-22 01:53:15,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-01-22 01:53:15,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-01-22 01:53:15,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-01-22 01:53:15,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-01-22 01:53:15,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-01-22 01:53:15,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-01-22 01:53:15,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-01-22 01:53:15,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-01-22 01:53:15,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-01-22 01:53:15,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-01-22 01:53:15,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-01-22 01:53:15,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-01-22 01:53:15,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-01-22 01:53:15,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-01-22 01:53:15,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-01-22 01:53:15,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-01-22 01:53:15,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-01-22 01:53:15,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-01-22 01:53:15,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-01-22 01:53:15,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-01-22 01:53:15,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-01-22 01:53:15,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-01-22 01:53:15,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-01-22 01:53:15,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-01-22 01:53:15,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-01-22 01:53:15,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-01-22 01:53:15,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-01-22 01:53:15,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-01-22 01:53:15,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-01-22 01:53:15,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-01-22 01:53:15,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-01-22 01:53:15,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-01-22 01:53:15,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-01-22 01:53:15,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-01-22 01:53:15,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-01-22 01:53:15,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-01-22 01:53:15,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-01-22 01:53:15,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-01-22 01:53:15,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-01-22 01:53:15,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-01-22 01:53:15,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-01-22 01:53:15,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-01-22 01:53:15,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-01-22 01:53:15,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-01-22 01:53:15,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-01-22 01:53:15,394 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.040618733748887505, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05620429306487681, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.040618733748887505, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.18275, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24625, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-22 01:53:15,395 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-01-22 01:53:15,395 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.1871434515614222, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.040618733748887505, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05620429306487681, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.040618733748887505, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.18275, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24625, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-01-22 01:53:15,723 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 495 ms to try 5000 different iterations.  Found a solution that moves 2649 regions; Going from a computed imbalance of 0.1871434515614222 to a new imbalance of 0.016357241620662103. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021963703918321635); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.029538158470631494, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29433333333333334, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021963703918321635); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013166666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04716666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-22 01:53:15,734 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1602437014:79 , srv1003396000:80 , srv2095448063:81 , srv248656486:81 , srv391917203:81 , srv1548426824:82 , srv1684445242:82 , srv1793292998:82 , srv1819664162:82 , srv2037963635:82 , srv398806488:82 , srv921079035:82 , srv1082750747:83 , srv1308321116:83 , srv140637165:83 , srv1780954740:83 , srv1987686026:83 , srv28119556:83 , srv311948407:83 , srv470434691:83 , srv632116376:83 , srv716174818:83 , srv1007590337:84 , srv1034183747:84 , srv1038581892:84 , srv1058803746:84 , srv1154344160:84 , srv1167325143:84 , srv125514036:84 , srv1694840256:84 , srv1709754450:84 , srv1745995119:84 , srv1850303835:84 , srv233413515:84 , srv240052080:84 , srv273759409:84 , srv516302798:84 , srv771773127:84 , srv1466113598:85 , srv1524284078:85 , srv1537389373:85 , srv1610671198:85 , srv186732250:85 , srv2130536100:85 , srv297185341:85 , srv434326571:85 , srv455253517:85 , srv529570071:85 , srv779488949:85 , srv818430512:85 , srv896319314:85 , srv1008930598:86 , srv1042236257:86 , srv1222535132:86 , srv1437809907:86 , srv1681631062:86 , srv2070903375:86 , srv2079785022:86 , srv312379643:86 , srv343348149:86 , srv526080310:86 , srv1235533317:87 , srv1259955960:87 , srv1288655561:87 , srv1594541497:87 , srv1714952891:87 , srv1926697098:87 , srv196604881:87 , srv1975762344:87 , srv345606523:87 , srv408852005:87 , srv712213933:87 , srv753882706:87 , srv796303327:87 , srv885066828:87 , srv905956656:87 , srv928441623:87 , srv1165352746:88 , srv1350207999:88 , srv1954108712:88 , srv2000469031:88 , srv201921574:88 , srv539033084:88 , srv608619447:88 , srv657532139:88 , srv1051842574:89 , srv115596009:89 , srv165311848:89 , srv407068701:89 , srv610818054:89 , srv1040103142:90 , srv954676239:90 , srv1176155195:91 , srv71241066:91 , srv765628155:91 , srv108699879:92 , srv319487363:92 , srv173267999:93 , srv2085915110:96 , srv754002609:518 }
2024-01-22 01:53:15,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-01-22 01:53:15,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv71241066=85, srv1165352746=13, srv905956656=96, srv1308321116=21, srv1926697098=45, srv319487363=66, srv1745995119=39, srv2085915110=55, srv391917203=69, srv1524284078=26, srv1058803746=8, srv1694840256=35, srv1082750747=9, srv753882706=87, srv1684445242=34, srv28119556=62, srv1437809907=24, srv1003396000=0, srv1222535132=16, srv115596009=12, srv1602437014=30, srv1594541497=29, srv1167325143=14, srv1034183747=3, srv1051842574=7, srv608619447=80, srv108699879=10, srv539033084=79, srv248656486=60, srv407068701=71, srv1975762344=48, srv1537389373=27, srv1042236257=6, srv1040103142=5, srv2037963635=52, srv928441623=98, srv796303327=92, srv1008930598=2, srv311948407=64, srv140637165=23, srv233413515=58, srv818430512=93, srv1288655561=20, srv186732250=44, srv1154344160=11, srv312379643=65, srv896319314=95, srv1780954740=40, srv2079785022=54, srv2000469031=50, srv165311848=32, srv1714952891=37, srv2070903375=53, srv240052080=59, srv196604881=47, srv954676239=99, srv1259955960=19, srv610818054=81, srv1038581892=4, srv526080310=77, srv173267999=38, srv455253517=74, srv779488949=91, srv434326571=73, srv632116376=82, srv516302798=76, srv1350207999=22, srv657532139=83, srv2130536100=57, srv1548426824=28, srv885066828=94, srv921079035=97, srv201921574=51, srv297185341=63, srv345606523=68, srv343348149=67, srv273759409=61, srv1819664162=42, srv2095448063=56, srv1176155195=15, srv716174818=86, srv1610671198=31, srv1681631062=33, srv1793292998=41, srv1954108712=46, srv529570071=78, srv470434691=75, srv398806488=70, srv125514036=18, srv1709754450=36, srv771773127=90, srv712213933=84, srv1987686026=49, srv1850303835=43, srv408852005=72, srv765628155=89, srv1466113598=25, srv1235533317=17, srv754002609=88, srv1007590337=1} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-01-22 01:53:15,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-01-22 01:53:15,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-01-22 01:53:15,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-01-22 01:53:15,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-01-22 01:53:15,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-01-22 01:53:15,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-01-22 01:53:15,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-01-22 01:53:15,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-01-22 01:53:15,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-01-22 01:53:15,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-01-22 01:53:15,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-01-22 01:53:15,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-01-22 01:53:15,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-01-22 01:53:15,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-01-22 01:53:15,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-01-22 01:53:15,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-01-22 01:53:15,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-01-22 01:53:15,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-01-22 01:53:15,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-01-22 01:53:15,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-01-22 01:53:15,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-01-22 01:53:15,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-01-22 01:53:15,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-01-22 01:53:15,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-01-22 01:53:15,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-01-22 01:53:15,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-01-22 01:53:15,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-01-22 01:53:15,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-01-22 01:53:15,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-01-22 01:53:15,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-01-22 01:53:15,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-01-22 01:53:15,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-01-22 01:53:15,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-01-22 01:53:15,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-01-22 01:53:15,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-01-22 01:53:15,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-01-22 01:53:15,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-01-22 01:53:15,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-01-22 01:53:15,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-01-22 01:53:15,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-01-22 01:53:15,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-01-22 01:53:15,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-01-22 01:53:15,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-01-22 01:53:15,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-01-22 01:53:15,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-01-22 01:53:15,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-01-22 01:53:15,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-01-22 01:53:15,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-01-22 01:53:15,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-01-22 01:53:15,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-01-22 01:53:15,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-01-22 01:53:15,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-01-22 01:53:15,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-01-22 01:53:15,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-01-22 01:53:15,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-01-22 01:53:15,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-01-22 01:53:15,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-01-22 01:53:15,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-01-22 01:53:15,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-01-22 01:53:15,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-01-22 01:53:15,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-01-22 01:53:15,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-01-22 01:53:15,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-01-22 01:53:15,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-01-22 01:53:15,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-01-22 01:53:15,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-01-22 01:53:15,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-01-22 01:53:15,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-01-22 01:53:15,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-01-22 01:53:15,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-01-22 01:53:15,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-01-22 01:53:15,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-01-22 01:53:15,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-01-22 01:53:15,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-01-22 01:53:15,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-01-22 01:53:15,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-01-22 01:53:15,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-01-22 01:53:15,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-01-22 01:53:15,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-01-22 01:53:15,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-01-22 01:53:15,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-01-22 01:53:15,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-01-22 01:53:15,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-01-22 01:53:15,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-01-22 01:53:15,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-01-22 01:53:15,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-01-22 01:53:15,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-01-22 01:53:15,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-01-22 01:53:15,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-01-22 01:53:15,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-01-22 01:53:15,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-01-22 01:53:15,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-01-22 01:53:15,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-01-22 01:53:15,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-01-22 01:53:15,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-01-22 01:53:15,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-01-22 01:53:15,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-01-22 01:53:15,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-01-22 01:53:15,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-01-22 01:53:15,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-01-22 01:53:15,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-01-22 01:53:15,935 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021963703918321635); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.029538158470631494, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021963703918321635); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013166666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04716666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-22 01:53:15,936 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-01-22 01:53:15,936 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.01633869292621291, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021963703918321635); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.029538158470631494, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021963703918321635); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013166666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04716666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-01-22 01:53:16,205 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 401 ms to try 5000 different iterations.  Found a solution that moves 1045 regions; Going from a computed imbalance of 0.01633869292621291 to a new imbalance of 4.0421851913167447E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004880413017956434); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0046178300810757415); MoveCostFunction : (multiplier=7.0, imbalance=0.11611111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.004880413017956434); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0030833333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-22 01:53:16,208 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1610671198:81 , srv2085915110:81 , srv885066828:81 , srv165311848:82 , srv954676239:82 , srv115596009:83 , srv1176155195:83 , srv1954108712:83 , srv201921574:83 , srv240052080:83 , srv753882706:83 , srv1038581892:84 , srv1222535132:84 , srv125514036:84 , srv1259955960:84 , srv1548426824:84 , srv1681631062:84 , srv1714952891:84 , srv319487363:84 , srv343348149:84 , srv526080310:84 , srv657532139:84 , srv71241066:84 , srv1008930598:85 , srv1034183747:85 , srv1040103142:85 , srv1042236257:85 , srv1235533317:85 , srv1288655561:85 , srv1350207999:85 , srv1437809907:85 , srv1466113598:85 , srv1684445242:85 , srv1745995119:85 , srv186732250:85 , srv1926697098:85 , srv1987686026:85 , srv2070903375:85 , srv233413515:85 , srv455253517:85 , srv516302798:85 , srv529570071:85 , srv712213933:85 , srv796303327:85 , srv1007590337:86 , srv1051842574:86 , srv1058803746:86 , srv1154344160:86 , srv1308321116:86 , srv1524284078:86 , srv1537389373:86 , srv1594541497:86 , srv173267999:86 , srv1780954740:86 , srv1793292998:86 , srv1850303835:86 , srv196604881:86 , srv2000469031:86 , srv2037963635:86 , srv2130536100:86 , srv248656486:86 , srv28119556:86 , srv311948407:86 , srv345606523:86 , srv391917203:86 , srv398806488:86 , srv407068701:86 , srv434326571:86 , srv539033084:86 , srv716174818:86 , srv765628155:86 , srv771773127:86 , srv818430512:86 , srv905956656:86 , srv1003396000:87 , srv1082750747:87 , srv108699879:87 , srv1165352746:87 , srv1167325143:87 , srv1694840256:87 , srv1975762344:87 , srv273759409:87 , srv312379643:87 , srv408852005:87 , srv610818054:87 , srv632116376:87 , srv896319314:87 , srv921079035:87 , srv928441623:87 , srv140637165:88 , srv1602437014:88 , srv1709754450:88 , srv470434691:88 , srv608619447:88 , srv779488949:88 , srv1819664162:89 , srv2095448063:89 , srv297185341:89 , srv2079785022:90 , srv754002609:532 }
2024-01-22 01:53:16,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-01-22 01:53:16,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv71241066=85, srv1165352746=13, srv905956656=96, srv1308321116=21, srv1926697098=45, srv319487363=66, srv1745995119=39, srv2085915110=55, srv391917203=69, srv1524284078=26, srv1058803746=8, srv1694840256=35, srv1082750747=9, srv753882706=87, srv1684445242=34, srv28119556=62, srv1437809907=24, srv1003396000=0, srv1222535132=16, srv115596009=12, srv1602437014=30, srv1594541497=29, srv1167325143=14, srv1034183747=3, srv1051842574=7, srv608619447=80, srv108699879=10, srv539033084=79, srv248656486=60, srv407068701=71, srv1975762344=48, srv1537389373=27, srv1042236257=6, srv1040103142=5, srv2037963635=52, srv928441623=98, srv796303327=92, srv1008930598=2, srv311948407=64, srv140637165=23, srv233413515=58, srv818430512=93, srv1288655561=20, srv186732250=44, srv1154344160=11, srv312379643=65, srv896319314=95, srv1780954740=40, srv2079785022=54, srv2000469031=50, srv165311848=32, srv1714952891=37, srv2070903375=53, srv240052080=59, srv196604881=47, srv954676239=99, srv1259955960=19, srv610818054=81, srv1038581892=4, srv526080310=77, srv173267999=38, srv455253517=74, srv779488949=91, srv434326571=73, srv632116376=82, srv516302798=76, srv1350207999=22, srv657532139=83, srv2130536100=57, srv1548426824=28, srv885066828=94, srv921079035=97, srv201921574=51, srv297185341=63, srv345606523=68, srv343348149=67, srv273759409=61, srv1819664162=42, srv2095448063=56, srv1176155195=15, srv716174818=86, srv1610671198=31, srv1681631062=33, srv1793292998=41, srv1954108712=46, srv529570071=78, srv470434691=75, srv398806488=70, srv125514036=18, srv1709754450=36, srv771773127=90, srv712213933=84, srv1987686026=49, srv1850303835=43, srv408852005=72, srv765628155=89, srv1466113598=25, srv1235533317=17, srv754002609=88, srv1007590337=1} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-01-22 01:53:16,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-01-22 01:53:16,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-01-22 01:53:16,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-01-22 01:53:16,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-01-22 01:53:16,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-01-22 01:53:16,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-01-22 01:53:16,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-01-22 01:53:16,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-01-22 01:53:16,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-01-22 01:53:16,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-01-22 01:53:16,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-01-22 01:53:16,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-01-22 01:53:16,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-01-22 01:53:16,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-01-22 01:53:16,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-01-22 01:53:16,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-01-22 01:53:16,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-01-22 01:53:16,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-01-22 01:53:16,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-01-22 01:53:16,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-01-22 01:53:16,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-01-22 01:53:16,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-01-22 01:53:16,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-01-22 01:53:16,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-01-22 01:53:16,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-01-22 01:53:16,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-01-22 01:53:16,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-01-22 01:53:16,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-01-22 01:53:16,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-01-22 01:53:16,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-01-22 01:53:16,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-01-22 01:53:16,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-01-22 01:53:16,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-01-22 01:53:16,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-01-22 01:53:16,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-01-22 01:53:16,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-01-22 01:53:16,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-01-22 01:53:16,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-01-22 01:53:16,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-01-22 01:53:16,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-01-22 01:53:16,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-01-22 01:53:16,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-01-22 01:53:16,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-01-22 01:53:16,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-01-22 01:53:16,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-01-22 01:53:16,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-01-22 01:53:16,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-01-22 01:53:16,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-01-22 01:53:16,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-01-22 01:53:16,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-01-22 01:53:16,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-01-22 01:53:16,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-01-22 01:53:16,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-01-22 01:53:16,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-01-22 01:53:16,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-01-22 01:53:16,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-01-22 01:53:16,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-01-22 01:53:16,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-01-22 01:53:16,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-01-22 01:53:16,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-01-22 01:53:16,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-01-22 01:53:16,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-01-22 01:53:16,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-01-22 01:53:16,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-01-22 01:53:16,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-01-22 01:53:16,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-01-22 01:53:16,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-01-22 01:53:16,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-01-22 01:53:16,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-01-22 01:53:16,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-01-22 01:53:16,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-01-22 01:53:16,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-01-22 01:53:16,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-01-22 01:53:16,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-01-22 01:53:16,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-01-22 01:53:16,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-01-22 01:53:16,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-01-22 01:53:16,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-01-22 01:53:16,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-01-22 01:53:16,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-01-22 01:53:16,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-01-22 01:53:16,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-01-22 01:53:16,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-01-22 01:53:16,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-01-22 01:53:16,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-01-22 01:53:16,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-01-22 01:53:16,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-01-22 01:53:16,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-01-22 01:53:16,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-01-22 01:53:16,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-01-22 01:53:16,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-01-22 01:53:16,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-01-22 01:53:16,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-01-22 01:53:16,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-01-22 01:53:16,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-01-22 01:53:16,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-01-22 01:53:16,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-01-22 01:53:16,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-01-22 01:53:16,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-01-22 01:53:16,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-01-22 01:53:16,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-01-22 01:53:16,344 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004880413017956434); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0046178300810757415); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.004880413017956434); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0030833333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-22 01:53:16,344 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-01-22 01:53:16,344 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=3.969012727370313E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004880413017956434); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0046178300810757415); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.004880413017956434); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0030833333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-01-22 01:53:16,703 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 457 ms to try 5000 different iterations.  Found a solution that moves 199 regions; Going from a computed imbalance of 3.969012727370313E-4 to a new imbalance of 1.8856358758074406E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.5313429231318235E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.022111111111111113); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.5313429231318235E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-22 01:53:16,704 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1167325143:83 , srv1975762344:83 , srv2095448063:83 , srv434326571:83 , srv470434691:83 , srv610818054:83 , srv712213933:83 , srv1003396000:84 , srv1007590337:84 , srv1040103142:84 , srv1042236257:84 , srv1051842574:84 , srv1058803746:84 , srv1082750747:84 , srv108699879:84 , srv115596009:84 , srv1165352746:84 , srv1176155195:84 , srv1222535132:84 , srv125514036:84 , srv1259955960:84 , srv140637165:84 , srv1437809907:84 , srv1524284078:84 , srv1594541497:84 , srv165311848:84 , srv1694840256:84 , srv1709754450:84 , srv173267999:84 , srv1745995119:84 , srv1780954740:84 , srv1819664162:84 , srv1926697098:84 , srv2070903375:84 , srv2085915110:84 , srv2130536100:84 , srv233413515:84 , srv297185341:84 , srv312379643:84 , srv319487363:84 , srv398806488:84 , srv407068701:84 , srv408852005:84 , srv516302798:84 , srv526080310:84 , srv657532139:84 , srv71241066:84 , srv716174818:84 , srv765628155:84 , srv779488949:84 , srv796303327:84 , srv818430512:84 , srv921079035:84 , srv928441623:84 , srv1034183747:85 , srv1038581892:85 , srv1154344160:85 , srv1235533317:85 , srv1288655561:85 , srv1308321116:85 , srv1350207999:85 , srv1466113598:85 , srv1537389373:85 , srv1548426824:85 , srv1610671198:85 , srv1681631062:85 , srv1684445242:85 , srv1714952891:85 , srv1793292998:85 , srv1850303835:85 , srv186732250:85 , srv1954108712:85 , srv196604881:85 , srv1987686026:85 , srv2000469031:85 , srv201921574:85 , srv2037963635:85 , srv2079785022:85 , srv240052080:85 , srv248656486:85 , srv273759409:85 , srv28119556:85 , srv311948407:85 , srv343348149:85 , srv345606523:85 , srv391917203:85 , srv455253517:85 , srv529570071:85 , srv539033084:85 , srv608619447:85 , srv632116376:85 , srv771773127:85 , srv896319314:85 , srv905956656:85 , srv1008930598:86 , srv1602437014:86 , srv753882706:86 , srv885066828:86 , srv954676239:86 , srv754002609:641 }
2024-01-22 01:53:16,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-01-22 01:53:16,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv71241066=85, srv1165352746=13, srv905956656=96, srv1308321116=21, srv1926697098=45, srv319487363=66, srv1745995119=39, srv2085915110=55, srv391917203=69, srv1524284078=26, srv1058803746=8, srv1694840256=35, srv1082750747=9, srv753882706=87, srv1684445242=34, srv28119556=62, srv1437809907=24, srv1003396000=0, srv1222535132=16, srv115596009=12, srv1602437014=30, srv1594541497=29, srv1167325143=14, srv1034183747=3, srv1051842574=7, srv608619447=80, srv108699879=10, srv539033084=79, srv248656486=60, srv407068701=71, srv1975762344=48, srv1537389373=27, srv1042236257=6, srv1040103142=5, srv2037963635=52, srv928441623=98, srv796303327=92, srv1008930598=2, srv311948407=64, srv140637165=23, srv233413515=58, srv818430512=93, srv1288655561=20, srv186732250=44, srv1154344160=11, srv312379643=65, srv896319314=95, srv1780954740=40, srv2079785022=54, srv2000469031=50, srv165311848=32, srv1714952891=37, srv2070903375=53, srv240052080=59, srv196604881=47, srv954676239=99, srv1259955960=19, srv610818054=81, srv1038581892=4, srv526080310=77, srv173267999=38, srv455253517=74, srv779488949=91, srv434326571=73, srv632116376=82, srv516302798=76, srv1350207999=22, srv657532139=83, srv2130536100=57, srv1548426824=28, srv885066828=94, srv921079035=97, srv201921574=51, srv297185341=63, srv345606523=68, srv343348149=67, srv273759409=61, srv1819664162=42, srv2095448063=56, srv1176155195=15, srv716174818=86, srv1610671198=31, srv1681631062=33, srv1793292998=41, srv1954108712=46, srv529570071=78, srv470434691=75, srv398806488=70, srv125514036=18, srv1709754450=36, srv771773127=90, srv712213933=84, srv1987686026=49, srv1850303835=43, srv408852005=72, srv765628155=89, srv1466113598=25, srv1235533317=17, srv754002609=88, srv1007590337=1} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-01-22 01:53:16,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-01-22 01:53:16,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-01-22 01:53:16,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-01-22 01:53:16,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-01-22 01:53:16,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-01-22 01:53:16,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-01-22 01:53:16,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-01-22 01:53:16,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-01-22 01:53:16,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-01-22 01:53:16,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-01-22 01:53:16,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-01-22 01:53:16,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-01-22 01:53:16,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-01-22 01:53:16,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-01-22 01:53:16,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-01-22 01:53:16,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-01-22 01:53:16,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-01-22 01:53:16,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-01-22 01:53:16,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-01-22 01:53:16,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-01-22 01:53:16,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-01-22 01:53:16,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-01-22 01:53:16,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-01-22 01:53:16,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-01-22 01:53:16,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-01-22 01:53:16,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-01-22 01:53:16,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-01-22 01:53:16,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-01-22 01:53:16,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-01-22 01:53:16,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-01-22 01:53:16,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-01-22 01:53:16,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-01-22 01:53:16,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-01-22 01:53:16,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-01-22 01:53:16,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-01-22 01:53:16,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-01-22 01:53:16,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-01-22 01:53:16,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-01-22 01:53:16,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-01-22 01:53:16,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-01-22 01:53:16,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-01-22 01:53:16,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-01-22 01:53:16,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-01-22 01:53:16,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-01-22 01:53:16,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-01-22 01:53:16,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-01-22 01:53:16,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-01-22 01:53:16,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-01-22 01:53:16,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-01-22 01:53:16,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-01-22 01:53:16,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-01-22 01:53:16,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-01-22 01:53:16,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-01-22 01:53:16,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-01-22 01:53:16,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-01-22 01:53:16,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-01-22 01:53:16,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-01-22 01:53:16,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-01-22 01:53:16,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-01-22 01:53:16,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-01-22 01:53:16,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-01-22 01:53:16,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-01-22 01:53:16,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-01-22 01:53:16,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-01-22 01:53:16,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-01-22 01:53:16,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-01-22 01:53:16,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-01-22 01:53:16,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-01-22 01:53:16,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-01-22 01:53:16,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-01-22 01:53:16,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-01-22 01:53:16,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-01-22 01:53:16,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-01-22 01:53:16,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-01-22 01:53:16,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-01-22 01:53:16,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-01-22 01:53:16,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-01-22 01:53:16,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-01-22 01:53:16,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-01-22 01:53:16,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-01-22 01:53:16,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-01-22 01:53:16,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-01-22 01:53:16,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-01-22 01:53:16,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-01-22 01:53:16,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-01-22 01:53:16,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-01-22 01:53:16,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-01-22 01:53:16,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-01-22 01:53:16,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-01-22 01:53:16,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-01-22 01:53:16,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-01-22 01:53:16,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-01-22 01:53:16,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-01-22 01:53:16,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-01-22 01:53:16,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-01-22 01:53:16,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-01-22 01:53:16,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-01-22 01:53:16,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-01-22 01:53:16,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-01-22 01:53:16,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-01-22 01:53:16,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-01-22 01:53:16,836 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=1.7462930975745232E-5 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.5313429231318235E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.5313429231318235E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-22 01:53:16,836 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1167325143:83 , srv1975762344:83 , srv2095448063:83 , srv434326571:83 , srv470434691:83 , srv610818054:83 , srv712213933:83 , srv1003396000:84 , srv1007590337:84 , srv1040103142:84 , srv1042236257:84 , srv1051842574:84 , srv1058803746:84 , srv1082750747:84 , srv108699879:84 , srv115596009:84 , srv1165352746:84 , srv1176155195:84 , srv1222535132:84 , srv125514036:84 , srv1259955960:84 , srv140637165:84 , srv1437809907:84 , srv1524284078:84 , srv1594541497:84 , srv165311848:84 , srv1694840256:84 , srv1709754450:84 , srv173267999:84 , srv1745995119:84 , srv1780954740:84 , srv1819664162:84 , srv1926697098:84 , srv2070903375:84 , srv2085915110:84 , srv2130536100:84 , srv233413515:84 , srv297185341:84 , srv312379643:84 , srv319487363:84 , srv398806488:84 , srv407068701:84 , srv408852005:84 , srv516302798:84 , srv526080310:84 , srv657532139:84 , srv71241066:84 , srv716174818:84 , srv765628155:84 , srv779488949:84 , srv796303327:84 , srv818430512:84 , srv921079035:84 , srv928441623:84 , srv1034183747:85 , srv1038581892:85 , srv1154344160:85 , srv1235533317:85 , srv1288655561:85 , srv1308321116:85 , srv1350207999:85 , srv1466113598:85 , srv1537389373:85 , srv1548426824:85 , srv1610671198:85 , srv1681631062:85 , srv1684445242:85 , srv1714952891:85 , srv1793292998:85 , srv1850303835:85 , srv186732250:85 , srv1954108712:85 , srv196604881:85 , srv1987686026:85 , srv2000469031:85 , srv201921574:85 , srv2037963635:85 , srv2079785022:85 , srv240052080:85 , srv248656486:85 , srv273759409:85 , srv28119556:85 , srv311948407:85 , srv343348149:85 , srv345606523:85 , srv391917203:85 , srv455253517:85 , srv529570071:85 , srv539033084:85 , srv608619447:85 , srv632116376:85 , srv771773127:85 , srv896319314:85 , srv905956656:85 , srv1008930598:86 , srv1602437014:86 , srv753882706:86 , srv885066828:86 , srv954676239:86 , srv754002609:641 }
2024-01-22 01:53:16,875 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=293 (was 284) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 167), AvailableMemoryMB=18257 (was 18857)
2024-01-22 01:53:16,883 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=293, ProcessCount=167, AvailableMemoryMB=18257
2024-01-22 01:53:16,884 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-01-22 01:53:16,885 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2024-01-22 01:53:16,898 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1002116018:84 , srv103472841:84 , srv1039382763:84 , srv1142757444:84 , srv1160584662:84 , srv119683851:84 , srv126592026:84 , srv1301853564:84 , srv1315013881:84 , srv1389664492:84 , srv14595677:84 , srv1482793571:84 , srv1485765968:84 , srv1553736593:84 , srv1556477539:84 , srv1560971574:84 , srv176524236:84 , srv1991448816:84 , srv221829230:84 , srv27482500:84 , srv292516417:84 , srv397307726:84 , srv487934862:84 , srv528940688:84 , srv707531108:84 , srv751861170:84 , srv788432791:84 , srv800996102:84 , srv89158249:84 , srv292305217:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2024-01-22 01:53:16,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-01-22 01:53:16,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv119683851=5, srv1002116018=0, srv292516417=21, srv1991448816=17, srv126592026=6, srv1142757444=3, srv788432791=27, srv1482793571=11, srv1315013881=8, srv27482500=19, srv707531108=25, srv1301853564=7, srv221829230=18, srv1560971574=15, srv1160584662=4, srv1556477539=14, srv176524236=16, srv800996102=28, srv103472841=1, srv292305217=20, srv751861170=26, srv1485765968=12, srv1553736593=13, srv89158249=29, srv14595677=10, srv1039382763=2, srv397307726=22, srv528940688=24, srv1389664492=9, srv487934862=23} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-01-22 01:53:16,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-01-22 01:53:16,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-01-22 01:53:16,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-01-22 01:53:16,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-01-22 01:53:16,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-01-22 01:53:16,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-01-22 01:53:16,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-01-22 01:53:16,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-01-22 01:53:16,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-01-22 01:53:16,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-01-22 01:53:16,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-01-22 01:53:16,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-01-22 01:53:16,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-01-22 01:53:16,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-01-22 01:53:16,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-01-22 01:53:16,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-01-22 01:53:16,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-01-22 01:53:16,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-01-22 01:53:16,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-01-22 01:53:16,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-01-22 01:53:16,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-01-22 01:53:16,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-01-22 01:53:16,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-01-22 01:53:16,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-01-22 01:53:16,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-01-22 01:53:16,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-01-22 01:53:16,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-01-22 01:53:16,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-01-22 01:53:16,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-01-22 01:53:16,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-01-22 01:53:16,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-01-22 01:53:16,942 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1236551552913847, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-22 01:53:16,942 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.991258267662089, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1236551552913847, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2024-01-22 01:55:16,921 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5527942 different iterations.  Found a solution that moves 1864 regions; Going from a computed imbalance of 0.991258267662089 to a new imbalance of 4.3506689887128686E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6903703703703704, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-22 01:55:16,930 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1002116018:90 , srv103472841:90 , srv1039382763:90 , srv1142757444:90 , srv1160584662:90 , srv119683851:90 , srv126592026:90 , srv1301853564:90 , srv1315013881:90 , srv1389664492:90 , srv14595677:90 , srv1482793571:90 , srv1485765968:90 , srv1553736593:90 , srv1556477539:90 , srv1560971574:90 , srv176524236:90 , srv1991448816:90 , srv221829230:90 , srv27482500:90 , srv292305217:90 , srv292516417:90 , srv397307726:90 , srv487934862:90 , srv528940688:90 , srv707531108:90 , srv751861170:90 , srv788432791:90 , srv800996102:90 , srv89158249:90 }
2024-01-22 01:55:16,938 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-01-22 01:55:16,938 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv119683851=5, srv1002116018=0, srv292516417=21, srv1991448816=17, srv126592026=6, srv1142757444=3, srv788432791=27, srv1482793571=11, srv1315013881=8, srv27482500=19, srv707531108=25, srv1301853564=7, srv221829230=18, srv1560971574=15, srv1160584662=4, srv1556477539=14, srv176524236=16, srv800996102=28, srv103472841=1, srv292305217=20, srv751861170=26, srv1485765968=12, srv1553736593=13, srv89158249=29, srv14595677=10, srv1039382763=2, srv397307726=22, srv528940688=24, srv1389664492=9, srv487934862=23} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-01-22 01:55:16,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-01-22 01:55:16,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-01-22 01:55:16,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-01-22 01:55:16,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-01-22 01:55:16,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-01-22 01:55:16,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-01-22 01:55:16,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-01-22 01:55:16,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-01-22 01:55:16,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-01-22 01:55:16,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-01-22 01:55:16,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-01-22 01:55:16,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-01-22 01:55:16,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-01-22 01:55:16,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-01-22 01:55:16,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-01-22 01:55:16,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-01-22 01:55:16,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-01-22 01:55:16,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-01-22 01:55:16,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-01-22 01:55:16,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-01-22 01:55:16,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-01-22 01:55:16,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-01-22 01:55:16,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-01-22 01:55:16,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-01-22 01:55:16,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-01-22 01:55:16,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-01-22 01:55:16,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-01-22 01:55:16,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-01-22 01:55:16,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-01-22 01:55:16,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-01-22 01:55:16,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-01-22 01:55:16,981 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-22 01:55:16,981 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1002116018:90 , srv103472841:90 , srv1039382763:90 , srv1142757444:90 , srv1160584662:90 , srv119683851:90 , srv126592026:90 , srv1301853564:90 , srv1315013881:90 , srv1389664492:90 , srv14595677:90 , srv1482793571:90 , srv1485765968:90 , srv1553736593:90 , srv1556477539:90 , srv1560971574:90 , srv176524236:90 , srv1991448816:90 , srv221829230:90 , srv27482500:90 , srv292305217:90 , srv292516417:90 , srv397307726:90 , srv487934862:90 , srv528940688:90 , srv707531108:90 , srv751861170:90 , srv788432791:90 , srv800996102:90 , srv89158249:90 }
2024-01-22 01:55:17,006 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=278 (was 293), ProcessCount=167 (was 167), AvailableMemoryMB=18251 (was 18257)