2024-03-19 17:53:26,505 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2024-03-19 17:53:26,803 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2024-03-19 17:53:26,906 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2024-03-19 17:53:26,965 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-03-19 17:53:26,972 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-03-19 17:53:26,987 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=242, ProcessCount=170, AvailableMemoryMB=4918
2024-03-19 17:53:26,989 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-03-19 17:53:26,989 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-03-19 17:53:27,115 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1005147454:84 , srv1052691387:84 , srv1061657114:84 , srv1077460561:84 , srv1094271136:84 , srv1099586617:84 , srv1137094987:84 , srv1158356341:84 , srv1170235945:84 , srv118158310:84 , srv1197367529:84 , srv1232033582:84 , srv1247412683:84 , srv1248755342:84 , srv125276689:84 , srv1258177891:84 , srv1258690737:84 , srv1276353572:84 , srv1287805937:84 , srv1289698917:84 , srv1343276437:84 , srv1362053006:84 , srv1375931210:84 , srv1389361404:84 , srv139528519:84 , srv1416044219:84 , srv1426546658:84 , srv1433430671:84 , srv1437829474:84 , srv145964607:84 , srv159224014:84 , srv1593508152:84 , srv1610364111:84 , srv1631656920:84 , srv1666264188:84 , srv1688491070:84 , srv1717058854:84 , srv174304758:84 , srv1778477136:84 , srv1787970139:84 , srv1794892631:84 , srv1808685302:84 , srv1832884204:84 , srv1860279770:84 , srv1864209295:84 , srv1874591601:84 , srv1882059498:84 , srv1889044132:84 , srv1938692434:84 , srv2023580476:84 , srv20410501:84 , srv2056340015:84 , srv2065795426:84 , srv208176507:84 , srv2092354382:84 , srv2097883893:84 , srv2107175167:84 , srv2112289973:84 , srv2133315310:84 , srv217901965:84 , srv235920959:84 , srv263690862:84 , srv27890012:84 , srv2821880:84 , srv302523676:84 , srv330853521:84 , srv33521157:84 , srv345445112:84 , srv356963077:84 , srv367584452:84 , srv387509794:84 , srv394225941:84 , srv398347907:84 , srv436527112:84 , srv440524266:84 , srv442091764:84 , srv445923591:84 , srv453674985:84 , srv467689228:84 , srv49933397:84 , srv55191273:84 , srv561620251:84 , srv58471250:84 , srv621812292:84 , srv629561683:84 , srv648479920:84 , srv654985956:84 , srv66856405:84 , srv710056799:84 , srv728590113:84 , srv74525800:84 , srv822983928:84 , srv840072747:84 , srv861961028:84 , srv93253155:84 , srv932649260:84 , srv941176738:84 , srv946185949:84 , srv999478060:84 , srv761850452:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2024-03-19 17:53:27,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-03-19 17:53:27,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv139528519=24, srv58471250=82, srv999478060=99, srv125276689=14, srv1170235945=8, srv1808685302=41, srv1258177891=15, srv345445112=67, srv946185949=98, srv27890012=62, srv1052691387=1, srv1938692434=48, srv2133315310=58, srv356963077=68, srv1099586617=5, srv442091764=75, srv1416044219=25, srv2065795426=52, srv159224014=30, srv1874591601=45, srv932649260=96, srv1197367529=10, srv710056799=88, srv561620251=81, srv1610364111=32, srv1882059498=46, srv1389361404=23, srv1631656920=33, srv467689228=78, srv1860279770=43, srv217901965=59, srv728590113=89, srv2092354382=54, srv1247412683=12, srv1787970139=39, srv208176507=53, srv55191273=80, srv1426546658=26, srv394225941=71, srv1864209295=44, srv49933397=79, srv1289698917=19, srv235920959=60, srv74525800=90, srv2112289973=57, srv1258690737=16, srv1778477136=38, srv861961028=94, srv93253155=95, srv1717058854=36, srv1158356341=7, srv1832884204=42, srv263690862=61, srv1137094987=6, srv629561683=84, srv1061657114=2, srv1794892631=40, srv1248755342=13, srv2821880=63, srv1375931210=22, srv445923591=76, srv453674985=77, srv654985956=86, srv621812292=83, srv941176738=97, srv387509794=70, srv1232033582=11, srv302523676=64, srv1433430671=27, srv1593508152=31, srv2097883893=55, srv1287805937=18, srv436527112=73, srv1005147454=0, srv1362053006=21, srv33521157=66, srv840072747=93, srv118158310=9, srv1666264188=34, srv1077460561=3, srv145964607=29, srv398347907=72, srv20410501=50, srv1276353572=17, srv1343276437=20, srv648479920=85, srv2056340015=51, srv440524266=74, srv1437829474=28, srv1094271136=4, srv367584452=69, srv66856405=87, srv1688491070=35, srv330853521=65, srv761850452=91, srv1889044132=47, srv822983928=92, srv2023580476=49, srv174304758=37, srv2107175167=56} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-03-19 17:53:27,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-03-19 17:53:27,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-03-19 17:53:27,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-03-19 17:53:27,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-03-19 17:53:27,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-03-19 17:53:27,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-03-19 17:53:27,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-03-19 17:53:27,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-03-19 17:53:27,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-03-19 17:53:27,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-03-19 17:53:27,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-03-19 17:53:27,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-03-19 17:53:27,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-03-19 17:53:27,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-03-19 17:53:27,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-03-19 17:53:27,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-03-19 17:53:27,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-03-19 17:53:27,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-03-19 17:53:27,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-03-19 17:53:27,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-03-19 17:53:27,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-03-19 17:53:27,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-03-19 17:53:27,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-03-19 17:53:27,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-03-19 17:53:27,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-03-19 17:53:27,203 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-03-19 17:53:27,203 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-03-19 17:53:27,203 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-03-19 17:53:27,203 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-03-19 17:53:27,203 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-03-19 17:53:27,203 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-03-19 17:53:27,203 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-03-19 17:53:27,203 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-03-19 17:53:27,203 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-03-19 17:53:27,203 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-03-19 17:53:27,204 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-03-19 17:53:27,204 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-03-19 17:53:27,204 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-03-19 17:53:27,204 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-03-19 17:53:27,204 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-03-19 17:53:27,204 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-03-19 17:53:27,204 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-03-19 17:53:27,204 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-03-19 17:53:27,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-03-19 17:53:27,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-03-19 17:53:27,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-03-19 17:53:27,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-03-19 17:53:27,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-03-19 17:53:27,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-03-19 17:53:27,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-03-19 17:53:27,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-03-19 17:53:27,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-03-19 17:53:27,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-03-19 17:53:27,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-03-19 17:53:27,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-03-19 17:53:27,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-03-19 17:53:27,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-03-19 17:53:27,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-03-19 17:53:27,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-03-19 17:53:27,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-03-19 17:53:27,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-03-19 17:53:27,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-03-19 17:53:27,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-03-19 17:53:27,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-03-19 17:53:27,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-03-19 17:53:27,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-03-19 17:53:27,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-03-19 17:53:27,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-03-19 17:53:27,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-03-19 17:53:27,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-03-19 17:53:27,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-03-19 17:53:27,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-03-19 17:53:27,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-03-19 17:53:27,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-03-19 17:53:27,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-03-19 17:53:27,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-03-19 17:53:27,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-03-19 17:53:27,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-03-19 17:53:27,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-03-19 17:53:27,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-03-19 17:53:27,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-03-19 17:53:27,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-03-19 17:53:27,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-03-19 17:53:27,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-03-19 17:53:27,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-03-19 17:53:27,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-03-19 17:53:27,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-03-19 17:53:27,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-03-19 17:53:27,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-03-19 17:53:27,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-03-19 17:53:27,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-03-19 17:53:27,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-03-19 17:53:27,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-03-19 17:53:27,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-03-19 17:53:27,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-03-19 17:53:27,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-03-19 17:53:27,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-03-19 17:53:27,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-03-19 17:53:27,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-03-19 17:53:27,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-03-19 17:53:27,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-03-19 17:53:27,543 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-19 17:53:27,544 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-03-19 17:53:27,544 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-03-19 17:53:28,241 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 1007 ms to try 5000 different iterations.  Found a solution that moves 4665 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18223119872311774. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04242552507280205, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05407107597426364, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5183333333333333, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04242552507280205, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17758333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.243, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-19 17:53:28,263 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv33521157:81 , srv728590113:81 , srv1197367529:82 , srv1375931210:82 , srv27890012:82 , srv302523676:82 , srv367584452:82 , srv93253155:82 , srv1005147454:83 , srv1170235945:83 , srv1389361404:83 , srv145964607:83 , srv1631656920:83 , srv174304758:83 , srv436527112:83 , srv629561683:83 , srv946185949:83 , srv1137094987:84 , srv125276689:84 , srv1276353572:84 , srv1426546658:84 , srv1666264188:84 , srv1832884204:84 , srv1882059498:84 , srv208176507:84 , srv49933397:84 , srv74525800:84 , srv1052691387:85 , srv1094271136:85 , srv1248755342:85 , srv1416044219:85 , srv217901965:85 , srv263690862:85 , srv387509794:85 , srv394225941:85 , srv467689228:85 , srv55191273:85 , srv648479920:85 , srv999478060:85 , srv118158310:86 , srv1247412683:86 , srv1258690737:86 , srv139528519:86 , srv1688491070:86 , srv1717058854:86 , srv1778477136:86 , srv1787970139:86 , srv1794892631:86 , srv2107175167:86 , srv345445112:86 , srv398347907:86 , srv561620251:86 , srv710056799:86 , srv941176738:86 , srv1099586617:87 , srv1158356341:87 , srv1258177891:87 , srv1437829474:87 , srv159224014:87 , srv1610364111:87 , srv1864209295:87 , srv2056340015:87 , srv2065795426:87 , srv2092354382:87 , srv2097883893:87 , srv235920959:87 , srv442091764:87 , srv453674985:87 , srv58471250:87 , srv654985956:87 , srv66856405:87 , srv932649260:87 , srv1077460561:88 , srv1593508152:88 , srv1860279770:88 , srv1874591601:88 , srv2023580476:88 , srv2112289973:88 , srv2821880:88 , srv330853521:88 , srv356963077:88 , srv445923591:88 , srv621812292:88 , srv822983928:88 , srv840072747:88 , srv1232033582:89 , srv1287805937:89 , srv1362053006:89 , srv1808685302:89 , srv1938692434:89 , srv20410501:89 , srv2133315310:89 , srv861961028:89 , srv1433430671:90 , srv1343276437:92 , srv440524266:92 , srv1061657114:94 , srv1289698917:95 , srv1889044132:97 , srv761850452:467 }
2024-03-19 17:53:28,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-03-19 17:53:28,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv139528519=24, srv58471250=82, srv999478060=99, srv125276689=14, srv1170235945=8, srv1808685302=41, srv1258177891=15, srv345445112=67, srv946185949=98, srv27890012=62, srv1052691387=1, srv1938692434=48, srv2133315310=58, srv356963077=68, srv1099586617=5, srv442091764=75, srv1416044219=25, srv2065795426=52, srv159224014=30, srv1874591601=45, srv932649260=96, srv1197367529=10, srv710056799=88, srv561620251=81, srv1610364111=32, srv1882059498=46, srv1389361404=23, srv1631656920=33, srv467689228=78, srv1860279770=43, srv217901965=59, srv728590113=89, srv2092354382=54, srv1247412683=12, srv1787970139=39, srv208176507=53, srv55191273=80, srv1426546658=26, srv394225941=71, srv1864209295=44, srv49933397=79, srv1289698917=19, srv235920959=60, srv74525800=90, srv2112289973=57, srv1258690737=16, srv1778477136=38, srv861961028=94, srv93253155=95, srv1717058854=36, srv1158356341=7, srv1832884204=42, srv263690862=61, srv1137094987=6, srv629561683=84, srv1061657114=2, srv1794892631=40, srv1248755342=13, srv2821880=63, srv1375931210=22, srv445923591=76, srv453674985=77, srv654985956=86, srv621812292=83, srv941176738=97, srv387509794=70, srv1232033582=11, srv302523676=64, srv1433430671=27, srv1593508152=31, srv2097883893=55, srv1287805937=18, srv436527112=73, srv1005147454=0, srv1362053006=21, srv33521157=66, srv840072747=93, srv118158310=9, srv1666264188=34, srv1077460561=3, srv145964607=29, srv398347907=72, srv20410501=50, srv1276353572=17, srv1343276437=20, srv648479920=85, srv2056340015=51, srv440524266=74, srv1437829474=28, srv1094271136=4, srv367584452=69, srv66856405=87, srv1688491070=35, srv330853521=65, srv761850452=91, srv1889044132=47, srv822983928=92, srv2023580476=49, srv174304758=37, srv2107175167=56} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-03-19 17:53:28,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-03-19 17:53:28,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-03-19 17:53:28,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-03-19 17:53:28,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-03-19 17:53:28,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-03-19 17:53:28,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-03-19 17:53:28,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-03-19 17:53:28,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-03-19 17:53:28,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-03-19 17:53:28,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-03-19 17:53:28,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-03-19 17:53:28,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-03-19 17:53:28,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-03-19 17:53:28,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-03-19 17:53:28,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-03-19 17:53:28,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-03-19 17:53:28,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-03-19 17:53:28,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-03-19 17:53:28,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-03-19 17:53:28,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-03-19 17:53:28,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-03-19 17:53:28,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-03-19 17:53:28,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-03-19 17:53:28,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-03-19 17:53:28,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-03-19 17:53:28,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-03-19 17:53:28,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-03-19 17:53:28,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-03-19 17:53:28,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-03-19 17:53:28,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-03-19 17:53:28,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-03-19 17:53:28,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-03-19 17:53:28,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-03-19 17:53:28,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-03-19 17:53:28,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-03-19 17:53:28,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-03-19 17:53:28,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-03-19 17:53:28,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-03-19 17:53:28,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-03-19 17:53:28,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-03-19 17:53:28,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-03-19 17:53:28,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-03-19 17:53:28,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-03-19 17:53:28,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-03-19 17:53:28,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-03-19 17:53:28,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-03-19 17:53:28,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-03-19 17:53:28,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-03-19 17:53:28,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-03-19 17:53:28,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-03-19 17:53:28,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-03-19 17:53:28,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-03-19 17:53:28,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-03-19 17:53:28,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-03-19 17:53:28,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-03-19 17:53:28,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-03-19 17:53:28,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-03-19 17:53:28,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-03-19 17:53:28,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-03-19 17:53:28,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-03-19 17:53:28,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-03-19 17:53:28,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-03-19 17:53:28,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-03-19 17:53:28,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-03-19 17:53:28,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-03-19 17:53:28,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-03-19 17:53:28,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-03-19 17:53:28,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-03-19 17:53:28,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-03-19 17:53:28,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-03-19 17:53:28,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-03-19 17:53:28,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-03-19 17:53:28,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-03-19 17:53:28,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-03-19 17:53:28,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-03-19 17:53:28,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-03-19 17:53:28,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-03-19 17:53:28,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-03-19 17:53:28,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-03-19 17:53:28,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-03-19 17:53:28,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-03-19 17:53:28,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-03-19 17:53:28,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-03-19 17:53:28,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-03-19 17:53:28,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-03-19 17:53:28,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-03-19 17:53:28,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-03-19 17:53:28,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-03-19 17:53:28,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-03-19 17:53:28,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-03-19 17:53:28,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-03-19 17:53:28,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-03-19 17:53:28,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-03-19 17:53:28,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-03-19 17:53:28,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-03-19 17:53:28,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-03-19 17:53:28,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-03-19 17:53:28,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-03-19 17:53:28,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-03-19 17:53:28,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-03-19 17:53:28,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-03-19 17:53:28,407 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04242552507280205, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05407107597426364, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04242552507280205, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17758333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.243, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-19 17:53:28,408 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-03-19 17:53:28,408 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.1821985336949541, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04242552507280205, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05407107597426364, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04242552507280205, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17758333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.243, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-03-19 17:53:28,676 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 366 ms to try 5000 different iterations.  Found a solution that moves 2672 regions; Going from a computed imbalance of 0.1821985336949541 to a new imbalance of 0.013908451142514058. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023619906594430407); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0337216439469164, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29688888888888887, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023619906594430407); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010583333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0455, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-19 17:53:28,688 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1289698917:75 , srv1889044132:75 , srv1061657114:76 , srv1343276437:78 , srv1433430671:81 , srv440524266:81 , srv1938692434:82 , srv2112289973:82 , srv1158356341:83 , srv1232033582:83 , srv1437829474:83 , srv1860279770:83 , srv1864209295:83 , srv2023580476:83 , srv20410501:83 , srv2097883893:83 , srv235920959:83 , srv445923591:83 , srv840072747:83 , srv861961028:83 , srv1287805937:84 , srv1688491070:84 , srv1808685302:84 , srv1874591601:84 , srv2065795426:84 , srv330853521:84 , srv356963077:84 , srv442091764:84 , srv58471250:84 , srv1077460561:85 , srv1099586617:85 , srv1248755342:85 , srv1258690737:85 , srv1362053006:85 , srv1416044219:85 , srv159224014:85 , srv2821880:85 , srv398347907:85 , srv453674985:85 , srv467689228:85 , srv621812292:85 , srv66856405:85 , srv1247412683:86 , srv125276689:86 , srv1258177891:86 , srv139528519:86 , srv1426546658:86 , srv1610364111:86 , srv1717058854:86 , srv1787970139:86 , srv1794892631:86 , srv1882059498:86 , srv2056340015:86 , srv2133315310:86 , srv345445112:86 , srv55191273:86 , srv648479920:86 , srv654985956:86 , srv822983928:86 , srv932649260:86 , srv999478060:86 , srv1052691387:87 , srv1094271136:87 , srv1170235945:87 , srv118158310:87 , srv1276353572:87 , srv1593508152:87 , srv1631656920:87 , srv1666264188:87 , srv1832884204:87 , srv2092354382:87 , srv387509794:87 , srv49933397:87 , srv561620251:87 , srv941176738:87 , srv1005147454:88 , srv1389361404:88 , srv174304758:88 , srv2107175167:88 , srv394225941:88 , srv710056799:88 , srv946185949:88 , srv1778477136:89 , srv217901965:89 , srv33521157:89 , srv436527112:89 , srv629561683:89 , srv93253155:89 , srv1137094987:90 , srv1197367529:90 , srv208176507:90 , srv263690862:90 , srv27890012:90 , srv302523676:90 , srv367584452:90 , srv74525800:90 , srv145964607:91 , srv728590113:91 , srv1375931210:92 , srv761850452:517 }
2024-03-19 17:53:28,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-03-19 17:53:28,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv139528519=24, srv58471250=82, srv999478060=99, srv125276689=14, srv1170235945=8, srv1808685302=41, srv1258177891=15, srv345445112=67, srv946185949=98, srv27890012=62, srv1052691387=1, srv1938692434=48, srv2133315310=58, srv356963077=68, srv1099586617=5, srv442091764=75, srv1416044219=25, srv2065795426=52, srv159224014=30, srv1874591601=45, srv932649260=96, srv1197367529=10, srv710056799=88, srv561620251=81, srv1610364111=32, srv1882059498=46, srv1389361404=23, srv1631656920=33, srv467689228=78, srv1860279770=43, srv217901965=59, srv728590113=89, srv2092354382=54, srv1247412683=12, srv1787970139=39, srv208176507=53, srv55191273=80, srv1426546658=26, srv394225941=71, srv1864209295=44, srv49933397=79, srv1289698917=19, srv235920959=60, srv74525800=90, srv2112289973=57, srv1258690737=16, srv1778477136=38, srv861961028=94, srv93253155=95, srv1717058854=36, srv1158356341=7, srv1832884204=42, srv263690862=61, srv1137094987=6, srv629561683=84, srv1061657114=2, srv1794892631=40, srv1248755342=13, srv2821880=63, srv1375931210=22, srv445923591=76, srv453674985=77, srv654985956=86, srv621812292=83, srv941176738=97, srv387509794=70, srv1232033582=11, srv302523676=64, srv1433430671=27, srv1593508152=31, srv2097883893=55, srv1287805937=18, srv436527112=73, srv1005147454=0, srv1362053006=21, srv33521157=66, srv840072747=93, srv118158310=9, srv1666264188=34, srv1077460561=3, srv145964607=29, srv398347907=72, srv20410501=50, srv1276353572=17, srv1343276437=20, srv648479920=85, srv2056340015=51, srv440524266=74, srv1437829474=28, srv1094271136=4, srv367584452=69, srv66856405=87, srv1688491070=35, srv330853521=65, srv761850452=91, srv1889044132=47, srv822983928=92, srv2023580476=49, srv174304758=37, srv2107175167=56} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-03-19 17:53:28,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-03-19 17:53:28,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-03-19 17:53:28,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-03-19 17:53:28,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-03-19 17:53:28,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-03-19 17:53:28,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-03-19 17:53:28,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-03-19 17:53:28,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-03-19 17:53:28,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-03-19 17:53:28,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-03-19 17:53:28,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-03-19 17:53:28,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-03-19 17:53:28,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-03-19 17:53:28,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-03-19 17:53:28,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-03-19 17:53:28,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-03-19 17:53:28,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-03-19 17:53:28,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-03-19 17:53:28,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-03-19 17:53:28,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-03-19 17:53:28,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-03-19 17:53:28,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-03-19 17:53:28,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-03-19 17:53:28,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-03-19 17:53:28,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-03-19 17:53:28,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-03-19 17:53:28,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-03-19 17:53:28,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-03-19 17:53:28,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-03-19 17:53:28,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-03-19 17:53:28,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-03-19 17:53:28,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-03-19 17:53:28,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-03-19 17:53:28,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-03-19 17:53:28,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-03-19 17:53:28,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-03-19 17:53:28,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-03-19 17:53:28,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-03-19 17:53:28,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-03-19 17:53:28,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-03-19 17:53:28,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-03-19 17:53:28,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-03-19 17:53:28,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-03-19 17:53:28,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-03-19 17:53:28,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-03-19 17:53:28,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-03-19 17:53:28,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-03-19 17:53:28,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-03-19 17:53:28,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-03-19 17:53:28,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-03-19 17:53:28,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-03-19 17:53:28,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-03-19 17:53:28,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-03-19 17:53:28,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-03-19 17:53:28,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-03-19 17:53:28,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-03-19 17:53:28,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-03-19 17:53:28,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-03-19 17:53:28,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-03-19 17:53:28,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-03-19 17:53:28,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-03-19 17:53:28,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-03-19 17:53:28,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-03-19 17:53:28,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-03-19 17:53:28,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-03-19 17:53:28,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-03-19 17:53:28,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-03-19 17:53:28,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-03-19 17:53:28,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-03-19 17:53:28,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-03-19 17:53:28,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-03-19 17:53:28,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-03-19 17:53:28,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-03-19 17:53:28,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-03-19 17:53:28,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-03-19 17:53:28,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-03-19 17:53:28,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-03-19 17:53:28,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-03-19 17:53:28,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-03-19 17:53:28,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-03-19 17:53:28,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-03-19 17:53:28,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-03-19 17:53:28,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-03-19 17:53:28,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-03-19 17:53:28,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-03-19 17:53:28,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-03-19 17:53:28,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-03-19 17:53:28,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-03-19 17:53:28,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-03-19 17:53:28,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-03-19 17:53:28,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-03-19 17:53:28,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-03-19 17:53:28,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-03-19 17:53:28,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-03-19 17:53:28,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-03-19 17:53:28,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-03-19 17:53:28,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-03-19 17:53:28,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-03-19 17:53:28,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-03-19 17:53:28,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-03-19 17:53:28,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-03-19 17:53:28,846 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023619906594430407); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0337216439469164, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023619906594430407); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010583333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0455, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-19 17:53:28,846 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-03-19 17:53:28,846 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.013889741398622682, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023619906594430407); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0337216439469164, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023619906594430407); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010583333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0455, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-03-19 17:53:29,059 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 313 ms to try 5000 different iterations.  Found a solution that moves 988 regions; Going from a computed imbalance of 0.013889741398622682 to a new imbalance of 9.265897882862756E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004984074901000224); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007309112127323451); MoveCostFunction : (multiplier=7.0, imbalance=0.10977777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.004984074901000224); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.833333333333334E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00375); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-19 17:53:29,061 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1593508152:82 , srv1778477136:83 , srv2107175167:83 , srv263690862:83 , srv1077460561:84 , srv1137094987:84 , srv118158310:84 , srv1287805937:84 , srv1362053006:84 , srv1375931210:84 , srv145964607:84 , srv208176507:84 , srv2092354382:84 , srv2133315310:84 , srv217901965:84 , srv394225941:84 , srv440524266:84 , srv621812292:84 , srv629561683:84 , srv654985956:84 , srv710056799:84 , srv74525800:84 , srv822983928:84 , srv932649260:84 , srv941176738:84 , srv1197367529:85 , srv1232033582:85 , srv1247412683:85 , srv1258177891:85 , srv159224014:85 , srv1610364111:85 , srv1717058854:85 , srv1787970139:85 , srv1808685302:85 , srv1874591601:85 , srv2821880:85 , srv302523676:85 , srv330853521:85 , srv356963077:85 , srv387509794:85 , srv453674985:85 , srv561620251:85 , srv66856405:85 , srv1005147454:86 , srv1052691387:86 , srv1099586617:86 , srv1258690737:86 , srv139528519:86 , srv1433430671:86 , srv1794892631:86 , srv1860279770:86 , srv1889044132:86 , srv1938692434:86 , srv20410501:86 , srv2056340015:86 , srv2065795426:86 , srv27890012:86 , srv345445112:86 , srv367584452:86 , srv398347907:86 , srv436527112:86 , srv442091764:86 , srv445923591:86 , srv49933397:86 , srv648479920:86 , srv861961028:86 , srv946185949:86 , srv999478060:86 , srv1061657114:87 , srv1094271136:87 , srv1158356341:87 , srv1170235945:87 , srv1276353572:87 , srv1289698917:87 , srv1389361404:87 , srv1416044219:87 , srv1666264188:87 , srv174304758:87 , srv1832884204:87 , srv1864209295:87 , srv2023580476:87 , srv2097883893:87 , srv2112289973:87 , srv235920959:87 , srv467689228:87 , srv55191273:87 , srv728590113:87 , srv840072747:87 , srv93253155:87 , srv1248755342:88 , srv125276689:88 , srv1343276437:88 , srv1426546658:88 , srv1437829474:88 , srv1631656920:88 , srv1688491070:88 , srv1882059498:88 , srv33521157:88 , srv58471250:88 , srv761850452:518 }
2024-03-19 17:53:29,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-03-19 17:53:29,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv139528519=24, srv58471250=82, srv999478060=99, srv125276689=14, srv1170235945=8, srv1808685302=41, srv1258177891=15, srv345445112=67, srv946185949=98, srv27890012=62, srv1052691387=1, srv1938692434=48, srv2133315310=58, srv356963077=68, srv1099586617=5, srv442091764=75, srv1416044219=25, srv2065795426=52, srv159224014=30, srv1874591601=45, srv932649260=96, srv1197367529=10, srv710056799=88, srv561620251=81, srv1610364111=32, srv1882059498=46, srv1389361404=23, srv1631656920=33, srv467689228=78, srv1860279770=43, srv217901965=59, srv728590113=89, srv2092354382=54, srv1247412683=12, srv1787970139=39, srv208176507=53, srv55191273=80, srv1426546658=26, srv394225941=71, srv1864209295=44, srv49933397=79, srv1289698917=19, srv235920959=60, srv74525800=90, srv2112289973=57, srv1258690737=16, srv1778477136=38, srv861961028=94, srv93253155=95, srv1717058854=36, srv1158356341=7, srv1832884204=42, srv263690862=61, srv1137094987=6, srv629561683=84, srv1061657114=2, srv1794892631=40, srv1248755342=13, srv2821880=63, srv1375931210=22, srv445923591=76, srv453674985=77, srv654985956=86, srv621812292=83, srv941176738=97, srv387509794=70, srv1232033582=11, srv302523676=64, srv1433430671=27, srv1593508152=31, srv2097883893=55, srv1287805937=18, srv436527112=73, srv1005147454=0, srv1362053006=21, srv33521157=66, srv840072747=93, srv118158310=9, srv1666264188=34, srv1077460561=3, srv145964607=29, srv398347907=72, srv20410501=50, srv1276353572=17, srv1343276437=20, srv648479920=85, srv2056340015=51, srv440524266=74, srv1437829474=28, srv1094271136=4, srv367584452=69, srv66856405=87, srv1688491070=35, srv330853521=65, srv761850452=91, srv1889044132=47, srv822983928=92, srv2023580476=49, srv174304758=37, srv2107175167=56} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-03-19 17:53:29,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-03-19 17:53:29,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-03-19 17:53:29,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-03-19 17:53:29,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-03-19 17:53:29,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-03-19 17:53:29,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-03-19 17:53:29,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-03-19 17:53:29,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-03-19 17:53:29,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-03-19 17:53:29,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-03-19 17:53:29,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-03-19 17:53:29,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-03-19 17:53:29,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-03-19 17:53:29,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-03-19 17:53:29,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-03-19 17:53:29,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-03-19 17:53:29,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-03-19 17:53:29,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-03-19 17:53:29,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-03-19 17:53:29,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-03-19 17:53:29,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-03-19 17:53:29,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-03-19 17:53:29,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-03-19 17:53:29,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-03-19 17:53:29,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-03-19 17:53:29,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-03-19 17:53:29,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-03-19 17:53:29,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-03-19 17:53:29,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-03-19 17:53:29,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-03-19 17:53:29,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-03-19 17:53:29,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-03-19 17:53:29,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-03-19 17:53:29,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-03-19 17:53:29,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-03-19 17:53:29,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-03-19 17:53:29,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-03-19 17:53:29,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-03-19 17:53:29,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-03-19 17:53:29,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-03-19 17:53:29,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-03-19 17:53:29,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-03-19 17:53:29,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-03-19 17:53:29,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-03-19 17:53:29,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-03-19 17:53:29,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-03-19 17:53:29,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-03-19 17:53:29,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-03-19 17:53:29,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-03-19 17:53:29,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-03-19 17:53:29,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-03-19 17:53:29,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-03-19 17:53:29,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-03-19 17:53:29,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-03-19 17:53:29,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-03-19 17:53:29,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-03-19 17:53:29,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-03-19 17:53:29,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-03-19 17:53:29,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-03-19 17:53:29,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-03-19 17:53:29,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-03-19 17:53:29,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-03-19 17:53:29,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-03-19 17:53:29,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-03-19 17:53:29,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-03-19 17:53:29,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-03-19 17:53:29,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-03-19 17:53:29,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-03-19 17:53:29,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-03-19 17:53:29,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-03-19 17:53:29,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-03-19 17:53:29,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-03-19 17:53:29,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-03-19 17:53:29,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-03-19 17:53:29,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-03-19 17:53:29,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-03-19 17:53:29,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-03-19 17:53:29,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-03-19 17:53:29,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-03-19 17:53:29,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-03-19 17:53:29,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-03-19 17:53:29,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-03-19 17:53:29,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-03-19 17:53:29,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-03-19 17:53:29,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-03-19 17:53:29,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-03-19 17:53:29,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-03-19 17:53:29,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-03-19 17:53:29,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-03-19 17:53:29,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-03-19 17:53:29,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-03-19 17:53:29,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-03-19 17:53:29,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-03-19 17:53:29,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-03-19 17:53:29,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-03-19 17:53:29,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-03-19 17:53:29,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-03-19 17:53:29,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-03-19 17:53:29,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-03-19 17:53:29,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-03-19 17:53:29,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-03-19 17:53:29,183 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004984074901000224); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007309112127323451); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.004984074901000224); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.833333333333334E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00375); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-19 17:53:29,183 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-03-19 17:53:29,184 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=9.196716644222493E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004984074901000224); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007309112127323451); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.004984074901000224); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.833333333333334E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00375); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-03-19 17:53:29,498 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 409 ms to try 5000 different iterations.  Found a solution that moves 236 regions; Going from a computed imbalance of 9.196716644222493E-4 to a new imbalance of 1.91469898115635E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.026222222222222223, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-19 17:53:29,499 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1094271136:83 , srv2056340015:83 , srv2133315310:83 , srv345445112:83 , srv58471250:83 , srv728590113:83 , srv1061657114:84 , srv1099586617:84 , srv1158356341:84 , srv1197367529:84 , srv1248755342:84 , srv125276689:84 , srv1258177891:84 , srv1276353572:84 , srv1343276437:84 , srv1362053006:84 , srv1375931210:84 , srv1389361404:84 , srv139528519:84 , srv1426546658:84 , srv1437829474:84 , srv145964607:84 , srv1610364111:84 , srv1631656920:84 , srv1666264188:84 , srv1688491070:84 , srv174304758:84 , srv1778477136:84 , srv1787970139:84 , srv1794892631:84 , srv1808685302:84 , srv1832884204:84 , srv1882059498:84 , srv1889044132:84 , srv2023580476:84 , srv208176507:84 , srv217901965:84 , srv263690862:84 , srv27890012:84 , srv2821880:84 , srv33521157:84 , srv367584452:84 , srv398347907:84 , srv445923591:84 , srv561620251:84 , srv710056799:84 , srv74525800:84 , srv822983928:84 , srv840072747:84 , srv861961028:84 , srv93253155:84 , srv1005147454:85 , srv1052691387:85 , srv1077460561:85 , srv1137094987:85 , srv1170235945:85 , srv118158310:85 , srv1232033582:85 , srv1247412683:85 , srv1258690737:85 , srv1287805937:85 , srv1289698917:85 , srv1416044219:85 , srv1433430671:85 , srv159224014:85 , srv1593508152:85 , srv1717058854:85 , srv1860279770:85 , srv1864209295:85 , srv1874591601:85 , srv1938692434:85 , srv20410501:85 , srv2065795426:85 , srv2092354382:85 , srv2097883893:85 , srv2107175167:85 , srv235920959:85 , srv302523676:85 , srv330853521:85 , srv356963077:85 , srv387509794:85 , srv394225941:85 , srv436527112:85 , srv440524266:85 , srv442091764:85 , srv453674985:85 , srv467689228:85 , srv49933397:85 , srv55191273:85 , srv621812292:85 , srv648479920:85 , srv654985956:85 , srv66856405:85 , srv932649260:85 , srv941176738:85 , srv946185949:85 , srv999478060:85 , srv2112289973:86 , srv629561683:86 , srv761850452:640 }
2024-03-19 17:53:29,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-03-19 17:53:29,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv139528519=24, srv58471250=82, srv999478060=99, srv125276689=14, srv1170235945=8, srv1808685302=41, srv1258177891=15, srv345445112=67, srv946185949=98, srv27890012=62, srv1052691387=1, srv1938692434=48, srv2133315310=58, srv356963077=68, srv1099586617=5, srv442091764=75, srv1416044219=25, srv2065795426=52, srv159224014=30, srv1874591601=45, srv932649260=96, srv1197367529=10, srv710056799=88, srv561620251=81, srv1610364111=32, srv1882059498=46, srv1389361404=23, srv1631656920=33, srv467689228=78, srv1860279770=43, srv217901965=59, srv728590113=89, srv2092354382=54, srv1247412683=12, srv1787970139=39, srv208176507=53, srv55191273=80, srv1426546658=26, srv394225941=71, srv1864209295=44, srv49933397=79, srv1289698917=19, srv235920959=60, srv74525800=90, srv2112289973=57, srv1258690737=16, srv1778477136=38, srv861961028=94, srv93253155=95, srv1717058854=36, srv1158356341=7, srv1832884204=42, srv263690862=61, srv1137094987=6, srv629561683=84, srv1061657114=2, srv1794892631=40, srv1248755342=13, srv2821880=63, srv1375931210=22, srv445923591=76, srv453674985=77, srv654985956=86, srv621812292=83, srv941176738=97, srv387509794=70, srv1232033582=11, srv302523676=64, srv1433430671=27, srv1593508152=31, srv2097883893=55, srv1287805937=18, srv436527112=73, srv1005147454=0, srv1362053006=21, srv33521157=66, srv840072747=93, srv118158310=9, srv1666264188=34, srv1077460561=3, srv145964607=29, srv398347907=72, srv20410501=50, srv1276353572=17, srv1343276437=20, srv648479920=85, srv2056340015=51, srv440524266=74, srv1437829474=28, srv1094271136=4, srv367584452=69, srv66856405=87, srv1688491070=35, srv330853521=65, srv761850452=91, srv1889044132=47, srv822983928=92, srv2023580476=49, srv174304758=37, srv2107175167=56} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-03-19 17:53:29,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-03-19 17:53:29,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-03-19 17:53:29,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-03-19 17:53:29,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-03-19 17:53:29,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-03-19 17:53:29,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-03-19 17:53:29,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-03-19 17:53:29,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-03-19 17:53:29,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-03-19 17:53:29,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-03-19 17:53:29,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-03-19 17:53:29,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-03-19 17:53:29,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-03-19 17:53:29,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-03-19 17:53:29,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-03-19 17:53:29,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-03-19 17:53:29,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-03-19 17:53:29,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-03-19 17:53:29,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-03-19 17:53:29,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-03-19 17:53:29,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-03-19 17:53:29,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-03-19 17:53:29,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-03-19 17:53:29,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-03-19 17:53:29,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-03-19 17:53:29,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-03-19 17:53:29,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-03-19 17:53:29,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-03-19 17:53:29,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-03-19 17:53:29,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-03-19 17:53:29,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-03-19 17:53:29,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-03-19 17:53:29,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-03-19 17:53:29,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-03-19 17:53:29,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-03-19 17:53:29,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-03-19 17:53:29,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-03-19 17:53:29,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-03-19 17:53:29,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-03-19 17:53:29,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-03-19 17:53:29,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-03-19 17:53:29,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-03-19 17:53:29,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-03-19 17:53:29,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-03-19 17:53:29,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-03-19 17:53:29,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-03-19 17:53:29,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-03-19 17:53:29,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-03-19 17:53:29,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-03-19 17:53:29,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-03-19 17:53:29,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-03-19 17:53:29,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-03-19 17:53:29,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-03-19 17:53:29,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-03-19 17:53:29,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-03-19 17:53:29,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-03-19 17:53:29,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-03-19 17:53:29,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-03-19 17:53:29,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-03-19 17:53:29,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-03-19 17:53:29,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-03-19 17:53:29,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-03-19 17:53:29,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-03-19 17:53:29,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-03-19 17:53:29,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-03-19 17:53:29,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-03-19 17:53:29,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-03-19 17:53:29,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-03-19 17:53:29,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-03-19 17:53:29,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-03-19 17:53:29,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-03-19 17:53:29,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-03-19 17:53:29,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-03-19 17:53:29,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-03-19 17:53:29,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-03-19 17:53:29,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-03-19 17:53:29,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-03-19 17:53:29,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-03-19 17:53:29,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-03-19 17:53:29,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-03-19 17:53:29,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-03-19 17:53:29,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-03-19 17:53:29,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-03-19 17:53:29,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-03-19 17:53:29,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-03-19 17:53:29,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-03-19 17:53:29,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-03-19 17:53:29,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-03-19 17:53:29,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-03-19 17:53:29,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-03-19 17:53:29,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-03-19 17:53:29,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-03-19 17:53:29,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-03-19 17:53:29,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-03-19 17:53:29,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-03-19 17:53:29,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-03-19 17:53:29,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-03-19 17:53:29,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-03-19 17:53:29,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-03-19 17:53:29,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-03-19 17:53:29,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-03-19 17:53:29,624 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=1.7494482491816342E-5 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-19 17:53:29,624 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1094271136:83 , srv2056340015:83 , srv2133315310:83 , srv345445112:83 , srv58471250:83 , srv728590113:83 , srv1061657114:84 , srv1099586617:84 , srv1158356341:84 , srv1197367529:84 , srv1248755342:84 , srv125276689:84 , srv1258177891:84 , srv1276353572:84 , srv1343276437:84 , srv1362053006:84 , srv1375931210:84 , srv1389361404:84 , srv139528519:84 , srv1426546658:84 , srv1437829474:84 , srv145964607:84 , srv1610364111:84 , srv1631656920:84 , srv1666264188:84 , srv1688491070:84 , srv174304758:84 , srv1778477136:84 , srv1787970139:84 , srv1794892631:84 , srv1808685302:84 , srv1832884204:84 , srv1882059498:84 , srv1889044132:84 , srv2023580476:84 , srv208176507:84 , srv217901965:84 , srv263690862:84 , srv27890012:84 , srv2821880:84 , srv33521157:84 , srv367584452:84 , srv398347907:84 , srv445923591:84 , srv561620251:84 , srv710056799:84 , srv74525800:84 , srv822983928:84 , srv840072747:84 , srv861961028:84 , srv93253155:84 , srv1005147454:85 , srv1052691387:85 , srv1077460561:85 , srv1137094987:85 , srv1170235945:85 , srv118158310:85 , srv1232033582:85 , srv1247412683:85 , srv1258690737:85 , srv1287805937:85 , srv1289698917:85 , srv1416044219:85 , srv1433430671:85 , srv159224014:85 , srv1593508152:85 , srv1717058854:85 , srv1860279770:85 , srv1864209295:85 , srv1874591601:85 , srv1938692434:85 , srv20410501:85 , srv2065795426:85 , srv2092354382:85 , srv2097883893:85 , srv2107175167:85 , srv235920959:85 , srv302523676:85 , srv330853521:85 , srv356963077:85 , srv387509794:85 , srv394225941:85 , srv436527112:85 , srv440524266:85 , srv442091764:85 , srv453674985:85 , srv467689228:85 , srv49933397:85 , srv55191273:85 , srv621812292:85 , srv648479920:85 , srv654985956:85 , srv66856405:85 , srv932649260:85 , srv941176738:85 , srv946185949:85 , srv999478060:85 , srv2112289973:86 , srv629561683:86 , srv761850452:640 }
2024-03-19 17:53:29,656 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=239 (was 242), ProcessCount=170 (was 170), AvailableMemoryMB=4429 (was 4918)
2024-03-19 17:53:29,665 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=239, ProcessCount=170, AvailableMemoryMB=4429
2024-03-19 17:53:29,666 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-03-19 17:53:29,666 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2024-03-19 17:53:29,675 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1075747661:84 , srv109788036:84 , srv1207972265:84 , srv1278933514:84 , srv1339313233:84 , srv1355381061:84 , srv1476263702:84 , srv1551363923:84 , srv159099429:84 , srv1592954685:84 , srv1625689688:84 , srv1627686204:84 , srv1642996578:84 , srv1826076992:84 , srv2005798189:84 , srv2016411214:84 , srv2071598778:84 , srv2086334238:84 , srv212504144:84 , srv371604986:84 , srv466665173:84 , srv475572083:84 , srv594863050:84 , srv67787651:84 , srv783681135:84 , srv818443837:84 , srv828897404:84 , srv861601371:84 , srv869438266:84 , srv828644291:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2024-03-19 17:53:29,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-03-19 17:53:29,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv109788036=1, srv869438266=29, srv1627686204=11, srv371604986=19, srv1476263702=6, srv159099429=8, srv1075747661=0, srv1642996578=12, srv212504144=18, srv818443837=25, srv828644291=26, srv828897404=27, srv1207972265=2, srv594863050=22, srv1339313233=4, srv2005798189=14, srv1551363923=7, srv1625689688=10, srv2016411214=15, srv475572083=21, srv1278933514=3, srv67787651=23, srv1592954685=9, srv1355381061=5, srv1826076992=13, srv466665173=20, srv2086334238=17, srv783681135=24, srv861601371=28, srv2071598778=16} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-03-19 17:53:29,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-03-19 17:53:29,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-03-19 17:53:29,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-03-19 17:53:29,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-03-19 17:53:29,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-03-19 17:53:29,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-03-19 17:53:29,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-03-19 17:53:29,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-03-19 17:53:29,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-03-19 17:53:29,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-03-19 17:53:29,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-03-19 17:53:29,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-03-19 17:53:29,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-03-19 17:53:29,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-03-19 17:53:29,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-03-19 17:53:29,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-03-19 17:53:29,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-03-19 17:53:29,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-03-19 17:53:29,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-03-19 17:53:29,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-03-19 17:53:29,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-03-19 17:53:29,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-03-19 17:53:29,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-03-19 17:53:29,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-03-19 17:53:29,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-03-19 17:53:29,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-03-19 17:53:29,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-03-19 17:53:29,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-03-19 17:53:29,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-03-19 17:53:29,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-03-19 17:53:29,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-03-19 17:53:29,702 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.11728927217497, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-19 17:53:29,702 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912562617931056, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.11728927217497, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2024-03-19 17:55:29,690 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6310540 different iterations.  Found a solution that moves 1855 regions; Going from a computed imbalance of 0.9912562617931056 to a new imbalance of 4.329662539733032E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.687037037037037, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-19 17:55:29,698 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1075747661:90 , srv109788036:90 , srv1207972265:90 , srv1278933514:90 , srv1339313233:90 , srv1355381061:90 , srv1476263702:90 , srv1551363923:90 , srv159099429:90 , srv1592954685:90 , srv1625689688:90 , srv1627686204:90 , srv1642996578:90 , srv1826076992:90 , srv2005798189:90 , srv2016411214:90 , srv2071598778:90 , srv2086334238:90 , srv212504144:90 , srv371604986:90 , srv466665173:90 , srv475572083:90 , srv594863050:90 , srv67787651:90 , srv783681135:90 , srv818443837:90 , srv828644291:90 , srv828897404:90 , srv861601371:90 , srv869438266:90 }
2024-03-19 17:55:29,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-03-19 17:55:29,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv109788036=1, srv869438266=29, srv1627686204=11, srv371604986=19, srv1476263702=6, srv159099429=8, srv1075747661=0, srv1642996578=12, srv212504144=18, srv818443837=25, srv828644291=26, srv828897404=27, srv1207972265=2, srv594863050=22, srv1339313233=4, srv2005798189=14, srv1551363923=7, srv1625689688=10, srv2016411214=15, srv475572083=21, srv1278933514=3, srv67787651=23, srv1592954685=9, srv1355381061=5, srv1826076992=13, srv466665173=20, srv2086334238=17, srv783681135=24, srv861601371=28, srv2071598778=16} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-03-19 17:55:29,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-03-19 17:55:29,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-03-19 17:55:29,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-03-19 17:55:29,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-03-19 17:55:29,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-03-19 17:55:29,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-03-19 17:55:29,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-03-19 17:55:29,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-03-19 17:55:29,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-03-19 17:55:29,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-03-19 17:55:29,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-03-19 17:55:29,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-03-19 17:55:29,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-03-19 17:55:29,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-03-19 17:55:29,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-03-19 17:55:29,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-03-19 17:55:29,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-03-19 17:55:29,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-03-19 17:55:29,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-03-19 17:55:29,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-03-19 17:55:29,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-03-19 17:55:29,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-03-19 17:55:29,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-03-19 17:55:29,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-03-19 17:55:29,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-03-19 17:55:29,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-03-19 17:55:29,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-03-19 17:55:29,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-03-19 17:55:29,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-03-19 17:55:29,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-03-19 17:55:29,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-03-19 17:55:29,722 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-19 17:55:29,722 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1075747661:90 , srv109788036:90 , srv1207972265:90 , srv1278933514:90 , srv1339313233:90 , srv1355381061:90 , srv1476263702:90 , srv1551363923:90 , srv159099429:90 , srv1592954685:90 , srv1625689688:90 , srv1627686204:90 , srv1642996578:90 , srv1826076992:90 , srv2005798189:90 , srv2016411214:90 , srv2071598778:90 , srv2086334238:90 , srv212504144:90 , srv371604986:90 , srv466665173:90 , srv475572083:90 , srv594863050:90 , srv67787651:90 , srv783681135:90 , srv818443837:90 , srv828644291:90 , srv828897404:90 , srv861601371:90 , srv869438266:90 }
2024-03-19 17:55:29,740 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=169 (was 239), ProcessCount=168 (was 170), AvailableMemoryMB=3669 (was 4429)