2024-04-16 18:53:17,329 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2024-04-16 18:53:17,657 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2024-04-16 18:53:17,776 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2024-04-16 18:53:17,850 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-04-16 18:53:17,858 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-04-16 18:53:17,873 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=301, ProcessCount=171, AvailableMemoryMB=3612
2024-04-16 18:53:17,875 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-04-16 18:53:17,875 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-04-16 18:53:18,020 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1027327712:84 , srv1048278082:84 , srv1054534498:84 , srv1061061554:84 , srv1069081193:84 , srv1133036643:84 , srv1150198145:84 , srv1153974469:84 , srv1155297557:84 , srv1176187052:84 , srv117744471:84 , srv1178946379:84 , srv1184488847:84 , srv1315650855:84 , srv1320295325:84 , srv1350471620:84 , srv1351760893:84 , srv1354131115:84 , srv1356082998:84 , srv1356580698:84 , srv1357402484:84 , srv136600321:84 , srv1386559339:84 , srv1411482322:84 , srv1458183019:84 , srv1464885195:84 , srv1470218766:84 , srv14753448:84 , srv1476496960:84 , srv1476741026:84 , srv1515469269:84 , srv1529179174:84 , srv155236565:84 , srv1554320046:84 , srv1620169520:84 , srv1641228136:84 , srv1673129816:84 , srv1694997687:84 , srv1754093516:84 , srv1783409647:84 , srv1832435533:84 , srv1844000688:84 , srv1867601134:84 , srv1868974196:84 , srv1889726818:84 , srv1933939471:84 , srv2011405470:84 , srv2011428779:84 , srv2025926944:84 , srv203100145:84 , srv2045790296:84 , srv2111399409:84 , srv2121849009:84 , srv2125067462:84 , srv2144809507:84 , srv236306674:84 , srv284467358:84 , srv286683541:84 , srv325969782:84 , srv352533686:84 , srv354371241:84 , srv393958892:84 , srv43744164:84 , srv4577197:84 , srv462560534:84 , srv46442734:84 , srv469268406:84 , srv474407252:84 , srv517449483:84 , srv528115455:84 , srv558333186:84 , srv641345252:84 , srv643258045:84 , srv649151037:84 , srv652700064:84 , srv667556152:84 , srv728149680:84 , srv730825193:84 , srv744327676:84 , srv763781615:84 , srv776571905:84 , srv776706869:84 , srv783052667:84 , srv788497204:84 , srv790691169:84 , srv802406323:84 , srv81818216:84 , srv826875103:84 , srv87162669:84 , srv88516990:84 , srv904341690:84 , srv935164120:84 , srv944017232:84 , srv95113745:84 , srv963932152:84 , srv976102012:84 , srv977644633:84 , srv983255422:84 , srv999239522:84 , srv1026463121:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2024-04-16 18:53:18,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-16 18:53:18,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv87162669=89, srv667556152=76, srv999239522=99, srv1069081193=5, srv1464885195=26, srv652700064=75, srv1054534498=3, srv641345252=72, srv763781615=80, srv963932152=95, srv1184488847=13, srv155236565=33, srv1027327712=1, srv2111399409=52, srv46442734=66, srv95113745=94, srv1357402484=21, srv1386559339=23, srv558333186=71, srv826875103=88, srv1470218766=27, srv352533686=60, srv976102012=96, srv1150198145=7, srv1694997687=38, srv776571905=81, srv728149680=77, srv1048278082=2, srv649151037=74, srv325969782=59, srv1783409647=40, srv1061061554=4, srv1411482322=24, srv783052667=83, srv2011428779=48, srv474407252=68, srv469268406=67, srv1350471620=16, srv944017232=93, srv1133036643=6, srv517449483=69, srv643258045=73, srv88516990=90, srv462560534=65, srv393958892=62, srv977644633=97, srv788497204=84, srv983255422=98, srv117744471=11, srv1176187052=10, srv354371241=61, srv1315650855=14, srv1933939471=46, srv136600321=22, srv776706869=82, srv1832435533=41, srv1026463121=0, srv284467358=57, srv2125067462=54, srv1620169520=35, srv1641228136=36, srv1868974196=44, srv904341690=91, srv1515469269=31, srv2144809507=55, srv1458183019=25, srv236306674=56, srv2121849009=53, srv286683541=58, srv2045790296=51, srv1356082998=19, srv1153974469=8, srv1889726818=45, srv2025926944=49, srv1554320046=34, srv1673129816=37, srv730825193=78, srv935164120=92, srv1351760893=17, srv1867601134=43, srv1356580698=20, srv1155297557=9, srv4577197=64, srv81818216=87, srv1529179174=32, srv1354131115=18, srv1754093516=39, srv43744164=63, srv744327676=79, srv1844000688=42, srv528115455=70, srv14753448=28, srv1476741026=30, srv1178946379=12, srv203100145=50, srv1320295325=15, srv2011405470=47, srv1476496960=29, srv802406323=86, srv790691169=85} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-16 18:53:18,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-16 18:53:18,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-16 18:53:18,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-16 18:53:18,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-16 18:53:18,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-16 18:53:18,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-16 18:53:18,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-16 18:53:18,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-16 18:53:18,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-16 18:53:18,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-16 18:53:18,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-16 18:53:18,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-16 18:53:18,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-16 18:53:18,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-16 18:53:18,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-16 18:53:18,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-16 18:53:18,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-16 18:53:18,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-16 18:53:18,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-16 18:53:18,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-16 18:53:18,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-16 18:53:18,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-16 18:53:18,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-16 18:53:18,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-16 18:53:18,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-16 18:53:18,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-16 18:53:18,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-16 18:53:18,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-16 18:53:18,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-16 18:53:18,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-16 18:53:18,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-16 18:53:18,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-16 18:53:18,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-16 18:53:18,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-16 18:53:18,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-16 18:53:18,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-16 18:53:18,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-16 18:53:18,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-16 18:53:18,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-16 18:53:18,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-16 18:53:18,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-16 18:53:18,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-16 18:53:18,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-16 18:53:18,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-16 18:53:18,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-16 18:53:18,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-16 18:53:18,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-16 18:53:18,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-16 18:53:18,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-16 18:53:18,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-16 18:53:18,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-16 18:53:18,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-16 18:53:18,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-16 18:53:18,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-16 18:53:18,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-16 18:53:18,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-16 18:53:18,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-16 18:53:18,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-16 18:53:18,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-16 18:53:18,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-16 18:53:18,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-16 18:53:18,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-16 18:53:18,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-16 18:53:18,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-16 18:53:18,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-16 18:53:18,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-16 18:53:18,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-16 18:53:18,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-16 18:53:18,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-16 18:53:18,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-16 18:53:18,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-16 18:53:18,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-16 18:53:18,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-16 18:53:18,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-16 18:53:18,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-16 18:53:18,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-16 18:53:18,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-16 18:53:18,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-16 18:53:18,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-16 18:53:18,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-16 18:53:18,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-16 18:53:18,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-16 18:53:18,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-16 18:53:18,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-16 18:53:18,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-16 18:53:18,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-16 18:53:18,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-16 18:53:18,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-16 18:53:18,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-16 18:53:18,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-16 18:53:18,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-16 18:53:18,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-16 18:53:18,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-16 18:53:18,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-16 18:53:18,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-16 18:53:18,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-16 18:53:18,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-16 18:53:18,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-16 18:53:18,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-16 18:53:18,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-16 18:53:18,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-16 18:53:18,347 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-16 18:53:18,348 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-04-16 18:53:18,348 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-04-16 18:53:18,768 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 571 ms to try 5000 different iterations.  Found a solution that moves 4697 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17877711202183863. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04308527810835765, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05597618541248888, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5218888888888888, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04308527810835765, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.174, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24033333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-16 18:53:18,813 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv462560534:81 , srv1354131115:82 , srv1783409647:82 , srv977644633:82 , srv1027327712:83 , srv1069081193:83 , srv1176187052:83 , srv1184488847:83 , srv1356580698:83 , srv14753448:83 , srv1889726818:83 , srv2111399409:83 , srv2125067462:83 , srv643258045:83 , srv652700064:83 , srv790691169:83 , srv802406323:83 , srv1133036643:84 , srv1554320046:84 , srv1641228136:84 , srv286683541:84 , srv474407252:84 , srv728149680:84 , srv744327676:84 , srv783052667:84 , srv81818216:84 , srv983255422:84 , srv999239522:84 , srv1315650855:85 , srv1350471620:85 , srv1356082998:85 , srv136600321:85 , srv1620169520:85 , srv203100145:85 , srv2121849009:85 , srv352533686:85 , srv43744164:85 , srv46442734:85 , srv517449483:85 , srv730825193:85 , srv904341690:85 , srv944017232:85 , srv95113745:85 , srv1150198145:86 , srv1153974469:86 , srv1155297557:86 , srv1178946379:86 , srv1386559339:86 , srv1464885195:86 , srv1476741026:86 , srv1529179174:86 , srv155236565:86 , srv1673129816:86 , srv1694997687:86 , srv1933939471:86 , srv2011428779:86 , srv354371241:86 , srv4577197:86 , srv528115455:86 , srv776706869:86 , srv87162669:86 , srv1320295325:87 , srv1351760893:87 , srv1357402484:87 , srv1476496960:87 , srv1515469269:87 , srv1867601134:87 , srv2025926944:87 , srv2144809507:87 , srv325969782:87 , srv558333186:87 , srv667556152:87 , srv776571905:87 , srv1048278082:88 , srv1411482322:88 , srv1832435533:88 , srv2011405470:88 , srv236306674:88 , srv469268406:88 , srv935164120:88 , srv963932152:88 , srv976102012:88 , srv1061061554:89 , srv117744471:89 , srv1458183019:89 , srv1844000688:89 , srv2045790296:89 , srv284467358:89 , srv649151037:89 , srv826875103:89 , srv1470218766:90 , srv1754093516:90 , srv88516990:90 , srv1054534498:91 , srv393958892:92 , srv641345252:92 , srv763781615:93 , srv1868974196:94 , srv788497204:94 , srv1026463121:473 }
2024-04-16 18:53:18,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-16 18:53:18,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv87162669=89, srv667556152=76, srv999239522=99, srv1069081193=5, srv1464885195=26, srv652700064=75, srv1054534498=3, srv641345252=72, srv763781615=80, srv963932152=95, srv1184488847=13, srv155236565=33, srv1027327712=1, srv2111399409=52, srv46442734=66, srv95113745=94, srv1357402484=21, srv1386559339=23, srv558333186=71, srv826875103=88, srv1470218766=27, srv352533686=60, srv976102012=96, srv1150198145=7, srv1694997687=38, srv776571905=81, srv728149680=77, srv1048278082=2, srv649151037=74, srv325969782=59, srv1783409647=40, srv1061061554=4, srv1411482322=24, srv783052667=83, srv2011428779=48, srv474407252=68, srv469268406=67, srv1350471620=16, srv944017232=93, srv1133036643=6, srv517449483=69, srv643258045=73, srv88516990=90, srv462560534=65, srv393958892=62, srv977644633=97, srv788497204=84, srv983255422=98, srv117744471=11, srv1176187052=10, srv354371241=61, srv1315650855=14, srv1933939471=46, srv136600321=22, srv776706869=82, srv1832435533=41, srv1026463121=0, srv284467358=57, srv2125067462=54, srv1620169520=35, srv1641228136=36, srv1868974196=44, srv904341690=91, srv1515469269=31, srv2144809507=55, srv1458183019=25, srv236306674=56, srv2121849009=53, srv286683541=58, srv2045790296=51, srv1356082998=19, srv1153974469=8, srv1889726818=45, srv2025926944=49, srv1554320046=34, srv1673129816=37, srv730825193=78, srv935164120=92, srv1351760893=17, srv1867601134=43, srv1356580698=20, srv1155297557=9, srv4577197=64, srv81818216=87, srv1529179174=32, srv1354131115=18, srv1754093516=39, srv43744164=63, srv744327676=79, srv1844000688=42, srv528115455=70, srv14753448=28, srv1476741026=30, srv1178946379=12, srv203100145=50, srv1320295325=15, srv2011405470=47, srv1476496960=29, srv802406323=86, srv790691169=85} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-16 18:53:18,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-16 18:53:18,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-16 18:53:18,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-16 18:53:18,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-16 18:53:18,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-16 18:53:18,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-16 18:53:18,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-16 18:53:18,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-16 18:53:18,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-16 18:53:18,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-16 18:53:18,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-16 18:53:18,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-16 18:53:18,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-16 18:53:18,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-16 18:53:18,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-16 18:53:18,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-16 18:53:18,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-16 18:53:18,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-16 18:53:18,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-16 18:53:18,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-16 18:53:18,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-16 18:53:18,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-16 18:53:18,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-16 18:53:18,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-16 18:53:18,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-16 18:53:18,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-16 18:53:18,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-16 18:53:18,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-16 18:53:18,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-16 18:53:18,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-16 18:53:18,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-16 18:53:18,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-16 18:53:18,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-16 18:53:18,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-16 18:53:18,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-16 18:53:18,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-16 18:53:18,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-16 18:53:18,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-16 18:53:18,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-16 18:53:18,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-16 18:53:18,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-16 18:53:18,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-16 18:53:18,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-16 18:53:18,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-16 18:53:18,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-16 18:53:18,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-16 18:53:18,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-16 18:53:18,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-16 18:53:18,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-16 18:53:18,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-16 18:53:18,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-16 18:53:18,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-16 18:53:18,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-16 18:53:18,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-16 18:53:18,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-16 18:53:18,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-16 18:53:18,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-16 18:53:18,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-16 18:53:18,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-16 18:53:18,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-16 18:53:18,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-16 18:53:18,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-16 18:53:18,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-16 18:53:18,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-16 18:53:18,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-16 18:53:18,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-16 18:53:18,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-16 18:53:18,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-16 18:53:18,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-16 18:53:18,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-16 18:53:18,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-16 18:53:18,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-16 18:53:18,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-16 18:53:18,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-16 18:53:18,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-16 18:53:18,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-16 18:53:18,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-16 18:53:18,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-16 18:53:18,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-16 18:53:18,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-16 18:53:18,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-16 18:53:18,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-16 18:53:18,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-16 18:53:18,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-16 18:53:18,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-16 18:53:18,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-16 18:53:18,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-16 18:53:18,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-16 18:53:18,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-16 18:53:18,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-16 18:53:18,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-16 18:53:18,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-16 18:53:18,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-16 18:53:18,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-16 18:53:18,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-16 18:53:18,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-16 18:53:18,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-16 18:53:18,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-16 18:53:18,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-16 18:53:18,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-16 18:53:18,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-16 18:53:19,028 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04308527810835765, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05597618541248888, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04308527810835765, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.174, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24033333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-16 18:53:19,028 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-04-16 18:53:19,029 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17874422292488587, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04308527810835765, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05597618541248888, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04308527810835765, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.174, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24033333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-04-16 18:53:19,296 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 416 ms to try 5000 different iterations.  Found a solution that moves 2655 regions; Going from a computed imbalance of 0.17874422292488587 to a new imbalance of 0.014243377092742199. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02329294778759208); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.030169740528327, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.295, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02329294778759208); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04608333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-16 18:53:19,306 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1868974196:77 , srv788497204:77 , srv763781615:79 , srv393958892:80 , srv641345252:81 , srv826875103:81 , srv1411482322:82 , srv1470218766:82 , srv88516990:82 , srv117744471:83 , srv1357402484:83 , srv1476496960:83 , srv1754093516:83 , srv1844000688:83 , srv2025926944:83 , srv2045790296:83 , srv469268406:83 , srv776706869:83 , srv1048278082:84 , srv1054534498:84 , srv1155297557:84 , srv1320295325:84 , srv1351760893:84 , srv1458183019:84 , srv203100145:84 , srv667556152:84 , srv1061061554:85 , srv1356082998:85 , srv136600321:85 , srv1867601134:85 , srv1933939471:85 , srv236306674:85 , srv286683541:85 , srv325969782:85 , srv43744164:85 , srv46442734:85 , srv776571905:85 , srv95113745:85 , srv963932152:85 , srv976102012:85 , srv1133036643:86 , srv1150198145:86 , srv1178946379:86 , srv1350471620:86 , srv1476741026:86 , srv1529179174:86 , srv155236565:86 , srv1673129816:86 , srv1832435533:86 , srv2011405470:86 , srv2011428779:86 , srv2121849009:86 , srv354371241:86 , srv4577197:86 , srv474407252:86 , srv528115455:86 , srv558333186:86 , srv649151037:86 , srv728149680:86 , srv744327676:86 , srv87162669:86 , srv935164120:86 , srv944017232:86 , srv1315650855:87 , srv1386559339:87 , srv1464885195:87 , srv1515469269:87 , srv1554320046:87 , srv1620169520:87 , srv1694997687:87 , srv2111399409:87 , srv284467358:87 , srv730825193:87 , srv904341690:87 , srv999239522:87 , srv1027327712:88 , srv1641228136:88 , srv2125067462:88 , srv2144809507:88 , srv352533686:88 , srv643258045:88 , srv652700064:88 , srv783052667:88 , srv802406323:88 , srv81818216:88 , srv1354131115:89 , srv1356580698:89 , srv14753448:89 , srv517449483:89 , srv790691169:89 , srv977644633:89 , srv983255422:89 , srv1153974469:90 , srv1783409647:90 , srv1889726818:90 , srv1069081193:91 , srv1176187052:91 , srv1184488847:92 , srv462560534:93 , srv1026463121:508 }
2024-04-16 18:53:19,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-16 18:53:19,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv87162669=89, srv667556152=76, srv999239522=99, srv1069081193=5, srv1464885195=26, srv652700064=75, srv1054534498=3, srv641345252=72, srv763781615=80, srv963932152=95, srv1184488847=13, srv155236565=33, srv1027327712=1, srv2111399409=52, srv46442734=66, srv95113745=94, srv1357402484=21, srv1386559339=23, srv558333186=71, srv826875103=88, srv1470218766=27, srv352533686=60, srv976102012=96, srv1150198145=7, srv1694997687=38, srv776571905=81, srv728149680=77, srv1048278082=2, srv649151037=74, srv325969782=59, srv1783409647=40, srv1061061554=4, srv1411482322=24, srv783052667=83, srv2011428779=48, srv474407252=68, srv469268406=67, srv1350471620=16, srv944017232=93, srv1133036643=6, srv517449483=69, srv643258045=73, srv88516990=90, srv462560534=65, srv393958892=62, srv977644633=97, srv788497204=84, srv983255422=98, srv117744471=11, srv1176187052=10, srv354371241=61, srv1315650855=14, srv1933939471=46, srv136600321=22, srv776706869=82, srv1832435533=41, srv1026463121=0, srv284467358=57, srv2125067462=54, srv1620169520=35, srv1641228136=36, srv1868974196=44, srv904341690=91, srv1515469269=31, srv2144809507=55, srv1458183019=25, srv236306674=56, srv2121849009=53, srv286683541=58, srv2045790296=51, srv1356082998=19, srv1153974469=8, srv1889726818=45, srv2025926944=49, srv1554320046=34, srv1673129816=37, srv730825193=78, srv935164120=92, srv1351760893=17, srv1867601134=43, srv1356580698=20, srv1155297557=9, srv4577197=64, srv81818216=87, srv1529179174=32, srv1354131115=18, srv1754093516=39, srv43744164=63, srv744327676=79, srv1844000688=42, srv528115455=70, srv14753448=28, srv1476741026=30, srv1178946379=12, srv203100145=50, srv1320295325=15, srv2011405470=47, srv1476496960=29, srv802406323=86, srv790691169=85} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-16 18:53:19,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-16 18:53:19,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-16 18:53:19,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-16 18:53:19,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-16 18:53:19,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-16 18:53:19,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-16 18:53:19,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-16 18:53:19,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-16 18:53:19,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-16 18:53:19,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-16 18:53:19,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-16 18:53:19,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-16 18:53:19,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-16 18:53:19,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-16 18:53:19,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-16 18:53:19,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-16 18:53:19,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-16 18:53:19,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-16 18:53:19,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-16 18:53:19,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-16 18:53:19,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-16 18:53:19,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-16 18:53:19,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-16 18:53:19,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-16 18:53:19,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-16 18:53:19,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-16 18:53:19,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-16 18:53:19,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-16 18:53:19,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-16 18:53:19,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-16 18:53:19,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-16 18:53:19,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-16 18:53:19,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-16 18:53:19,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-16 18:53:19,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-16 18:53:19,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-16 18:53:19,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-16 18:53:19,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-16 18:53:19,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-16 18:53:19,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-16 18:53:19,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-16 18:53:19,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-16 18:53:19,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-16 18:53:19,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-16 18:53:19,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-16 18:53:19,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-16 18:53:19,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-16 18:53:19,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-16 18:53:19,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-16 18:53:19,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-16 18:53:19,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-16 18:53:19,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-16 18:53:19,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-16 18:53:19,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-16 18:53:19,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-16 18:53:19,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-16 18:53:19,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-16 18:53:19,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-16 18:53:19,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-16 18:53:19,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-16 18:53:19,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-16 18:53:19,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-16 18:53:19,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-16 18:53:19,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-16 18:53:19,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-16 18:53:19,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-16 18:53:19,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-16 18:53:19,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-16 18:53:19,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-16 18:53:19,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-16 18:53:19,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-16 18:53:19,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-16 18:53:19,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-16 18:53:19,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-16 18:53:19,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-16 18:53:19,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-16 18:53:19,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-16 18:53:19,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-16 18:53:19,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-16 18:53:19,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-16 18:53:19,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-16 18:53:19,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-16 18:53:19,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-16 18:53:19,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-16 18:53:19,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-16 18:53:19,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-16 18:53:19,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-16 18:53:19,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-16 18:53:19,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-16 18:53:19,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-16 18:53:19,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-16 18:53:19,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-16 18:53:19,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-16 18:53:19,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-16 18:53:19,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-16 18:53:19,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-16 18:53:19,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-16 18:53:19,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-16 18:53:19,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-16 18:53:19,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-16 18:53:19,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-16 18:53:19,484 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02329294778759208); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.030169740528327, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02329294778759208); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04608333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-16 18:53:19,485 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-04-16 18:53:19,485 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.014224786385395044, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02329294778759208); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.030169740528327, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02329294778759208); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04608333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-04-16 18:53:19,786 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 417 ms to try 5000 different iterations.  Found a solution that moves 1037 regions; Going from a computed imbalance of 0.014224786385395044 to a new imbalance of 7.775807215533492E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007115458828034776); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0068493488921877515); MoveCostFunction : (multiplier=7.0, imbalance=0.11522222222222223, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007115458828034776); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0045); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-16 18:53:19,790 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv284467358:81 , srv1054534498:83 , srv1069081193:83 , srv1153974469:83 , srv1176187052:83 , srv1184488847:83 , srv1386559339:83 , srv1515469269:83 , srv1832435533:83 , srv2144809507:83 , srv517449483:83 , srv558333186:83 , srv649151037:83 , srv1061061554:84 , srv1458183019:84 , srv1694997687:84 , srv1754093516:84 , srv1889726818:84 , srv2011405470:84 , srv236306674:84 , srv352533686:84 , srv462560534:84 , srv528115455:84 , srv776571905:84 , srv963932152:84 , srv976102012:84 , srv1150198145:85 , srv117744471:85 , srv1315650855:85 , srv1356580698:85 , srv1464885195:85 , srv1470218766:85 , srv1529179174:85 , srv1620169520:85 , srv1641228136:85 , srv1844000688:85 , srv1867601134:85 , srv2011428779:85 , srv325969782:85 , srv354371241:85 , srv393958892:85 , srv641345252:85 , srv730825193:85 , srv783052667:85 , srv790691169:85 , srv81818216:85 , srv88516990:85 , srv904341690:85 , srv935164120:85 , srv1048278082:86 , srv1178946379:86 , srv1320295325:86 , srv1350471620:86 , srv1351760893:86 , srv1354131115:86 , srv14753448:86 , srv1476741026:86 , srv1673129816:86 , srv1783409647:86 , srv1868974196:86 , srv2045790296:86 , srv2121849009:86 , srv2125067462:86 , srv4577197:86 , srv46442734:86 , srv643258045:86 , srv667556152:86 , srv728149680:86 , srv763781615:86 , srv788497204:86 , srv802406323:86 , srv87162669:86 , srv95113745:86 , srv1027327712:87 , srv1133036643:87 , srv1155297557:87 , srv136600321:87 , srv1411482322:87 , srv1476496960:87 , srv155236565:87 , srv1554320046:87 , srv1933939471:87 , srv2111399409:87 , srv43744164:87 , srv469268406:87 , srv652700064:87 , srv944017232:87 , srv977644633:87 , srv983255422:87 , srv1356082998:88 , srv1357402484:88 , srv2025926944:88 , srv203100145:88 , srv286683541:88 , srv474407252:88 , srv744327676:88 , srv776706869:88 , srv826875103:88 , srv999239522:88 , srv1026463121:540 }
2024-04-16 18:53:19,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-16 18:53:19,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv87162669=89, srv667556152=76, srv999239522=99, srv1069081193=5, srv1464885195=26, srv652700064=75, srv1054534498=3, srv641345252=72, srv763781615=80, srv963932152=95, srv1184488847=13, srv155236565=33, srv1027327712=1, srv2111399409=52, srv46442734=66, srv95113745=94, srv1357402484=21, srv1386559339=23, srv558333186=71, srv826875103=88, srv1470218766=27, srv352533686=60, srv976102012=96, srv1150198145=7, srv1694997687=38, srv776571905=81, srv728149680=77, srv1048278082=2, srv649151037=74, srv325969782=59, srv1783409647=40, srv1061061554=4, srv1411482322=24, srv783052667=83, srv2011428779=48, srv474407252=68, srv469268406=67, srv1350471620=16, srv944017232=93, srv1133036643=6, srv517449483=69, srv643258045=73, srv88516990=90, srv462560534=65, srv393958892=62, srv977644633=97, srv788497204=84, srv983255422=98, srv117744471=11, srv1176187052=10, srv354371241=61, srv1315650855=14, srv1933939471=46, srv136600321=22, srv776706869=82, srv1832435533=41, srv1026463121=0, srv284467358=57, srv2125067462=54, srv1620169520=35, srv1641228136=36, srv1868974196=44, srv904341690=91, srv1515469269=31, srv2144809507=55, srv1458183019=25, srv236306674=56, srv2121849009=53, srv286683541=58, srv2045790296=51, srv1356082998=19, srv1153974469=8, srv1889726818=45, srv2025926944=49, srv1554320046=34, srv1673129816=37, srv730825193=78, srv935164120=92, srv1351760893=17, srv1867601134=43, srv1356580698=20, srv1155297557=9, srv4577197=64, srv81818216=87, srv1529179174=32, srv1354131115=18, srv1754093516=39, srv43744164=63, srv744327676=79, srv1844000688=42, srv528115455=70, srv14753448=28, srv1476741026=30, srv1178946379=12, srv203100145=50, srv1320295325=15, srv2011405470=47, srv1476496960=29, srv802406323=86, srv790691169=85} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-16 18:53:19,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-16 18:53:19,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-16 18:53:19,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-16 18:53:19,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-16 18:53:19,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-16 18:53:19,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-16 18:53:19,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-16 18:53:19,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-16 18:53:19,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-16 18:53:19,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-16 18:53:19,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-16 18:53:19,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-16 18:53:19,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-16 18:53:19,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-16 18:53:19,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-16 18:53:19,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-16 18:53:19,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-16 18:53:19,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-16 18:53:19,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-16 18:53:19,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-16 18:53:19,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-16 18:53:19,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-16 18:53:19,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-16 18:53:19,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-16 18:53:19,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-16 18:53:19,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-16 18:53:19,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-16 18:53:19,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-16 18:53:19,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-16 18:53:19,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-16 18:53:19,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-16 18:53:19,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-16 18:53:19,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-16 18:53:19,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-16 18:53:19,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-16 18:53:19,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-16 18:53:19,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-16 18:53:19,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-16 18:53:19,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-16 18:53:19,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-16 18:53:19,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-16 18:53:19,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-16 18:53:19,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-16 18:53:19,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-16 18:53:19,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-16 18:53:19,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-16 18:53:19,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-16 18:53:19,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-16 18:53:19,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-16 18:53:19,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-16 18:53:19,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-16 18:53:19,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-16 18:53:19,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-16 18:53:19,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-16 18:53:19,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-16 18:53:19,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-16 18:53:19,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-16 18:53:19,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-16 18:53:19,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-16 18:53:19,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-16 18:53:19,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-16 18:53:19,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-16 18:53:19,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-16 18:53:19,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-16 18:53:19,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-16 18:53:19,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-16 18:53:19,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-16 18:53:19,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-16 18:53:19,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-16 18:53:19,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-16 18:53:19,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-16 18:53:19,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-16 18:53:19,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-16 18:53:19,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-16 18:53:19,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-16 18:53:19,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-16 18:53:19,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-16 18:53:19,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-16 18:53:19,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-16 18:53:19,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-16 18:53:19,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-16 18:53:19,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-16 18:53:19,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-16 18:53:19,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-16 18:53:19,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-16 18:53:19,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-16 18:53:19,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-16 18:53:19,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-16 18:53:19,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-16 18:53:19,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-16 18:53:19,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-16 18:53:19,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-16 18:53:19,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-16 18:53:19,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-16 18:53:19,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-16 18:53:19,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-16 18:53:19,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-16 18:53:19,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-16 18:53:19,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-16 18:53:19,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-16 18:53:19,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-16 18:53:19,930 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007115458828034776); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0068493488921877515); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007115458828034776); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0045); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-16 18:53:19,931 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-04-16 18:53:19,932 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=7.703194923559856E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007115458828034776); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0068493488921877515); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007115458828034776); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0045); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-04-16 18:53:20,333 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 512 ms to try 5000 different iterations.  Found a solution that moves 279 regions; Going from a computed imbalance of 7.703194923559856E-4 to a new imbalance of 2.8231414174445352E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.694119368783758E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.031, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.694119368783758E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-16 18:53:20,335 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv983255422:81 , srv1048278082:83 , srv1153974469:83 , srv4577197:83 , srv474407252:83 , srv744327676:83 , srv935164120:83 , srv999239522:83 , srv1027327712:84 , srv1054534498:84 , srv1061061554:84 , srv1178946379:84 , srv1184488847:84 , srv1350471620:84 , srv1356082998:84 , srv1357402484:84 , srv1411482322:84 , srv1464885195:84 , srv14753448:84 , srv1476741026:84 , srv155236565:84 , srv1554320046:84 , srv1673129816:84 , srv1783409647:84 , srv1868974196:84 , srv1933939471:84 , srv2025926944:84 , srv2111399409:84 , srv352533686:84 , srv462560534:84 , srv469268406:84 , srv641345252:84 , srv649151037:84 , srv652700064:84 , srv667556152:84 , srv763781615:84 , srv826875103:84 , srv87162669:84 , srv944017232:84 , srv976102012:84 , srv1069081193:85 , srv1133036643:85 , srv1150198145:85 , srv1176187052:85 , srv117744471:85 , srv1315650855:85 , srv1351760893:85 , srv1354131115:85 , srv1356580698:85 , srv136600321:85 , srv1470218766:85 , srv1515469269:85 , srv1529179174:85 , srv1620169520:85 , srv1641228136:85 , srv1694997687:85 , srv1754093516:85 , srv1832435533:85 , srv1844000688:85 , srv1889726818:85 , srv2011405470:85 , srv2011428779:85 , srv203100145:85 , srv2045790296:85 , srv2121849009:85 , srv2125067462:85 , srv2144809507:85 , srv284467358:85 , srv286683541:85 , srv325969782:85 , srv354371241:85 , srv393958892:85 , srv43744164:85 , srv517449483:85 , srv643258045:85 , srv728149680:85 , srv730825193:85 , srv776706869:85 , srv788497204:85 , srv790691169:85 , srv802406323:85 , srv81818216:85 , srv88516990:85 , srv904341690:85 , srv963932152:85 , srv977644633:85 , srv1155297557:86 , srv1320295325:86 , srv1386559339:86 , srv1458183019:86 , srv1476496960:86 , srv1867601134:86 , srv236306674:86 , srv46442734:86 , srv558333186:86 , srv776571905:86 , srv783052667:86 , srv95113745:86 , srv528115455:87 , srv1026463121:621 }
2024-04-16 18:53:20,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-16 18:53:20,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv87162669=89, srv667556152=76, srv999239522=99, srv1069081193=5, srv1464885195=26, srv652700064=75, srv1054534498=3, srv641345252=72, srv763781615=80, srv963932152=95, srv1184488847=13, srv155236565=33, srv1027327712=1, srv2111399409=52, srv46442734=66, srv95113745=94, srv1357402484=21, srv1386559339=23, srv558333186=71, srv826875103=88, srv1470218766=27, srv352533686=60, srv976102012=96, srv1150198145=7, srv1694997687=38, srv776571905=81, srv728149680=77, srv1048278082=2, srv649151037=74, srv325969782=59, srv1783409647=40, srv1061061554=4, srv1411482322=24, srv783052667=83, srv2011428779=48, srv474407252=68, srv469268406=67, srv1350471620=16, srv944017232=93, srv1133036643=6, srv517449483=69, srv643258045=73, srv88516990=90, srv462560534=65, srv393958892=62, srv977644633=97, srv788497204=84, srv983255422=98, srv117744471=11, srv1176187052=10, srv354371241=61, srv1315650855=14, srv1933939471=46, srv136600321=22, srv776706869=82, srv1832435533=41, srv1026463121=0, srv284467358=57, srv2125067462=54, srv1620169520=35, srv1641228136=36, srv1868974196=44, srv904341690=91, srv1515469269=31, srv2144809507=55, srv1458183019=25, srv236306674=56, srv2121849009=53, srv286683541=58, srv2045790296=51, srv1356082998=19, srv1153974469=8, srv1889726818=45, srv2025926944=49, srv1554320046=34, srv1673129816=37, srv730825193=78, srv935164120=92, srv1351760893=17, srv1867601134=43, srv1356580698=20, srv1155297557=9, srv4577197=64, srv81818216=87, srv1529179174=32, srv1354131115=18, srv1754093516=39, srv43744164=63, srv744327676=79, srv1844000688=42, srv528115455=70, srv14753448=28, srv1476741026=30, srv1178946379=12, srv203100145=50, srv1320295325=15, srv2011405470=47, srv1476496960=29, srv802406323=86, srv790691169=85} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-16 18:53:20,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-16 18:53:20,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-16 18:53:20,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-16 18:53:20,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-16 18:53:20,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-16 18:53:20,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-16 18:53:20,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-16 18:53:20,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-16 18:53:20,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-16 18:53:20,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-16 18:53:20,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-16 18:53:20,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-16 18:53:20,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-16 18:53:20,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-16 18:53:20,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-16 18:53:20,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-16 18:53:20,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-16 18:53:20,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-16 18:53:20,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-16 18:53:20,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-16 18:53:20,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-16 18:53:20,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-16 18:53:20,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-16 18:53:20,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-16 18:53:20,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-16 18:53:20,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-16 18:53:20,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-16 18:53:20,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-16 18:53:20,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-16 18:53:20,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-16 18:53:20,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-16 18:53:20,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-16 18:53:20,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-16 18:53:20,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-16 18:53:20,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-16 18:53:20,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-16 18:53:20,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-16 18:53:20,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-16 18:53:20,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-16 18:53:20,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-16 18:53:20,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-16 18:53:20,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-16 18:53:20,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-16 18:53:20,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-16 18:53:20,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-16 18:53:20,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-16 18:53:20,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-16 18:53:20,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-16 18:53:20,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-16 18:53:20,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-16 18:53:20,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-16 18:53:20,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-16 18:53:20,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-16 18:53:20,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-16 18:53:20,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-16 18:53:20,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-16 18:53:20,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-16 18:53:20,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-16 18:53:20,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-16 18:53:20,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-16 18:53:20,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-16 18:53:20,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-16 18:53:20,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-16 18:53:20,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-16 18:53:20,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-16 18:53:20,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-16 18:53:20,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-16 18:53:20,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-16 18:53:20,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-16 18:53:20,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-16 18:53:20,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-16 18:53:20,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-16 18:53:20,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-16 18:53:20,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-16 18:53:20,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-16 18:53:20,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-16 18:53:20,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-16 18:53:20,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-16 18:53:20,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-16 18:53:20,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-16 18:53:20,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-16 18:53:20,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-16 18:53:20,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-16 18:53:20,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-16 18:53:20,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-16 18:53:20,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-16 18:53:20,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-16 18:53:20,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-16 18:53:20,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-16 18:53:20,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-16 18:53:20,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-16 18:53:20,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-16 18:53:20,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-16 18:53:20,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-16 18:53:20,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-16 18:53:20,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-16 18:53:20,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-16 18:53:20,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-16 18:53:20,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-16 18:53:20,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-16 18:53:20,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-16 18:53:20,473 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.694119368783758E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.694119368783758E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-16 18:53:20,473 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-04-16 18:53:20,474 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.6277814419320526E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.694119368783758E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.694119368783758E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-04-16 18:53:20,687 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 319 ms to try 5000 different iterations.  Found a solution that moves 27 regions; Going from a computed imbalance of 2.6277814419320526E-5 to a new imbalance of 7.57681554113109E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0016412198797244363); MoveCostFunction : (multiplier=7.0, imbalance=0.003); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-16 18:53:20,688 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1155297557:83 , srv1320295325:83 , srv1458183019:83 , srv1476496960:83 , srv155236565:83 , srv1867601134:83 , srv2011405470:83 , srv2045790296:83 , srv2144809507:83 , srv236306674:83 , srv528115455:83 , srv783052667:83 , srv977644633:83 , srv1027327712:84 , srv1054534498:84 , srv1061061554:84 , srv1069081193:84 , srv1133036643:84 , srv1150198145:84 , srv1153974469:84 , srv1176187052:84 , srv117744471:84 , srv1178946379:84 , srv1184488847:84 , srv1315650855:84 , srv1351760893:84 , srv1354131115:84 , srv1356082998:84 , srv1356580698:84 , srv1357402484:84 , srv136600321:84 , srv1386559339:84 , srv1464885195:84 , srv1470218766:84 , srv14753448:84 , srv1476741026:84 , srv1515469269:84 , srv1529179174:84 , srv1554320046:84 , srv1620169520:84 , srv1641228136:84 , srv1673129816:84 , srv1694997687:84 , srv1754093516:84 , srv1783409647:84 , srv1832435533:84 , srv1844000688:84 , srv1889726818:84 , srv1933939471:84 , srv2011428779:84 , srv2025926944:84 , srv203100145:84 , srv2121849009:84 , srv2125067462:84 , srv284467358:84 , srv286683541:84 , srv325969782:84 , srv354371241:84 , srv393958892:84 , srv43744164:84 , srv462560534:84 , srv46442734:84 , srv469268406:84 , srv517449483:84 , srv558333186:84 , srv641345252:84 , srv643258045:84 , srv649151037:84 , srv652700064:84 , srv730825193:84 , srv763781615:84 , srv776571905:84 , srv776706869:84 , srv788497204:84 , srv790691169:84 , srv802406323:84 , srv81818216:84 , srv826875103:84 , srv87162669:84 , srv88516990:84 , srv904341690:84 , srv935164120:84 , srv944017232:84 , srv95113745:84 , srv963932152:84 , srv999239522:84 , srv1048278082:85 , srv1350471620:85 , srv1411482322:85 , srv1868974196:85 , srv2111399409:85 , srv352533686:85 , srv4577197:85 , srv474407252:85 , srv667556152:85 , srv728149680:85 , srv744327676:85 , srv976102012:85 , srv983255422:85 , srv1026463121:684 }
2024-04-16 18:53:20,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-16 18:53:20,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv87162669=89, srv667556152=76, srv999239522=99, srv1069081193=5, srv1464885195=26, srv652700064=75, srv1054534498=3, srv641345252=72, srv763781615=80, srv963932152=95, srv1184488847=13, srv155236565=33, srv1027327712=1, srv2111399409=52, srv46442734=66, srv95113745=94, srv1357402484=21, srv1386559339=23, srv558333186=71, srv826875103=88, srv1470218766=27, srv352533686=60, srv976102012=96, srv1150198145=7, srv1694997687=38, srv776571905=81, srv728149680=77, srv1048278082=2, srv649151037=74, srv325969782=59, srv1783409647=40, srv1061061554=4, srv1411482322=24, srv783052667=83, srv2011428779=48, srv474407252=68, srv469268406=67, srv1350471620=16, srv944017232=93, srv1133036643=6, srv517449483=69, srv643258045=73, srv88516990=90, srv462560534=65, srv393958892=62, srv977644633=97, srv788497204=84, srv983255422=98, srv117744471=11, srv1176187052=10, srv354371241=61, srv1315650855=14, srv1933939471=46, srv136600321=22, srv776706869=82, srv1832435533=41, srv1026463121=0, srv284467358=57, srv2125067462=54, srv1620169520=35, srv1641228136=36, srv1868974196=44, srv904341690=91, srv1515469269=31, srv2144809507=55, srv1458183019=25, srv236306674=56, srv2121849009=53, srv286683541=58, srv2045790296=51, srv1356082998=19, srv1153974469=8, srv1889726818=45, srv2025926944=49, srv1554320046=34, srv1673129816=37, srv730825193=78, srv935164120=92, srv1351760893=17, srv1867601134=43, srv1356580698=20, srv1155297557=9, srv4577197=64, srv81818216=87, srv1529179174=32, srv1354131115=18, srv1754093516=39, srv43744164=63, srv744327676=79, srv1844000688=42, srv528115455=70, srv14753448=28, srv1476741026=30, srv1178946379=12, srv203100145=50, srv1320295325=15, srv2011405470=47, srv1476496960=29, srv802406323=86, srv790691169=85} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-16 18:53:20,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-16 18:53:20,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-16 18:53:20,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-16 18:53:20,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-16 18:53:20,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-16 18:53:20,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-16 18:53:20,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-16 18:53:20,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-16 18:53:20,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-16 18:53:20,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-16 18:53:20,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-16 18:53:20,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-16 18:53:20,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-16 18:53:20,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-16 18:53:20,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-16 18:53:20,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-16 18:53:20,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-16 18:53:20,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-16 18:53:20,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-16 18:53:20,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-16 18:53:20,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-16 18:53:20,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-16 18:53:20,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-16 18:53:20,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-16 18:53:20,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-16 18:53:20,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-16 18:53:20,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-16 18:53:20,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-16 18:53:20,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-16 18:53:20,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-16 18:53:20,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-16 18:53:20,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-16 18:53:20,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-16 18:53:20,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-16 18:53:20,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-16 18:53:20,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-16 18:53:20,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-16 18:53:20,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-16 18:53:20,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-16 18:53:20,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-16 18:53:20,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-16 18:53:20,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-16 18:53:20,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-16 18:53:20,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-16 18:53:20,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-16 18:53:20,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-16 18:53:20,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-16 18:53:20,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-16 18:53:20,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-16 18:53:20,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-16 18:53:20,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-16 18:53:20,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-16 18:53:20,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-16 18:53:20,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-16 18:53:20,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-16 18:53:20,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-16 18:53:20,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-16 18:53:20,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-16 18:53:20,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-16 18:53:20,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-16 18:53:20,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-16 18:53:20,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-16 18:53:20,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-16 18:53:20,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-16 18:53:20,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-16 18:53:20,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-16 18:53:20,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-16 18:53:20,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-16 18:53:20,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-16 18:53:20,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-16 18:53:20,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-16 18:53:20,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-16 18:53:20,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-16 18:53:20,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-16 18:53:20,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-16 18:53:20,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-16 18:53:20,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-16 18:53:20,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-16 18:53:20,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-16 18:53:20,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-16 18:53:20,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-16 18:53:20,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-16 18:53:20,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-16 18:53:20,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-16 18:53:20,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-16 18:53:20,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-16 18:53:20,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-16 18:53:20,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-16 18:53:20,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-16 18:53:20,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-16 18:53:20,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-16 18:53:20,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-16 18:53:20,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-16 18:53:20,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-16 18:53:20,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-16 18:53:20,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-16 18:53:20,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-16 18:53:20,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-16 18:53:20,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-16 18:53:20,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-16 18:53:20,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-16 18:53:20,817 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.387757500312559E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0016412198797244363); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-16 18:53:20,817 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1155297557:83 , srv1320295325:83 , srv1458183019:83 , srv1476496960:83 , srv155236565:83 , srv1867601134:83 , srv2011405470:83 , srv2045790296:83 , srv2144809507:83 , srv236306674:83 , srv528115455:83 , srv783052667:83 , srv977644633:83 , srv1027327712:84 , srv1054534498:84 , srv1061061554:84 , srv1069081193:84 , srv1133036643:84 , srv1150198145:84 , srv1153974469:84 , srv1176187052:84 , srv117744471:84 , srv1178946379:84 , srv1184488847:84 , srv1315650855:84 , srv1351760893:84 , srv1354131115:84 , srv1356082998:84 , srv1356580698:84 , srv1357402484:84 , srv136600321:84 , srv1386559339:84 , srv1464885195:84 , srv1470218766:84 , srv14753448:84 , srv1476741026:84 , srv1515469269:84 , srv1529179174:84 , srv1554320046:84 , srv1620169520:84 , srv1641228136:84 , srv1673129816:84 , srv1694997687:84 , srv1754093516:84 , srv1783409647:84 , srv1832435533:84 , srv1844000688:84 , srv1889726818:84 , srv1933939471:84 , srv2011428779:84 , srv2025926944:84 , srv203100145:84 , srv2121849009:84 , srv2125067462:84 , srv284467358:84 , srv286683541:84 , srv325969782:84 , srv354371241:84 , srv393958892:84 , srv43744164:84 , srv462560534:84 , srv46442734:84 , srv469268406:84 , srv517449483:84 , srv558333186:84 , srv641345252:84 , srv643258045:84 , srv649151037:84 , srv652700064:84 , srv730825193:84 , srv763781615:84 , srv776571905:84 , srv776706869:84 , srv788497204:84 , srv790691169:84 , srv802406323:84 , srv81818216:84 , srv826875103:84 , srv87162669:84 , srv88516990:84 , srv904341690:84 , srv935164120:84 , srv944017232:84 , srv95113745:84 , srv963932152:84 , srv999239522:84 , srv1048278082:85 , srv1350471620:85 , srv1411482322:85 , srv1868974196:85 , srv2111399409:85 , srv352533686:85 , srv4577197:85 , srv474407252:85 , srv667556152:85 , srv728149680:85 , srv744327676:85 , srv976102012:85 , srv983255422:85 , srv1026463121:684 }
2024-04-16 18:53:20,844 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=309 (was 301) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 171), AvailableMemoryMB=2878 (was 3612)
2024-04-16 18:53:20,854 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=309, ProcessCount=171, AvailableMemoryMB=2878
2024-04-16 18:53:20,854 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-04-16 18:53:20,854 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2024-04-16 18:53:20,870 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1083950051:84 , srv1107091955:84 , srv1177135619:84 , srv1223575327:84 , srv1242839794:84 , srv1297339480:84 , srv1503380594:84 , srv1559782308:84 , srv1694137590:84 , srv173518771:84 , srv1796205942:84 , srv1814887979:84 , srv182832803:84 , srv1915220498:84 , srv1964406911:84 , srv2002114534:84 , srv2004128406:84 , srv2079935073:84 , srv238207476:84 , srv242960036:84 , srv337278296:84 , srv396386545:84 , srv468269986:84 , srv493087704:84 , srv593490784:84 , srv62252632:84 , srv732903990:84 , srv887136245:84 , srv921499658:84 , srv2065306137:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2024-04-16 18:53:20,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-16 18:53:20,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1814887979=11, srv1694137590=8, srv1177135619=2, srv1503380594=6, srv887136245=28, srv2065306137=17, srv396386545=22, srv732903990=27, srv1964406911=14, srv238207476=19, srv2002114534=15, srv493087704=24, srv62252632=26, srv182832803=12, srv2004128406=16, srv593490784=25, srv1083950051=0, srv921499658=29, srv1223575327=3, srv468269986=23, srv1559782308=7, srv1242839794=4, srv1297339480=5, srv1107091955=1, srv2079935073=18, srv337278296=21, srv1915220498=13, srv242960036=20, srv1796205942=10, srv173518771=9} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-16 18:53:20,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-16 18:53:20,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-16 18:53:20,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-16 18:53:20,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-16 18:53:20,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-16 18:53:20,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-16 18:53:20,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-16 18:53:20,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-16 18:53:20,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-16 18:53:20,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-16 18:53:20,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-16 18:53:20,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-16 18:53:20,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-16 18:53:20,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-16 18:53:20,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-16 18:53:20,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-16 18:53:20,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-16 18:53:20,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-16 18:53:20,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-16 18:53:20,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-16 18:53:20,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-16 18:53:20,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-16 18:53:20,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-16 18:53:20,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-16 18:53:20,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-16 18:53:20,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-16 18:53:20,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-16 18:53:20,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-16 18:53:20,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-16 18:53:20,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-16 18:53:20,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-04-16 18:53:20,914 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1391705230651956, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-16 18:53:20,914 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912631565038122, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1391705230651956, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2024-04-16 18:55:20,892 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6088332 different iterations.  Found a solution that moves 1860 regions; Going from a computed imbalance of 0.9912631565038122 to a new imbalance of 4.341332789166274E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6888888888888889, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-16 18:55:20,898 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1083950051:90 , srv1107091955:90 , srv1177135619:90 , srv1223575327:90 , srv1242839794:90 , srv1297339480:90 , srv1503380594:90 , srv1559782308:90 , srv1694137590:90 , srv173518771:90 , srv1796205942:90 , srv1814887979:90 , srv182832803:90 , srv1915220498:90 , srv1964406911:90 , srv2002114534:90 , srv2004128406:90 , srv2065306137:90 , srv2079935073:90 , srv238207476:90 , srv242960036:90 , srv337278296:90 , srv396386545:90 , srv468269986:90 , srv493087704:90 , srv593490784:90 , srv62252632:90 , srv732903990:90 , srv887136245:90 , srv921499658:90 }
2024-04-16 18:55:20,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-16 18:55:20,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1814887979=11, srv1694137590=8, srv1177135619=2, srv1503380594=6, srv887136245=28, srv2065306137=17, srv396386545=22, srv732903990=27, srv1964406911=14, srv238207476=19, srv2002114534=15, srv493087704=24, srv62252632=26, srv182832803=12, srv2004128406=16, srv593490784=25, srv1083950051=0, srv921499658=29, srv1223575327=3, srv468269986=23, srv1559782308=7, srv1242839794=4, srv1297339480=5, srv1107091955=1, srv2079935073=18, srv337278296=21, srv1915220498=13, srv242960036=20, srv1796205942=10, srv173518771=9} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-16 18:55:20,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-16 18:55:20,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-16 18:55:20,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-16 18:55:20,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-16 18:55:20,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-16 18:55:20,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-16 18:55:20,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-16 18:55:20,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-16 18:55:20,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-16 18:55:20,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-16 18:55:20,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-16 18:55:20,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-16 18:55:20,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-16 18:55:20,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-16 18:55:20,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-16 18:55:20,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-16 18:55:20,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-16 18:55:20,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-16 18:55:20,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-16 18:55:20,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-16 18:55:20,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-16 18:55:20,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-16 18:55:20,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-16 18:55:20,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-16 18:55:20,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-16 18:55:20,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-16 18:55:20,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-16 18:55:20,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-16 18:55:20,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-16 18:55:20,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-16 18:55:20,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-04-16 18:55:20,916 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-16 18:55:20,916 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1083950051:90 , srv1107091955:90 , srv1177135619:90 , srv1223575327:90 , srv1242839794:90 , srv1297339480:90 , srv1503380594:90 , srv1559782308:90 , srv1694137590:90 , srv173518771:90 , srv1796205942:90 , srv1814887979:90 , srv182832803:90 , srv1915220498:90 , srv1964406911:90 , srv2002114534:90 , srv2004128406:90 , srv2065306137:90 , srv2079935073:90 , srv238207476:90 , srv242960036:90 , srv337278296:90 , srv396386545:90 , srv468269986:90 , srv493087704:90 , srv593490784:90 , srv62252632:90 , srv732903990:90 , srv887136245:90 , srv921499658:90 }
2024-04-16 18:55:20,930 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=286 (was 309), ProcessCount=167 (was 171), AvailableMemoryMB=2074 (was 2878)