2023-12-10 17:53:15,529 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-12-10 17:53:15,867 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-12-10 17:53:15,992 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-12-10 17:53:16,063 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-12-10 17:53:16,070 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-12-10 17:53:16,086 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=254, ProcessCount=173, AvailableMemoryMB=6695
2023-12-10 17:53:16,088 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-12-10 17:53:16,088 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-12-10 17:53:16,219 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1005701490:84 , srv1026771975:84 , srv1027213767:84 , srv1070635772:84 , srv1079680857:84 , srv1093812751:84 , srv1101524647:84 , srv1129884553:84 , srv1150122819:84 , srv1156621564:84 , srv117490391:84 , srv1199129227:84 , srv1212205098:84 , srv1219731033:84 , srv1287929126:84 , srv1291758170:84 , srv1309159142:84 , srv1342959510:84 , srv134440472:84 , srv136616685:84 , srv1376027804:84 , srv1384467314:84 , srv1389379377:84 , srv1426921611:84 , srv1464144507:84 , srv1478759051:84 , srv1495612263:84 , srv1505154472:84 , srv1566466822:84 , srv1611268188:84 , srv1613071245:84 , srv1621042632:84 , srv1625726576:84 , srv1650257501:84 , srv1650369884:84 , srv1650543291:84 , srv1655661014:84 , srv1656393188:84 , srv1677511111:84 , srv1727363829:84 , srv1732313715:84 , srv1739780586:84 , srv1762525631:84 , srv1795860292:84 , srv1811764970:84 , srv1842989942:84 , srv1897108134:84 , srv1898511870:84 , srv1932171575:84 , srv1948205733:84 , srv197086098:84 , srv2000862702:84 , srv2010588804:84 , srv2027097289:84 , srv2041283038:84 , srv2085657491:84 , srv2094237752:84 , srv2103357541:84 , srv2111317943:84 , srv2125076628:84 , srv258907113:84 , srv26262861:84 , srv263205972:84 , srv276744346:84 , srv290704519:84 , srv291537708:84 , srv32240489:84 , srv337906020:84 , srv371663170:84 , srv374591853:84 , srv384474185:84 , srv390121692:84 , srv393998781:84 , srv405326791:84 , srv411121183:84 , srv433588175:84 , srv440020257:84 , srv498375401:84 , srv527569761:84 , srv544671354:84 , srv588022775:84 , srv628810468:84 , srv650489879:84 , srv662938551:84 , srv691204228:84 , srv71274006:84 , srv731231859:84 , srv747283700:84 , srv753335629:84 , srv766208286:84 , srv789972759:84 , srv814085191:84 , srv873414904:84 , srv878196674:84 , srv948086737:84 , srv960471507:84 , srv960924424:84 , srv963051585:84 , srv994506812:84 , srv261412500:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-12-10 17:53:16,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-10 17:53:16,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1505154472=27, srv1291758170=15, srv2085657491=55, srv2111317943=58, srv1842989942=45, srv2010588804=52, srv1611268188=29, srv878196674=94, srv588022775=81, srv1762525631=42, srv374591853=70, srv1079680857=4, srv1212205098=12, srv371663170=69, srv2041283038=54, srv1101524647=6, srv1739780586=41, srv1384467314=21, srv1650369884=34, srv789972759=91, srv960924424=97, srv1613071245=30, srv1898511870=47, srv117490391=10, srv2094237752=56, srv71274006=86, srv32240489=67, srv1026771975=1, srv258907113=60, srv498375401=78, srv544671354=80, srv197086098=50, srv384474185=71, srv1376027804=20, srv1199129227=11, srv1156621564=9, srv1655661014=36, srv1566466822=28, srv1027213767=2, srv1309159142=16, srv1948205733=49, srv290704519=65, srv390121692=72, srv1070635772=3, srv873414904=93, srv948086737=95, srv1795860292=43, srv1650543291=35, srv2103357541=57, srv1811764970=44, srv2125076628=59, srv433588175=76, srv691204228=85, srv1150122819=8, srv731231859=87, srv1093812751=5, srv1932171575=48, srv263205972=63, srv650489879=83, srv1727363829=39, srv1625726576=32, srv1287929126=14, srv994506812=99, srv1732313715=40, srv814085191=92, srv393998781=73, srv1464144507=24, srv440020257=77, srv1389379377=22, srv1478759051=25, srv1129884553=7, srv1495612263=26, srv2027097289=53, srv628810468=82, srv527569761=79, srv1342959510=17, srv1426921611=23, srv136616685=19, srv276744346=64, srv766208286=90, srv963051585=98, srv960471507=96, srv1621042632=31, srv1005701490=0, srv1656393188=37, srv291537708=66, srv1650257501=33, srv753335629=89, srv662938551=84, srv261412500=61, srv2000862702=51, srv1677511111=38, srv26262861=62, srv1897108134=46, srv747283700=88, srv1219731033=13, srv405326791=74, srv337906020=68, srv411121183=75, srv134440472=18} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-10 17:53:16,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-10 17:53:16,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-10 17:53:16,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-10 17:53:16,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-10 17:53:16,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-10 17:53:16,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-10 17:53:16,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-10 17:53:16,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-10 17:53:16,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-10 17:53:16,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-10 17:53:16,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-10 17:53:16,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-10 17:53:16,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-10 17:53:16,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-10 17:53:16,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-10 17:53:16,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-10 17:53:16,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-10 17:53:16,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-10 17:53:16,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-10 17:53:16,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-10 17:53:16,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-10 17:53:16,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-10 17:53:16,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-10 17:53:16,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-10 17:53:16,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-10 17:53:16,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-10 17:53:16,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-10 17:53:16,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-10 17:53:16,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-10 17:53:16,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-10 17:53:16,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-10 17:53:16,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-10 17:53:16,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-10 17:53:16,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-10 17:53:16,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-10 17:53:16,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-10 17:53:16,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-10 17:53:16,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-10 17:53:16,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-10 17:53:16,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-10 17:53:16,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-10 17:53:16,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-10 17:53:16,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-10 17:53:16,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-10 17:53:16,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-10 17:53:16,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-10 17:53:16,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-10 17:53:16,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-10 17:53:16,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-10 17:53:16,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-10 17:53:16,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-10 17:53:16,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-10 17:53:16,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-10 17:53:16,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-10 17:53:16,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-10 17:53:16,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-10 17:53:16,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-10 17:53:16,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-10 17:53:16,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-10 17:53:16,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-10 17:53:16,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-10 17:53:16,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-10 17:53:16,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-10 17:53:16,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-10 17:53:16,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-10 17:53:16,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-10 17:53:16,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-10 17:53:16,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-10 17:53:16,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-10 17:53:16,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-10 17:53:16,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-10 17:53:16,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-10 17:53:16,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-10 17:53:16,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-10 17:53:16,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-10 17:53:16,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-10 17:53:16,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-10 17:53:16,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-10 17:53:16,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-10 17:53:16,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-10 17:53:16,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-10 17:53:16,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-10 17:53:16,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-10 17:53:16,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-10 17:53:16,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-10 17:53:16,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-10 17:53:16,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-10 17:53:16,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-10 17:53:16,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-10 17:53:16,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-10 17:53:16,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-10 17:53:16,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-10 17:53:16,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-10 17:53:16,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-10 17:53:16,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-10 17:53:16,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-10 17:53:16,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-10 17:53:16,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-10 17:53:16,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-10 17:53:16,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-10 17:53:16,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-10 17:53:16,584 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-10 17:53:16,584 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-10 17:53:16,585 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-10 17:53:17,550 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 1188 ms to try 5000 different iterations.  Found a solution that moves 4660 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18323194363134115. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.037284024943995006, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05356640989799736, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5177777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.037284024943995006, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.1785, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24525, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-10 17:53:17,566 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv2085657491:81 , srv117490391:82 , srv2111317943:82 , srv32240489:82 , srv527569761:82 , srv747283700:82 , srv1070635772:83 , srv1291758170:83 , srv1495612263:83 , srv1811764970:83 , srv1842989942:83 , srv197086098:83 , srv258907113:83 , srv948086737:83 , srv1027213767:84 , srv1101524647:84 , srv1199129227:84 , srv1384467314:84 , srv1898511870:84 , srv2000862702:84 , srv2103357541:84 , srv789972759:84 , srv1156621564:85 , srv1219731033:85 , srv1389379377:85 , srv1655661014:85 , srv1656393188:85 , srv1677511111:85 , srv1732313715:85 , srv411121183:85 , srv498375401:85 , srv71274006:85 , srv1150122819:86 , srv1309159142:86 , srv1464144507:86 , srv1505154472:86 , srv1621042632:86 , srv1625726576:86 , srv1650369884:86 , srv1650543291:86 , srv1897108134:86 , srv2010588804:86 , srv2125076628:86 , srv337906020:86 , srv374591853:86 , srv390121692:86 , srv588022775:86 , srv814085191:86 , srv878196674:86 , srv960471507:86 , srv994506812:86 , srv1079680857:87 , srv1093812751:87 , srv1129884553:87 , srv1342959510:87 , srv134440472:87 , srv1795860292:87 , srv2027097289:87 , srv291537708:87 , srv371663170:87 , srv405326791:87 , srv544671354:87 , srv766208286:87 , srv960924424:87 , srv963051585:87 , srv1005701490:88 , srv1426921611:88 , srv1611268188:88 , srv1727363829:88 , srv1932171575:88 , srv1948205733:88 , srv2041283038:88 , srv276744346:88 , srv290704519:88 , srv433588175:88 , srv628810468:88 , srv650489879:88 , srv662938551:88 , srv731231859:88 , srv136616685:89 , srv1376027804:89 , srv2094237752:89 , srv384474185:89 , srv440020257:89 , srv691204228:89 , srv1026771975:90 , srv1212205098:90 , srv1566466822:90 , srv1613071245:90 , srv26262861:90 , srv873414904:90 , srv1650257501:91 , srv1287929126:92 , srv263205972:92 , srv753335629:92 , srv1478759051:93 , srv393998781:94 , srv1739780586:95 , srv1762525631:95 , srv261412500:421 }
2023-12-10 17:53:17,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-10 17:53:17,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1505154472=27, srv1291758170=15, srv2085657491=55, srv2111317943=58, srv1842989942=45, srv2010588804=52, srv1611268188=29, srv878196674=94, srv588022775=81, srv1762525631=42, srv374591853=70, srv1079680857=4, srv1212205098=12, srv371663170=69, srv2041283038=54, srv1101524647=6, srv1739780586=41, srv1384467314=21, srv1650369884=34, srv789972759=91, srv960924424=97, srv1613071245=30, srv1898511870=47, srv117490391=10, srv2094237752=56, srv71274006=86, srv32240489=67, srv1026771975=1, srv258907113=60, srv498375401=78, srv544671354=80, srv197086098=50, srv384474185=71, srv1376027804=20, srv1199129227=11, srv1156621564=9, srv1655661014=36, srv1566466822=28, srv1027213767=2, srv1309159142=16, srv1948205733=49, srv290704519=65, srv390121692=72, srv1070635772=3, srv873414904=93, srv948086737=95, srv1795860292=43, srv1650543291=35, srv2103357541=57, srv1811764970=44, srv2125076628=59, srv433588175=76, srv691204228=85, srv1150122819=8, srv731231859=87, srv1093812751=5, srv1932171575=48, srv263205972=63, srv650489879=83, srv1727363829=39, srv1625726576=32, srv1287929126=14, srv994506812=99, srv1732313715=40, srv814085191=92, srv393998781=73, srv1464144507=24, srv440020257=77, srv1389379377=22, srv1478759051=25, srv1129884553=7, srv1495612263=26, srv2027097289=53, srv628810468=82, srv527569761=79, srv1342959510=17, srv1426921611=23, srv136616685=19, srv276744346=64, srv766208286=90, srv963051585=98, srv960471507=96, srv1621042632=31, srv1005701490=0, srv1656393188=37, srv291537708=66, srv1650257501=33, srv753335629=89, srv662938551=84, srv261412500=61, srv2000862702=51, srv1677511111=38, srv26262861=62, srv1897108134=46, srv747283700=88, srv1219731033=13, srv405326791=74, srv337906020=68, srv411121183=75, srv134440472=18} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-10 17:53:17,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-10 17:53:17,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-10 17:53:17,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-10 17:53:17,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-10 17:53:17,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-10 17:53:17,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-10 17:53:17,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-10 17:53:17,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-10 17:53:17,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-10 17:53:17,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-10 17:53:17,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-10 17:53:17,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-10 17:53:17,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-10 17:53:17,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-10 17:53:17,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-10 17:53:17,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-10 17:53:17,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-10 17:53:17,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-10 17:53:17,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-10 17:53:17,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-10 17:53:17,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-10 17:53:17,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-10 17:53:17,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-10 17:53:17,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-10 17:53:17,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-10 17:53:17,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-10 17:53:17,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-10 17:53:17,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-10 17:53:17,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-10 17:53:17,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-10 17:53:17,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-10 17:53:17,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-10 17:53:17,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-10 17:53:17,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-10 17:53:17,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-10 17:53:17,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-10 17:53:17,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-10 17:53:17,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-10 17:53:17,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-10 17:53:17,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-10 17:53:17,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-10 17:53:17,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-10 17:53:17,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-10 17:53:17,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-10 17:53:17,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-10 17:53:17,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-10 17:53:17,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-10 17:53:17,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-10 17:53:17,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-10 17:53:17,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-10 17:53:17,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-10 17:53:17,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-10 17:53:17,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-10 17:53:17,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-10 17:53:17,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-10 17:53:17,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-10 17:53:17,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-10 17:53:17,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-10 17:53:17,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-10 17:53:17,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-10 17:53:17,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-10 17:53:17,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-10 17:53:17,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-10 17:53:17,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-10 17:53:17,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-10 17:53:17,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-10 17:53:17,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-10 17:53:17,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-10 17:53:17,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-10 17:53:17,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-10 17:53:17,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-10 17:53:17,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-10 17:53:17,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-10 17:53:17,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-10 17:53:17,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-10 17:53:17,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-10 17:53:17,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-10 17:53:17,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-10 17:53:17,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-10 17:53:17,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-10 17:53:17,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-10 17:53:17,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-10 17:53:17,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-10 17:53:17,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-10 17:53:17,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-10 17:53:17,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-10 17:53:17,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-10 17:53:17,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-10 17:53:17,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-10 17:53:17,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-10 17:53:17,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-10 17:53:17,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-10 17:53:17,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-10 17:53:17,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-10 17:53:17,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-10 17:53:17,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-10 17:53:17,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-10 17:53:17,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-10 17:53:17,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-10 17:53:17,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-10 17:53:17,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-10 17:53:17,766 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.037284024943995006, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05356640989799736, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.037284024943995006, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.1785, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24525, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-10 17:53:17,767 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-10 17:53:17,767 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18319931361392577, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.037284024943995006, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05356640989799736, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.037284024943995006, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.1785, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24525, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-10 17:53:18,036 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 401 ms to try 5000 different iterations.  Found a solution that moves 2664 regions; Going from a computed imbalance of 0.18319931361392577 to a new imbalance of 0.016225632239969284. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020942382016124392); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03637008921421634, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.296, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020942382016124392); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013166666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04541666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-10 17:53:18,049 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1762525631:76 , srv393998781:77 , srv1478759051:78 , srv26262861:80 , srv753335629:80 , srv1026771975:81 , srv1212205098:81 , srv1650257501:81 , srv1739780586:81 , srv263205972:81 , srv1932171575:82 , srv1287929126:83 , srv1376027804:83 , srv1566466822:83 , srv1611268188:83 , srv276744346:83 , srv290704519:83 , srv291537708:83 , srv384474185:83 , srv440020257:83 , srv731231859:83 , srv873414904:83 , srv960924424:83 , srv963051585:83 , srv1005701490:84 , srv1093812751:84 , srv136616685:84 , srv1426921611:84 , srv1613071245:84 , srv1948205733:84 , srv2041283038:84 , srv374591853:84 , srv691204228:84 , srv814085191:84 , srv994506812:84 , srv1464144507:85 , srv1505154472:85 , srv1650543291:85 , srv371663170:85 , srv390121692:85 , srv433588175:85 , srv544671354:85 , srv650489879:85 , srv662938551:85 , srv878196674:85 , srv1129884553:86 , srv1150122819:86 , srv1219731033:86 , srv1309159142:86 , srv134440472:86 , srv1495612263:86 , srv1621042632:86 , srv1625726576:86 , srv1650369884:86 , srv1732313715:86 , srv1897108134:86 , srv1898511870:86 , srv2094237752:86 , srv405326791:86 , srv411121183:86 , srv588022775:86 , srv766208286:86 , srv960471507:86 , srv1027213767:87 , srv1079680857:87 , srv1156621564:87 , srv1199129227:87 , srv1342959510:87 , srv1384467314:87 , srv1389379377:87 , srv1655661014:87 , srv2000862702:87 , srv2010588804:87 , srv337906020:87 , srv498375401:87 , srv71274006:87 , srv1677511111:88 , srv1727363829:88 , srv1795860292:88 , srv2027097289:88 , srv2103357541:88 , srv527569761:88 , srv628810468:88 , srv789972759:88 , srv1101524647:89 , srv117490391:89 , srv1811764970:89 , srv1842989942:89 , srv2125076628:89 , srv948086737:89 , srv1291758170:90 , srv197086098:90 , srv2085657491:90 , srv2111317943:90 , srv258907113:90 , srv32240489:90 , srv747283700:90 , srv1070635772:91 , srv1656393188:92 , srv261412500:539 }
2023-12-10 17:53:18,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-10 17:53:18,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1505154472=27, srv1291758170=15, srv2085657491=55, srv2111317943=58, srv1842989942=45, srv2010588804=52, srv1611268188=29, srv878196674=94, srv588022775=81, srv1762525631=42, srv374591853=70, srv1079680857=4, srv1212205098=12, srv371663170=69, srv2041283038=54, srv1101524647=6, srv1739780586=41, srv1384467314=21, srv1650369884=34, srv789972759=91, srv960924424=97, srv1613071245=30, srv1898511870=47, srv117490391=10, srv2094237752=56, srv71274006=86, srv32240489=67, srv1026771975=1, srv258907113=60, srv498375401=78, srv544671354=80, srv197086098=50, srv384474185=71, srv1376027804=20, srv1199129227=11, srv1156621564=9, srv1655661014=36, srv1566466822=28, srv1027213767=2, srv1309159142=16, srv1948205733=49, srv290704519=65, srv390121692=72, srv1070635772=3, srv873414904=93, srv948086737=95, srv1795860292=43, srv1650543291=35, srv2103357541=57, srv1811764970=44, srv2125076628=59, srv433588175=76, srv691204228=85, srv1150122819=8, srv731231859=87, srv1093812751=5, srv1932171575=48, srv263205972=63, srv650489879=83, srv1727363829=39, srv1625726576=32, srv1287929126=14, srv994506812=99, srv1732313715=40, srv814085191=92, srv393998781=73, srv1464144507=24, srv440020257=77, srv1389379377=22, srv1478759051=25, srv1129884553=7, srv1495612263=26, srv2027097289=53, srv628810468=82, srv527569761=79, srv1342959510=17, srv1426921611=23, srv136616685=19, srv276744346=64, srv766208286=90, srv963051585=98, srv960471507=96, srv1621042632=31, srv1005701490=0, srv1656393188=37, srv291537708=66, srv1650257501=33, srv753335629=89, srv662938551=84, srv261412500=61, srv2000862702=51, srv1677511111=38, srv26262861=62, srv1897108134=46, srv747283700=88, srv1219731033=13, srv405326791=74, srv337906020=68, srv411121183=75, srv134440472=18} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-10 17:53:18,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-10 17:53:18,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-10 17:53:18,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-10 17:53:18,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-10 17:53:18,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-10 17:53:18,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-10 17:53:18,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-10 17:53:18,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-10 17:53:18,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-10 17:53:18,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-10 17:53:18,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-10 17:53:18,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-10 17:53:18,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-10 17:53:18,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-10 17:53:18,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-10 17:53:18,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-10 17:53:18,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-10 17:53:18,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-10 17:53:18,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-10 17:53:18,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-10 17:53:18,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-10 17:53:18,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-10 17:53:18,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-10 17:53:18,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-10 17:53:18,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-10 17:53:18,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-10 17:53:18,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-10 17:53:18,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-10 17:53:18,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-10 17:53:18,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-10 17:53:18,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-10 17:53:18,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-10 17:53:18,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-10 17:53:18,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-10 17:53:18,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-10 17:53:18,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-10 17:53:18,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-10 17:53:18,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-10 17:53:18,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-10 17:53:18,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-10 17:53:18,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-10 17:53:18,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-10 17:53:18,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-10 17:53:18,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-10 17:53:18,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-10 17:53:18,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-10 17:53:18,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-10 17:53:18,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-10 17:53:18,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-10 17:53:18,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-10 17:53:18,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-10 17:53:18,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-10 17:53:18,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-10 17:53:18,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-10 17:53:18,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-10 17:53:18,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-10 17:53:18,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-10 17:53:18,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-10 17:53:18,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-10 17:53:18,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-10 17:53:18,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-10 17:53:18,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-10 17:53:18,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-10 17:53:18,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-10 17:53:18,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-10 17:53:18,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-10 17:53:18,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-10 17:53:18,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-10 17:53:18,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-10 17:53:18,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-10 17:53:18,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-10 17:53:18,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-10 17:53:18,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-10 17:53:18,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-10 17:53:18,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-10 17:53:18,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-10 17:53:18,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-10 17:53:18,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-10 17:53:18,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-10 17:53:18,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-10 17:53:18,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-10 17:53:18,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-10 17:53:18,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-10 17:53:18,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-10 17:53:18,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-10 17:53:18,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-10 17:53:18,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-10 17:53:18,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-10 17:53:18,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-10 17:53:18,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-10 17:53:18,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-10 17:53:18,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-10 17:53:18,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-10 17:53:18,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-10 17:53:18,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-10 17:53:18,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-10 17:53:18,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-10 17:53:18,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-10 17:53:18,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-10 17:53:18,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-10 17:53:18,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-10 17:53:18,194 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020942382016124392); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03637008921421634, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020942382016124392); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013166666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04541666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-10 17:53:18,194 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-10 17:53:18,194 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.01620697851327519, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020942382016124392); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03637008921421634, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020942382016124392); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013166666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04541666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-10 17:53:18,583 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 498 ms to try 5000 different iterations.  Found a solution that moves 955 regions; Going from a computed imbalance of 0.01620697851327519 to a new imbalance of 8.417686070126646E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0073261536802473525); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009344389795537962); MoveCostFunction : (multiplier=7.0, imbalance=0.10611111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0073261536802473525); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005083333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-10 17:53:18,584 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1656393188:80 , srv1727363829:81 , srv1287929126:82 , srv1739780586:82 , srv2094237752:82 , srv2125076628:82 , srv628810468:82 , srv1070635772:83 , srv1079680857:83 , srv1795860292:83 , srv2027097289:83 , srv1101524647:84 , srv1129884553:84 , srv1342959510:84 , srv134440472:84 , srv1677511111:84 , srv1897108134:84 , srv197086098:84 , srv2010588804:84 , srv258907113:84 , srv263205972:84 , srv405326791:84 , srv544671354:84 , srv650489879:84 , srv691204228:84 , srv873414904:84 , srv1005701490:85 , srv1150122819:85 , srv1156621564:85 , srv1291758170:85 , srv1309159142:85 , srv136616685:85 , srv1426921611:85 , srv1566466822:85 , srv1613071245:85 , srv1625726576:85 , srv1650257501:85 , srv1655661014:85 , srv1811764970:85 , srv1842989942:85 , srv2041283038:85 , srv2111317943:85 , srv337906020:85 , srv371663170:85 , srv384474185:85 , srv411121183:85 , srv433588175:85 , srv498375401:85 , srv588022775:85 , srv662938551:85 , srv71274006:85 , srv747283700:85 , srv753335629:85 , srv789972759:85 , srv948086737:85 , srv960471507:85 , srv1026771975:86 , srv1093812751:86 , srv117490391:86 , srv1199129227:86 , srv1219731033:86 , srv1376027804:86 , srv1384467314:86 , srv1389379377:86 , srv1478759051:86 , srv1611268188:86 , srv1621042632:86 , srv1650369884:86 , srv1650543291:86 , srv1732313715:86 , srv1948205733:86 , srv2103357541:86 , srv290704519:86 , srv32240489:86 , srv390121692:86 , srv393998781:86 , srv440020257:86 , srv731231859:86 , srv766208286:86 , srv878196674:86 , srv1027213767:87 , srv1212205098:87 , srv1464144507:87 , srv1505154472:87 , srv1762525631:87 , srv1898511870:87 , srv1932171575:87 , srv2000862702:87 , srv2085657491:87 , srv276744346:87 , srv291537708:87 , srv374591853:87 , srv527569761:87 , srv814085191:87 , srv960924424:87 , srv994506812:88 , srv1495612263:89 , srv26262861:89 , srv963051585:89 , srv261412500:563 }
2023-12-10 17:53:18,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-10 17:53:18,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1505154472=27, srv1291758170=15, srv2085657491=55, srv2111317943=58, srv1842989942=45, srv2010588804=52, srv1611268188=29, srv878196674=94, srv588022775=81, srv1762525631=42, srv374591853=70, srv1079680857=4, srv1212205098=12, srv371663170=69, srv2041283038=54, srv1101524647=6, srv1739780586=41, srv1384467314=21, srv1650369884=34, srv789972759=91, srv960924424=97, srv1613071245=30, srv1898511870=47, srv117490391=10, srv2094237752=56, srv71274006=86, srv32240489=67, srv1026771975=1, srv258907113=60, srv498375401=78, srv544671354=80, srv197086098=50, srv384474185=71, srv1376027804=20, srv1199129227=11, srv1156621564=9, srv1655661014=36, srv1566466822=28, srv1027213767=2, srv1309159142=16, srv1948205733=49, srv290704519=65, srv390121692=72, srv1070635772=3, srv873414904=93, srv948086737=95, srv1795860292=43, srv1650543291=35, srv2103357541=57, srv1811764970=44, srv2125076628=59, srv433588175=76, srv691204228=85, srv1150122819=8, srv731231859=87, srv1093812751=5, srv1932171575=48, srv263205972=63, srv650489879=83, srv1727363829=39, srv1625726576=32, srv1287929126=14, srv994506812=99, srv1732313715=40, srv814085191=92, srv393998781=73, srv1464144507=24, srv440020257=77, srv1389379377=22, srv1478759051=25, srv1129884553=7, srv1495612263=26, srv2027097289=53, srv628810468=82, srv527569761=79, srv1342959510=17, srv1426921611=23, srv136616685=19, srv276744346=64, srv766208286=90, srv963051585=98, srv960471507=96, srv1621042632=31, srv1005701490=0, srv1656393188=37, srv291537708=66, srv1650257501=33, srv753335629=89, srv662938551=84, srv261412500=61, srv2000862702=51, srv1677511111=38, srv26262861=62, srv1897108134=46, srv747283700=88, srv1219731033=13, srv405326791=74, srv337906020=68, srv411121183=75, srv134440472=18} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-10 17:53:18,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-10 17:53:18,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-10 17:53:18,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-10 17:53:18,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-10 17:53:18,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-10 17:53:18,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-10 17:53:18,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-10 17:53:18,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-10 17:53:18,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-10 17:53:18,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-10 17:53:18,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-10 17:53:18,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-10 17:53:18,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-10 17:53:18,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-10 17:53:18,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-10 17:53:18,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-10 17:53:18,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-10 17:53:18,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-10 17:53:18,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-10 17:53:18,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-10 17:53:18,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-10 17:53:18,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-10 17:53:18,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-10 17:53:18,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-10 17:53:18,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-10 17:53:18,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-10 17:53:18,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-10 17:53:18,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-10 17:53:18,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-10 17:53:18,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-10 17:53:18,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-10 17:53:18,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-10 17:53:18,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-10 17:53:18,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-10 17:53:18,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-10 17:53:18,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-10 17:53:18,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-10 17:53:18,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-10 17:53:18,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-10 17:53:18,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-10 17:53:18,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-10 17:53:18,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-10 17:53:18,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-10 17:53:18,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-10 17:53:18,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-10 17:53:18,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-10 17:53:18,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-10 17:53:18,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-10 17:53:18,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-10 17:53:18,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-10 17:53:18,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-10 17:53:18,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-10 17:53:18,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-10 17:53:18,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-10 17:53:18,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-10 17:53:18,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-10 17:53:18,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-10 17:53:18,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-10 17:53:18,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-10 17:53:18,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-10 17:53:18,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-10 17:53:18,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-10 17:53:18,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-10 17:53:18,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-10 17:53:18,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-10 17:53:18,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-10 17:53:18,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-10 17:53:18,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-10 17:53:18,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-10 17:53:18,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-10 17:53:18,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-10 17:53:18,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-10 17:53:18,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-10 17:53:18,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-10 17:53:18,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-10 17:53:18,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-10 17:53:18,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-10 17:53:18,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-10 17:53:18,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-10 17:53:18,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-10 17:53:18,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-10 17:53:18,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-10 17:53:18,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-10 17:53:18,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-10 17:53:18,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-10 17:53:18,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-10 17:53:18,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-10 17:53:18,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-10 17:53:18,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-10 17:53:18,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-10 17:53:18,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-10 17:53:18,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-10 17:53:18,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-10 17:53:18,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-10 17:53:18,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-10 17:53:18,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-10 17:53:18,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-10 17:53:18,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-10 17:53:18,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-10 17:53:18,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-10 17:53:18,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-10 17:53:18,773 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0073261536802473525); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009344389795537962); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0073261536802473525); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005083333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-10 17:53:18,773 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-10 17:53:18,774 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=8.350815540874167E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0073261536802473525); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009344389795537962); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0073261536802473525); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005083333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-10 17:53:19,056 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 425 ms to try 5000 different iterations.  Found a solution that moves 265 regions; Going from a computed imbalance of 8.350815540874167E-4 to a new imbalance of 3.502762789633077E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.029444444444444443, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-10 17:53:19,057 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1376027804:83 , srv1478759051:83 , srv1948205733:83 , srv26262861:83 , srv766208286:83 , srv963051585:83 , srv1026771975:84 , srv1027213767:84 , srv1212205098:84 , srv1291758170:84 , srv1342959510:84 , srv136616685:84 , srv1389379377:84 , srv1464144507:84 , srv1495612263:84 , srv1566466822:84 , srv1613071245:84 , srv1621042632:84 , srv1650369884:84 , srv1732313715:84 , srv1739780586:84 , srv1762525631:84 , srv1795860292:84 , srv2027097289:84 , srv2085657491:84 , srv2103357541:84 , srv276744346:84 , srv32240489:84 , srv337906020:84 , srv393998781:84 , srv433588175:84 , srv628810468:84 , srv662938551:84 , srv691204228:84 , srv753335629:84 , srv994506812:84 , srv1005701490:85 , srv1070635772:85 , srv1079680857:85 , srv1093812751:85 , srv1129884553:85 , srv1150122819:85 , srv1156621564:85 , srv1219731033:85 , srv1287929126:85 , srv134440472:85 , srv1384467314:85 , srv1426921611:85 , srv1505154472:85 , srv1611268188:85 , srv1625726576:85 , srv1650257501:85 , srv1650543291:85 , srv1655661014:85 , srv1656393188:85 , srv1677511111:85 , srv1727363829:85 , srv1811764970:85 , srv1842989942:85 , srv1898511870:85 , srv1932171575:85 , srv197086098:85 , srv2000862702:85 , srv2010588804:85 , srv2041283038:85 , srv2094237752:85 , srv2111317943:85 , srv2125076628:85 , srv258907113:85 , srv263205972:85 , srv290704519:85 , srv291537708:85 , srv371663170:85 , srv374591853:85 , srv384474185:85 , srv390121692:85 , srv405326791:85 , srv440020257:85 , srv498375401:85 , srv527569761:85 , srv588022775:85 , srv650489879:85 , srv71274006:85 , srv747283700:85 , srv789972759:85 , srv814085191:85 , srv873414904:85 , srv878196674:85 , srv948086737:85 , srv960471507:85 , srv960924424:85 , srv1101524647:86 , srv117490391:86 , srv1199129227:86 , srv1309159142:86 , srv1897108134:86 , srv411121183:86 , srv544671354:86 , srv731231859:86 , srv261412500:619 }
2023-12-10 17:53:19,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-10 17:53:19,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1505154472=27, srv1291758170=15, srv2085657491=55, srv2111317943=58, srv1842989942=45, srv2010588804=52, srv1611268188=29, srv878196674=94, srv588022775=81, srv1762525631=42, srv374591853=70, srv1079680857=4, srv1212205098=12, srv371663170=69, srv2041283038=54, srv1101524647=6, srv1739780586=41, srv1384467314=21, srv1650369884=34, srv789972759=91, srv960924424=97, srv1613071245=30, srv1898511870=47, srv117490391=10, srv2094237752=56, srv71274006=86, srv32240489=67, srv1026771975=1, srv258907113=60, srv498375401=78, srv544671354=80, srv197086098=50, srv384474185=71, srv1376027804=20, srv1199129227=11, srv1156621564=9, srv1655661014=36, srv1566466822=28, srv1027213767=2, srv1309159142=16, srv1948205733=49, srv290704519=65, srv390121692=72, srv1070635772=3, srv873414904=93, srv948086737=95, srv1795860292=43, srv1650543291=35, srv2103357541=57, srv1811764970=44, srv2125076628=59, srv433588175=76, srv691204228=85, srv1150122819=8, srv731231859=87, srv1093812751=5, srv1932171575=48, srv263205972=63, srv650489879=83, srv1727363829=39, srv1625726576=32, srv1287929126=14, srv994506812=99, srv1732313715=40, srv814085191=92, srv393998781=73, srv1464144507=24, srv440020257=77, srv1389379377=22, srv1478759051=25, srv1129884553=7, srv1495612263=26, srv2027097289=53, srv628810468=82, srv527569761=79, srv1342959510=17, srv1426921611=23, srv136616685=19, srv276744346=64, srv766208286=90, srv963051585=98, srv960471507=96, srv1621042632=31, srv1005701490=0, srv1656393188=37, srv291537708=66, srv1650257501=33, srv753335629=89, srv662938551=84, srv261412500=61, srv2000862702=51, srv1677511111=38, srv26262861=62, srv1897108134=46, srv747283700=88, srv1219731033=13, srv405326791=74, srv337906020=68, srv411121183=75, srv134440472=18} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-10 17:53:19,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-10 17:53:19,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-10 17:53:19,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-10 17:53:19,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-10 17:53:19,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-10 17:53:19,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-10 17:53:19,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-10 17:53:19,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-10 17:53:19,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-10 17:53:19,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-10 17:53:19,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-10 17:53:19,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-10 17:53:19,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-10 17:53:19,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-10 17:53:19,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-10 17:53:19,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-10 17:53:19,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-10 17:53:19,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-10 17:53:19,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-10 17:53:19,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-10 17:53:19,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-10 17:53:19,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-10 17:53:19,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-10 17:53:19,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-10 17:53:19,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-10 17:53:19,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-10 17:53:19,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-10 17:53:19,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-10 17:53:19,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-10 17:53:19,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-10 17:53:19,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-10 17:53:19,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-10 17:53:19,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-10 17:53:19,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-10 17:53:19,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-10 17:53:19,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-10 17:53:19,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-10 17:53:19,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-10 17:53:19,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-10 17:53:19,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-10 17:53:19,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-10 17:53:19,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-10 17:53:19,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-10 17:53:19,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-10 17:53:19,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-10 17:53:19,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-10 17:53:19,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-10 17:53:19,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-10 17:53:19,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-10 17:53:19,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-10 17:53:19,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-10 17:53:19,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-10 17:53:19,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-10 17:53:19,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-10 17:53:19,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-10 17:53:19,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-10 17:53:19,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-10 17:53:19,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-10 17:53:19,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-10 17:53:19,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-10 17:53:19,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-10 17:53:19,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-10 17:53:19,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-10 17:53:19,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-10 17:53:19,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-10 17:53:19,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-10 17:53:19,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-10 17:53:19,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-10 17:53:19,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-10 17:53:19,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-10 17:53:19,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-10 17:53:19,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-10 17:53:19,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-10 17:53:19,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-10 17:53:19,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-10 17:53:19,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-10 17:53:19,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-10 17:53:19,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-10 17:53:19,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-10 17:53:19,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-10 17:53:19,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-10 17:53:19,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-10 17:53:19,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-10 17:53:19,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-10 17:53:19,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-10 17:53:19,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-10 17:53:19,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-10 17:53:19,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-10 17:53:19,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-10 17:53:19,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-10 17:53:19,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-10 17:53:19,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-10 17:53:19,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-10 17:53:19,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-10 17:53:19,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-10 17:53:19,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-10 17:53:19,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-10 17:53:19,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-10 17:53:19,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-10 17:53:19,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-10 17:53:19,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-10 17:53:19,205 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-10 17:53:19,205 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-10 17:53:19,206 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=3.317205823644519E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-10 17:53:19,466 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 365 ms to try 5000 different iterations.  Found a solution that moves 25 regions; Going from a computed imbalance of 3.317205823644519E-5 to a new imbalance of 6.919122795330589E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014982219165849825); MoveCostFunction : (multiplier=7.0, imbalance=0.002777777777777778); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-10 17:53:19,467 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1101524647:83 , srv117490391:83 , srv1199129227:83 , srv1309159142:83 , srv1505154472:83 , srv1613071245:83 , srv2000862702:83 , srv440020257:83 , srv731231859:83 , srv1005701490:84 , srv1027213767:84 , srv1070635772:84 , srv1079680857:84 , srv1093812751:84 , srv1129884553:84 , srv1150122819:84 , srv1156621564:84 , srv1212205098:84 , srv1219731033:84 , srv1287929126:84 , srv1291758170:84 , srv1342959510:84 , srv134440472:84 , srv136616685:84 , srv1384467314:84 , srv1389379377:84 , srv1426921611:84 , srv1464144507:84 , srv1495612263:84 , srv1566466822:84 , srv1611268188:84 , srv1621042632:84 , srv1625726576:84 , srv1650257501:84 , srv1650369884:84 , srv1650543291:84 , srv1655661014:84 , srv1656393188:84 , srv1677511111:84 , srv1727363829:84 , srv1739780586:84 , srv1762525631:84 , srv1795860292:84 , srv1811764970:84 , srv1842989942:84 , srv1897108134:84 , srv1898511870:84 , srv1932171575:84 , srv197086098:84 , srv2010588804:84 , srv2027097289:84 , srv2041283038:84 , srv2085657491:84 , srv2094237752:84 , srv2103357541:84 , srv2111317943:84 , srv2125076628:84 , srv258907113:84 , srv26262861:84 , srv263205972:84 , srv276744346:84 , srv290704519:84 , srv291537708:84 , srv32240489:84 , srv337906020:84 , srv371663170:84 , srv374591853:84 , srv384474185:84 , srv390121692:84 , srv405326791:84 , srv411121183:84 , srv433588175:84 , srv498375401:84 , srv527569761:84 , srv544671354:84 , srv588022775:84 , srv628810468:84 , srv650489879:84 , srv662938551:84 , srv71274006:84 , srv747283700:84 , srv766208286:84 , srv789972759:84 , srv814085191:84 , srv873414904:84 , srv878196674:84 , srv948086737:84 , srv960471507:84 , srv960924424:84 , srv963051585:84 , srv994506812:84 , srv1026771975:85 , srv1376027804:85 , srv1732313715:85 , srv1948205733:85 , srv393998781:85 , srv691204228:85 , srv753335629:85 , srv1478759051:86 , srv261412500:684 }
2023-12-10 17:53:19,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-10 17:53:19,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1505154472=27, srv1291758170=15, srv2085657491=55, srv2111317943=58, srv1842989942=45, srv2010588804=52, srv1611268188=29, srv878196674=94, srv588022775=81, srv1762525631=42, srv374591853=70, srv1079680857=4, srv1212205098=12, srv371663170=69, srv2041283038=54, srv1101524647=6, srv1739780586=41, srv1384467314=21, srv1650369884=34, srv789972759=91, srv960924424=97, srv1613071245=30, srv1898511870=47, srv117490391=10, srv2094237752=56, srv71274006=86, srv32240489=67, srv1026771975=1, srv258907113=60, srv498375401=78, srv544671354=80, srv197086098=50, srv384474185=71, srv1376027804=20, srv1199129227=11, srv1156621564=9, srv1655661014=36, srv1566466822=28, srv1027213767=2, srv1309159142=16, srv1948205733=49, srv290704519=65, srv390121692=72, srv1070635772=3, srv873414904=93, srv948086737=95, srv1795860292=43, srv1650543291=35, srv2103357541=57, srv1811764970=44, srv2125076628=59, srv433588175=76, srv691204228=85, srv1150122819=8, srv731231859=87, srv1093812751=5, srv1932171575=48, srv263205972=63, srv650489879=83, srv1727363829=39, srv1625726576=32, srv1287929126=14, srv994506812=99, srv1732313715=40, srv814085191=92, srv393998781=73, srv1464144507=24, srv440020257=77, srv1389379377=22, srv1478759051=25, srv1129884553=7, srv1495612263=26, srv2027097289=53, srv628810468=82, srv527569761=79, srv1342959510=17, srv1426921611=23, srv136616685=19, srv276744346=64, srv766208286=90, srv963051585=98, srv960471507=96, srv1621042632=31, srv1005701490=0, srv1656393188=37, srv291537708=66, srv1650257501=33, srv753335629=89, srv662938551=84, srv261412500=61, srv2000862702=51, srv1677511111=38, srv26262861=62, srv1897108134=46, srv747283700=88, srv1219731033=13, srv405326791=74, srv337906020=68, srv411121183=75, srv134440472=18} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-10 17:53:19,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-10 17:53:19,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-10 17:53:19,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-10 17:53:19,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-10 17:53:19,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-10 17:53:19,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-10 17:53:19,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-10 17:53:19,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-10 17:53:19,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-10 17:53:19,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-10 17:53:19,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-10 17:53:19,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-10 17:53:19,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-10 17:53:19,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-10 17:53:19,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-10 17:53:19,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-10 17:53:19,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-10 17:53:19,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-10 17:53:19,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-10 17:53:19,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-10 17:53:19,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-10 17:53:19,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-10 17:53:19,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-10 17:53:19,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-10 17:53:19,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-10 17:53:19,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-10 17:53:19,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-10 17:53:19,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-10 17:53:19,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-10 17:53:19,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-10 17:53:19,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-10 17:53:19,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-10 17:53:19,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-10 17:53:19,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-10 17:53:19,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-10 17:53:19,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-10 17:53:19,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-10 17:53:19,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-10 17:53:19,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-10 17:53:19,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-10 17:53:19,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-10 17:53:19,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-10 17:53:19,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-10 17:53:19,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-10 17:53:19,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-10 17:53:19,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-10 17:53:19,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-10 17:53:19,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-10 17:53:19,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-10 17:53:19,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-10 17:53:19,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-10 17:53:19,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-10 17:53:19,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-10 17:53:19,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-10 17:53:19,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-10 17:53:19,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-10 17:53:19,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-10 17:53:19,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-10 17:53:19,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-10 17:53:19,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-10 17:53:19,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-10 17:53:19,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-10 17:53:19,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-10 17:53:19,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-10 17:53:19,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-10 17:53:19,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-10 17:53:19,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-10 17:53:19,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-10 17:53:19,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-10 17:53:19,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-10 17:53:19,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-10 17:53:19,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-10 17:53:19,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-10 17:53:19,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-10 17:53:19,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-10 17:53:19,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-10 17:53:19,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-10 17:53:19,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-10 17:53:19,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-10 17:53:19,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-10 17:53:19,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-10 17:53:19,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-10 17:53:19,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-10 17:53:19,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-10 17:53:19,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-10 17:53:19,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-10 17:53:19,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-10 17:53:19,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-10 17:53:19,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-10 17:53:19,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-10 17:53:19,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-10 17:53:19,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-10 17:53:19,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-10 17:53:19,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-10 17:53:19,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-10 17:53:19,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-10 17:53:19,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-10 17:53:19,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-10 17:53:19,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-10 17:53:19,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-10 17:53:19,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-10 17:53:19,617 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=6.744069053831948E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014982219165849825); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-10 17:53:19,617 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1101524647:83 , srv117490391:83 , srv1199129227:83 , srv1309159142:83 , srv1505154472:83 , srv1613071245:83 , srv2000862702:83 , srv440020257:83 , srv731231859:83 , srv1005701490:84 , srv1027213767:84 , srv1070635772:84 , srv1079680857:84 , srv1093812751:84 , srv1129884553:84 , srv1150122819:84 , srv1156621564:84 , srv1212205098:84 , srv1219731033:84 , srv1287929126:84 , srv1291758170:84 , srv1342959510:84 , srv134440472:84 , srv136616685:84 , srv1384467314:84 , srv1389379377:84 , srv1426921611:84 , srv1464144507:84 , srv1495612263:84 , srv1566466822:84 , srv1611268188:84 , srv1621042632:84 , srv1625726576:84 , srv1650257501:84 , srv1650369884:84 , srv1650543291:84 , srv1655661014:84 , srv1656393188:84 , srv1677511111:84 , srv1727363829:84 , srv1739780586:84 , srv1762525631:84 , srv1795860292:84 , srv1811764970:84 , srv1842989942:84 , srv1897108134:84 , srv1898511870:84 , srv1932171575:84 , srv197086098:84 , srv2010588804:84 , srv2027097289:84 , srv2041283038:84 , srv2085657491:84 , srv2094237752:84 , srv2103357541:84 , srv2111317943:84 , srv2125076628:84 , srv258907113:84 , srv26262861:84 , srv263205972:84 , srv276744346:84 , srv290704519:84 , srv291537708:84 , srv32240489:84 , srv337906020:84 , srv371663170:84 , srv374591853:84 , srv384474185:84 , srv390121692:84 , srv405326791:84 , srv411121183:84 , srv433588175:84 , srv498375401:84 , srv527569761:84 , srv544671354:84 , srv588022775:84 , srv628810468:84 , srv650489879:84 , srv662938551:84 , srv71274006:84 , srv747283700:84 , srv766208286:84 , srv789972759:84 , srv814085191:84 , srv873414904:84 , srv878196674:84 , srv948086737:84 , srv960471507:84 , srv960924424:84 , srv963051585:84 , srv994506812:84 , srv1026771975:85 , srv1376027804:85 , srv1732313715:85 , srv1948205733:85 , srv393998781:85 , srv691204228:85 , srv753335629:85 , srv1478759051:86 , srv261412500:684 }
2023-12-10 17:53:19,655 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=267 (was 254) - SystemLoadAverage LEAK? -, ProcessCount=173 (was 173), AvailableMemoryMB=5714 (was 6695)
2023-12-10 17:53:19,667 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=267, ProcessCount=173, AvailableMemoryMB=5713
2023-12-10 17:53:19,668 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-12-10 17:53:19,668 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-12-10 17:53:19,689 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1036820126:84 , srv114425256:84 , srv1232562845:84 , srv1347878076:84 , srv1554382346:84 , srv1756810257:84 , srv1764234145:84 , srv1853095212:84 , srv1890118382:84 , srv1951884861:84 , srv1963083674:84 , srv2074553874:84 , srv2083844348:84 , srv2089688647:84 , srv2126725321:84 , srv222508705:84 , srv28036046:84 , srv340109207:84 , srv380919828:84 , srv43921150:84 , srv45575960:84 , srv462942263:84 , srv476652347:84 , srv481710159:84 , srv520999361:84 , srv777268284:84 , srv805802389:84 , srv866490516:84 , srv937988653:84 , srv454919024:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-12-10 17:53:19,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-10 17:53:19,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv476652347=23, srv520999361=25, srv937988653=29, srv1963083674=10, srv222508705=15, srv1347878076=3, srv805802389=27, srv481710159=24, srv1853095212=7, srv45575960=21, srv380919828=18, srv2089688647=13, srv1554382346=4, srv2074553874=11, srv777268284=26, srv28036046=16, srv2083844348=12, srv1036820126=0, srv2126725321=14, srv1951884861=9, srv462942263=22, srv1890118382=8, srv866490516=28, srv1756810257=5, srv114425256=1, srv340109207=17, srv454919024=20, srv43921150=19, srv1764234145=6, srv1232562845=2} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-10 17:53:19,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-10 17:53:19,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-10 17:53:19,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-10 17:53:19,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-10 17:53:19,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-10 17:53:19,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-10 17:53:19,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-10 17:53:19,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-10 17:53:19,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-10 17:53:19,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-10 17:53:19,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-10 17:53:19,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-10 17:53:19,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-10 17:53:19,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-10 17:53:19,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-10 17:53:19,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-10 17:53:19,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-10 17:53:19,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-10 17:53:19,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-10 17:53:19,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-10 17:53:19,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-10 17:53:19,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-10 17:53:19,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-10 17:53:19,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-10 17:53:19,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-10 17:53:19,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-10 17:53:19,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-10 17:53:19,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-10 17:53:19,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-10 17:53:19,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-10 17:53:19,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-12-10 17:53:19,746 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1688740260846668, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-10 17:53:19,746 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912725159806227, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1688740260846668, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-12-10 17:55:19,717 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6156701 different iterations.  Found a solution that moves 1857 regions; Going from a computed imbalance of 0.9912725159806227 to a new imbalance of 4.334330639506329E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6877777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-10 17:55:19,724 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1036820126:90 , srv114425256:90 , srv1232562845:90 , srv1347878076:90 , srv1554382346:90 , srv1756810257:90 , srv1764234145:90 , srv1853095212:90 , srv1890118382:90 , srv1951884861:90 , srv1963083674:90 , srv2074553874:90 , srv2083844348:90 , srv2089688647:90 , srv2126725321:90 , srv222508705:90 , srv28036046:90 , srv340109207:90 , srv380919828:90 , srv43921150:90 , srv454919024:90 , srv45575960:90 , srv462942263:90 , srv476652347:90 , srv481710159:90 , srv520999361:90 , srv777268284:90 , srv805802389:90 , srv866490516:90 , srv937988653:90 }
2023-12-10 17:55:19,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-10 17:55:19,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv476652347=23, srv520999361=25, srv937988653=29, srv1963083674=10, srv222508705=15, srv1347878076=3, srv805802389=27, srv481710159=24, srv1853095212=7, srv45575960=21, srv380919828=18, srv2089688647=13, srv1554382346=4, srv2074553874=11, srv777268284=26, srv28036046=16, srv2083844348=12, srv1036820126=0, srv2126725321=14, srv1951884861=9, srv462942263=22, srv1890118382=8, srv866490516=28, srv1756810257=5, srv114425256=1, srv340109207=17, srv454919024=20, srv43921150=19, srv1764234145=6, srv1232562845=2} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-10 17:55:19,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-10 17:55:19,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-10 17:55:19,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-10 17:55:19,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-10 17:55:19,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-10 17:55:19,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-10 17:55:19,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-10 17:55:19,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-10 17:55:19,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-10 17:55:19,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-10 17:55:19,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-10 17:55:19,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-10 17:55:19,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-10 17:55:19,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-10 17:55:19,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-10 17:55:19,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-10 17:55:19,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-10 17:55:19,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-10 17:55:19,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-10 17:55:19,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-10 17:55:19,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-10 17:55:19,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-10 17:55:19,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-10 17:55:19,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-10 17:55:19,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-10 17:55:19,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-10 17:55:19,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-10 17:55:19,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-10 17:55:19,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-10 17:55:19,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-10 17:55:19,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-12-10 17:55:19,746 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-10 17:55:19,746 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1036820126:90 , srv114425256:90 , srv1232562845:90 , srv1347878076:90 , srv1554382346:90 , srv1756810257:90 , srv1764234145:90 , srv1853095212:90 , srv1890118382:90 , srv1951884861:90 , srv1963083674:90 , srv2074553874:90 , srv2083844348:90 , srv2089688647:90 , srv2126725321:90 , srv222508705:90 , srv28036046:90 , srv340109207:90 , srv380919828:90 , srv43921150:90 , srv454919024:90 , srv45575960:90 , srv462942263:90 , srv476652347:90 , srv481710159:90 , srv520999361:90 , srv777268284:90 , srv805802389:90 , srv866490516:90 , srv937988653:90 }
2023-12-10 17:55:19,758 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=259 (was 267), ProcessCount=171 (was 173), AvailableMemoryMB=5162 (was 5713)