2023-09-29 17:53:14,537 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-09-29 17:53:14,855 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-09-29 17:53:14,973 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-09-29 17:53:15,044 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-09-29 17:53:15,051 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-09-29 17:53:15,064 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=333, ProcessCount=171, AvailableMemoryMB=3087
2023-09-29 17:53:15,066 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-09-29 17:53:15,067 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-09-29 17:53:15,217 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv100835559:84 , srv1041484276:84 , srv107393876:84 , srv1174006550:84 , srv1223095407:84 , srv1224762292:84 , srv1250786983:84 , srv1256690130:84 , srv1273941754:84 , srv1279542695:84 , srv1326920048:84 , srv1389355696:84 , srv1410196361:84 , srv1417438932:84 , srv1423158536:84 , srv143345846:84 , srv1461967080:84 , srv1463273972:84 , srv1484876710:84 , srv1489798935:84 , srv149912640:84 , srv1503850397:84 , srv155036785:84 , srv1585455614:84 , srv160142260:84 , srv1602093905:84 , srv1604370622:84 , srv1607995146:84 , srv1610616527:84 , srv1619175433:84 , srv1621101028:84 , srv1633520454:84 , srv1655698117:84 , srv1708013057:84 , srv174324205:84 , srv1776509977:84 , srv178094676:84 , srv1801196838:84 , srv1826834251:84 , srv1830452154:84 , srv1833961465:84 , srv1834292165:84 , srv1835693735:84 , srv1874992498:84 , srv1913825861:84 , srv1920547408:84 , srv1926077459:84 , srv1928604605:84 , srv1938617583:84 , srv1997311316:84 , srv2023971681:84 , srv2044786991:84 , srv2048635259:84 , srv2054315196:84 , srv2110953967:84 , srv2117600552:84 , srv236641493:84 , srv273776115:84 , srv290352704:84 , srv292931192:84 , srv293561734:84 , srv310625105:84 , srv341765640:84 , srv342579886:84 , srv352600333:84 , srv363366362:84 , srv368733197:84 , srv393175383:84 , srv415865644:84 , srv416059809:84 , srv417921098:84 , srv466345070:84 , srv486373609:84 , srv531393155:84 , srv533575365:84 , srv550945055:84 , srv557986712:84 , srv565824015:84 , srv578967377:84 , srv580583228:84 , srv595759939:84 , srv629998704:84 , srv632492173:84 , srv634101988:84 , srv645759085:84 , srv657226576:84 , srv67339893:84 , srv776071156:84 , srv803173882:84 , srv815893235:84 , srv826247368:84 , srv868169602:84 , srv894411423:84 , srv900144954:84 , srv90748941:84 , srv923531385:84 , srv929571944:84 , srv944695969:84 , srv993739576:84 , srv600449727:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-09-29 17:53:15,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-29 17:53:15,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv466345070=71, srv1928604605=47, srv1326920048=10, srv533575365=74, srv155036785=22, srv923531385=96, srv1833961465=40, srv565824015=77, srv826247368=91, srv149912640=20, srv1619175433=29, srv993739576=99, srv1835693735=42, srv236641493=56, srv900144954=94, srv550945055=75, srv160142260=24, srv578967377=78, srv632492173=83, srv629998704=82, srv645759085=85, srv2054315196=53, srv1926077459=46, srv393175383=67, srv776071156=88, srv67339893=87, srv1830452154=39, srv1997311316=49, srv531393155=73, srv2023971681=50, srv310625105=61, srv1461967080=16, srv1938617583=48, srv2110953967=54, srv1273941754=8, srv1776509977=35, srv1489798935=19, srv1174006550=3, srv1585455614=23, srv634101988=84, srv1602093905=25, srv803173882=89, srv2044786991=51, srv290352704=58, srv1607995146=27, srv1874992498=43, srv657226576=86, srv342579886=63, srv90748941=95, srv1484876710=18, srv2117600552=55, srv894411423=93, srv2048635259=52, srv1223095407=4, srv293561734=60, srv174324205=34, srv600449727=81, srv368733197=66, srv1041484276=1, srv1604370622=26, srv1834292165=41, srv416059809=69, srv1417438932=13, srv1913825861=44, srv1655698117=32, srv1633520454=31, srv363366362=65, srv1224762292=5, srv580583228=79, srv100835559=0, srv1610616527=28, srv143345846=15, srv557986712=76, srv1250786983=6, srv1503850397=21, srv352600333=64, srv107393876=2, srv815893235=90, srv1256690130=7, srv1708013057=33, srv341765640=62, srv595759939=80, srv417921098=70, srv1423158536=14, srv944695969=98, srv1389355696=11, srv1621101028=30, srv1920547408=45, srv1826834251=38, srv178094676=36, srv273776115=57, srv1801196838=37, srv868169602=92, srv292931192=59, srv415865644=68, srv1410196361=12, srv1279542695=9, srv486373609=72, srv1463273972=17, srv929571944=97} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-29 17:53:15,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-29 17:53:15,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-29 17:53:15,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-29 17:53:15,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-29 17:53:15,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-29 17:53:15,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-29 17:53:15,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-29 17:53:15,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-29 17:53:15,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-29 17:53:15,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-29 17:53:15,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-29 17:53:15,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-29 17:53:15,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-29 17:53:15,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-29 17:53:15,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-29 17:53:15,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-29 17:53:15,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-29 17:53:15,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-29 17:53:15,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-29 17:53:15,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-29 17:53:15,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-29 17:53:15,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-29 17:53:15,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-29 17:53:15,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-29 17:53:15,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-29 17:53:15,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-29 17:53:15,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-29 17:53:15,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-29 17:53:15,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-29 17:53:15,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-29 17:53:15,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-29 17:53:15,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-29 17:53:15,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-29 17:53:15,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-29 17:53:15,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-29 17:53:15,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-29 17:53:15,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-29 17:53:15,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-29 17:53:15,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-29 17:53:15,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-29 17:53:15,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-29 17:53:15,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-29 17:53:15,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-29 17:53:15,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-29 17:53:15,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-29 17:53:15,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-29 17:53:15,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-29 17:53:15,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-29 17:53:15,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-29 17:53:15,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-29 17:53:15,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-29 17:53:15,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-29 17:53:15,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-29 17:53:15,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-29 17:53:15,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-29 17:53:15,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-29 17:53:15,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-29 17:53:15,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-29 17:53:15,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-29 17:53:15,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-29 17:53:15,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-29 17:53:15,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-29 17:53:15,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-29 17:53:15,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-29 17:53:15,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-29 17:53:15,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-29 17:53:15,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-29 17:53:15,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-29 17:53:15,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-29 17:53:15,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-29 17:53:15,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-29 17:53:15,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-29 17:53:15,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-29 17:53:15,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-29 17:53:15,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-29 17:53:15,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-29 17:53:15,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-29 17:53:15,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-29 17:53:15,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-29 17:53:15,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-29 17:53:15,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-29 17:53:15,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-29 17:53:15,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-29 17:53:15,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-29 17:53:15,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-29 17:53:15,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-29 17:53:15,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-29 17:53:15,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-29 17:53:15,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-29 17:53:15,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-29 17:53:15,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-29 17:53:15,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-29 17:53:15,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-29 17:53:15,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-29 17:53:15,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-29 17:53:15,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-29 17:53:15,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-29 17:53:15,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-29 17:53:15,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-29 17:53:15,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-29 17:53:15,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-29 17:53:15,546 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-29 17:53:15,546 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-09-29 17:53:15,547 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-09-29 17:53:15,925 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 568 ms to try 5000 different iterations.  Found a solution that moves 4738 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17379389336166706. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04219770095433104, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05982015695776114, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5264444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04219770095433104, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.16925, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23233333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-29 17:53:15,944 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv90748941:79 , srv1174006550:81 , srv1223095407:81 , srv417921098:81 , srv657226576:81 , srv1326920048:82 , srv1621101028:82 , srv368733197:82 , srv868169602:82 , srv1585455614:83 , srv352600333:83 , srv595759939:83 , srv632492173:83 , srv900144954:83 , srv100835559:84 , srv107393876:84 , srv1256690130:84 , srv1484876710:84 , srv1833961465:84 , srv1835693735:84 , srv466345070:84 , srv531393155:84 , srv533575365:84 , srv580583228:84 , srv929571944:84 , srv149912640:85 , srv160142260:85 , srv1655698117:85 , srv174324205:85 , srv1826834251:85 , srv1830452154:85 , srv1926077459:85 , srv1928604605:85 , srv2110953967:85 , srv236641493:85 , srv293561734:85 , srv342579886:85 , srv393175383:85 , srv557986712:85 , srv815893235:85 , srv1279542695:86 , srv1503850397:86 , srv155036785:86 , srv1610616527:86 , srv1776509977:86 , srv1997311316:86 , srv2117600552:86 , srv363366362:86 , srv415865644:86 , srv486373609:86 , srv565824015:86 , srv67339893:86 , srv803173882:86 , srv923531385:86 , srv993739576:86 , srv1417438932:87 , srv143345846:87 , srv1489798935:87 , srv1604370622:87 , srv1633520454:87 , srv178094676:87 , srv1834292165:87 , srv1874992498:87 , srv1913825861:87 , srv273776115:87 , srv290352704:87 , srv341765640:87 , srv550945055:87 , srv578967377:87 , srv944695969:87 , srv1410196361:88 , srv1423158536:88 , srv1463273972:88 , srv1619175433:88 , srv1920547408:88 , srv2048635259:88 , srv292931192:88 , srv310625105:88 , srv416059809:88 , srv826247368:88 , srv894411423:88 , srv1250786983:89 , srv1607995146:89 , srv1938617583:89 , srv2044786991:89 , srv776071156:89 , srv1041484276:90 , srv1224762292:90 , srv1461967080:90 , srv1801196838:90 , srv634101988:90 , srv645759085:90 , srv1389355696:91 , srv2023971681:91 , srv629998704:91 , srv1273941754:92 , srv1602093905:92 , srv2054315196:92 , srv1708013057:93 , srv600449727:465 }
2023-09-29 17:53:15,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-29 17:53:15,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv466345070=71, srv1928604605=47, srv1326920048=10, srv533575365=74, srv155036785=22, srv923531385=96, srv1833961465=40, srv565824015=77, srv826247368=91, srv149912640=20, srv1619175433=29, srv993739576=99, srv1835693735=42, srv236641493=56, srv900144954=94, srv550945055=75, srv160142260=24, srv578967377=78, srv632492173=83, srv629998704=82, srv645759085=85, srv2054315196=53, srv1926077459=46, srv393175383=67, srv776071156=88, srv67339893=87, srv1830452154=39, srv1997311316=49, srv531393155=73, srv2023971681=50, srv310625105=61, srv1461967080=16, srv1938617583=48, srv2110953967=54, srv1273941754=8, srv1776509977=35, srv1489798935=19, srv1174006550=3, srv1585455614=23, srv634101988=84, srv1602093905=25, srv803173882=89, srv2044786991=51, srv290352704=58, srv1607995146=27, srv1874992498=43, srv657226576=86, srv342579886=63, srv90748941=95, srv1484876710=18, srv2117600552=55, srv894411423=93, srv2048635259=52, srv1223095407=4, srv293561734=60, srv174324205=34, srv600449727=81, srv368733197=66, srv1041484276=1, srv1604370622=26, srv1834292165=41, srv416059809=69, srv1417438932=13, srv1913825861=44, srv1655698117=32, srv1633520454=31, srv363366362=65, srv1224762292=5, srv580583228=79, srv100835559=0, srv1610616527=28, srv143345846=15, srv557986712=76, srv1250786983=6, srv1503850397=21, srv352600333=64, srv107393876=2, srv815893235=90, srv1256690130=7, srv1708013057=33, srv341765640=62, srv595759939=80, srv417921098=70, srv1423158536=14, srv944695969=98, srv1389355696=11, srv1621101028=30, srv1920547408=45, srv1826834251=38, srv178094676=36, srv273776115=57, srv1801196838=37, srv868169602=92, srv292931192=59, srv415865644=68, srv1410196361=12, srv1279542695=9, srv486373609=72, srv1463273972=17, srv929571944=97} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-29 17:53:15,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-29 17:53:15,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-29 17:53:15,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-29 17:53:15,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-29 17:53:15,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-29 17:53:15,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-29 17:53:15,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-29 17:53:15,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-29 17:53:15,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-29 17:53:15,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-29 17:53:15,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-29 17:53:15,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-29 17:53:15,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-29 17:53:15,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-29 17:53:15,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-29 17:53:15,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-29 17:53:15,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-29 17:53:15,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-29 17:53:15,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-29 17:53:15,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-29 17:53:15,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-29 17:53:15,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-29 17:53:15,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-29 17:53:15,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-29 17:53:15,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-29 17:53:15,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-29 17:53:15,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-29 17:53:15,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-29 17:53:15,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-29 17:53:15,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-29 17:53:15,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-29 17:53:15,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-29 17:53:15,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-29 17:53:15,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-29 17:53:15,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-29 17:53:15,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-29 17:53:15,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-29 17:53:15,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-29 17:53:15,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-29 17:53:15,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-29 17:53:15,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-29 17:53:15,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-29 17:53:15,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-29 17:53:15,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-29 17:53:15,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-29 17:53:15,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-29 17:53:15,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-29 17:53:15,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-29 17:53:15,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-29 17:53:15,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-29 17:53:15,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-29 17:53:15,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-29 17:53:15,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-29 17:53:15,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-29 17:53:15,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-29 17:53:15,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-29 17:53:15,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-29 17:53:15,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-29 17:53:15,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-29 17:53:15,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-29 17:53:15,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-29 17:53:15,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-29 17:53:15,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-29 17:53:15,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-29 17:53:15,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-29 17:53:15,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-29 17:53:15,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-29 17:53:15,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-29 17:53:15,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-29 17:53:15,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-29 17:53:15,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-29 17:53:15,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-29 17:53:15,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-29 17:53:15,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-29 17:53:15,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-29 17:53:15,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-29 17:53:15,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-29 17:53:15,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-29 17:53:15,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-29 17:53:15,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-29 17:53:15,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-29 17:53:15,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-29 17:53:15,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-29 17:53:15,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-29 17:53:15,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-29 17:53:15,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-29 17:53:15,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-29 17:53:15,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-29 17:53:15,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-29 17:53:15,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-29 17:53:15,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-29 17:53:15,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-29 17:53:15,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-29 17:53:15,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-29 17:53:15,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-29 17:53:15,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-29 17:53:15,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-29 17:53:15,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-29 17:53:15,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-29 17:53:15,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-29 17:53:15,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-29 17:53:16,178 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04219770095433104, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05982015695776114, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04219770095433104, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.16925, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23233333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-29 17:53:16,178 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-09-29 17:53:16,179 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.1737607171765782, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04219770095433104, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05982015695776114, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04219770095433104, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.16925, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23233333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-09-29 17:53:16,609 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 583 ms to try 5000 different iterations.  Found a solution that moves 2600 regions; Going from a computed imbalance of 0.1737607171765782 to a new imbalance of 0.015353127050093176. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.025756057260316604, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.037488494306749706, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.28888888888888886, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.025756057260316604, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012666666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04041666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-29 17:53:16,623 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1708013057:77 , srv1602093905:79 , srv1041484276:80 , srv2054315196:80 , srv629998704:80 , srv645759085:80 , srv1273941754:81 , srv1801196838:81 , srv2023971681:81 , srv634101988:81 , srv776071156:81 , srv1224762292:82 , srv1607995146:82 , srv1938617583:82 , srv2044786991:82 , srv292931192:82 , srv826247368:82 , srv894411423:82 , srv1389355696:83 , srv1417438932:83 , srv1423158536:83 , srv143345846:83 , srv1461967080:83 , srv1619175433:83 , srv1913825861:83 , srv1928604605:83 , srv1250786983:84 , srv1410196361:84 , srv1489798935:84 , srv1633520454:84 , srv1776509977:84 , srv2048635259:84 , srv310625105:84 , srv341765640:84 , srv486373609:84 , srv550945055:84 , srv578967377:84 , srv1463273972:85 , srv1604370622:85 , srv1655698117:85 , srv178094676:85 , srv1834292165:85 , srv1926077459:85 , srv1997311316:85 , srv2110953967:85 , srv290352704:85 , srv342579886:85 , srv363366362:85 , srv415865644:85 , srv533575365:85 , srv557986712:85 , srv944695969:85 , srv107393876:86 , srv1610616527:86 , srv174324205:86 , srv1874992498:86 , srv2117600552:86 , srv236641493:86 , srv293561734:86 , srv416059809:86 , srv67339893:86 , srv923531385:86 , srv993739576:86 , srv1256690130:87 , srv1279542695:87 , srv1484876710:87 , srv155036785:87 , srv1621101028:87 , srv1830452154:87 , srv1835693735:87 , srv273776115:87 , srv580583228:87 , srv632492173:87 , srv815893235:87 , srv100835559:88 , srv1503850397:88 , srv1585455614:88 , srv1920547408:88 , srv352600333:88 , srv531393155:88 , srv149912640:89 , srv1826834251:89 , srv1833961465:89 , srv368733197:89 , srv393175383:89 , srv565824015:89 , srv595759939:89 , srv803173882:89 , srv160142260:90 , srv466345070:90 , srv868169602:90 , srv929571944:90 , srv1223095407:91 , srv1326920048:91 , srv657226576:91 , srv900144954:91 , srv417921098:92 , srv90748941:92 , srv1174006550:93 , srv600449727:538 }
2023-09-29 17:53:16,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-29 17:53:16,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv466345070=71, srv1928604605=47, srv1326920048=10, srv533575365=74, srv155036785=22, srv923531385=96, srv1833961465=40, srv565824015=77, srv826247368=91, srv149912640=20, srv1619175433=29, srv993739576=99, srv1835693735=42, srv236641493=56, srv900144954=94, srv550945055=75, srv160142260=24, srv578967377=78, srv632492173=83, srv629998704=82, srv645759085=85, srv2054315196=53, srv1926077459=46, srv393175383=67, srv776071156=88, srv67339893=87, srv1830452154=39, srv1997311316=49, srv531393155=73, srv2023971681=50, srv310625105=61, srv1461967080=16, srv1938617583=48, srv2110953967=54, srv1273941754=8, srv1776509977=35, srv1489798935=19, srv1174006550=3, srv1585455614=23, srv634101988=84, srv1602093905=25, srv803173882=89, srv2044786991=51, srv290352704=58, srv1607995146=27, srv1874992498=43, srv657226576=86, srv342579886=63, srv90748941=95, srv1484876710=18, srv2117600552=55, srv894411423=93, srv2048635259=52, srv1223095407=4, srv293561734=60, srv174324205=34, srv600449727=81, srv368733197=66, srv1041484276=1, srv1604370622=26, srv1834292165=41, srv416059809=69, srv1417438932=13, srv1913825861=44, srv1655698117=32, srv1633520454=31, srv363366362=65, srv1224762292=5, srv580583228=79, srv100835559=0, srv1610616527=28, srv143345846=15, srv557986712=76, srv1250786983=6, srv1503850397=21, srv352600333=64, srv107393876=2, srv815893235=90, srv1256690130=7, srv1708013057=33, srv341765640=62, srv595759939=80, srv417921098=70, srv1423158536=14, srv944695969=98, srv1389355696=11, srv1621101028=30, srv1920547408=45, srv1826834251=38, srv178094676=36, srv273776115=57, srv1801196838=37, srv868169602=92, srv292931192=59, srv415865644=68, srv1410196361=12, srv1279542695=9, srv486373609=72, srv1463273972=17, srv929571944=97} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-29 17:53:16,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-29 17:53:16,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-29 17:53:16,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-29 17:53:16,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-29 17:53:16,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-29 17:53:16,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-29 17:53:16,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-29 17:53:16,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-29 17:53:16,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-29 17:53:16,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-29 17:53:16,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-29 17:53:16,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-29 17:53:16,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-29 17:53:16,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-29 17:53:16,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-29 17:53:16,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-29 17:53:16,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-29 17:53:16,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-29 17:53:16,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-29 17:53:16,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-29 17:53:16,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-29 17:53:16,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-29 17:53:16,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-29 17:53:16,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-29 17:53:16,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-29 17:53:16,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-29 17:53:16,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-29 17:53:16,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-29 17:53:16,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-29 17:53:16,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-29 17:53:16,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-29 17:53:16,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-29 17:53:16,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-29 17:53:16,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-29 17:53:16,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-29 17:53:16,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-29 17:53:16,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-29 17:53:16,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-29 17:53:16,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-29 17:53:16,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-29 17:53:16,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-29 17:53:16,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-29 17:53:16,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-29 17:53:16,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-29 17:53:16,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-29 17:53:16,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-29 17:53:16,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-29 17:53:16,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-29 17:53:16,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-29 17:53:16,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-29 17:53:16,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-29 17:53:16,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-29 17:53:16,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-29 17:53:16,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-29 17:53:16,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-29 17:53:16,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-29 17:53:16,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-29 17:53:16,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-29 17:53:16,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-29 17:53:16,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-29 17:53:16,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-29 17:53:16,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-29 17:53:16,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-29 17:53:16,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-29 17:53:16,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-29 17:53:16,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-29 17:53:16,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-29 17:53:16,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-29 17:53:16,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-29 17:53:16,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-29 17:53:16,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-29 17:53:16,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-29 17:53:16,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-29 17:53:16,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-29 17:53:16,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-29 17:53:16,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-29 17:53:16,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-29 17:53:16,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-29 17:53:16,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-29 17:53:16,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-29 17:53:16,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-29 17:53:16,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-29 17:53:16,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-29 17:53:16,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-29 17:53:16,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-29 17:53:16,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-29 17:53:16,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-29 17:53:16,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-29 17:53:16,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-29 17:53:16,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-29 17:53:16,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-29 17:53:16,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-29 17:53:16,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-29 17:53:16,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-29 17:53:16,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-29 17:53:16,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-29 17:53:16,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-29 17:53:16,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-29 17:53:16,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-29 17:53:16,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-29 17:53:16,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-29 17:53:16,835 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.025756057260316604, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.037488494306749706, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.025756057260316604, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012666666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04041666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-29 17:53:16,835 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-09-29 17:53:16,835 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.01533492146097732, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.025756057260316604, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.037488494306749706, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.025756057260316604, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012666666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04041666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-09-29 17:53:17,188 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 492 ms to try 5000 different iterations.  Found a solution that moves 951 regions; Going from a computed imbalance of 0.01533492146097732 to a new imbalance of 6.858071527410119E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009129733780762418); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00943998706461097); MoveCostFunction : (multiplier=7.0, imbalance=0.10566666666666667, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.009129733780762418); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004916666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-29 17:53:17,191 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1920547408:80 , srv1389355696:82 , srv1826834251:82 , srv565824015:82 , srv1503850397:83 , srv160142260:83 , srv393175383:83 , srv416059809:83 , srv466345070:83 , srv803173882:83 , srv900144954:83 , srv1174006550:84 , srv1250786983:84 , srv1273941754:84 , srv1279542695:84 , srv1461967080:84 , srv1463273972:84 , srv178094676:84 , srv1830452154:84 , srv1834292165:84 , srv2048635259:84 , srv273776115:84 , srv929571944:84 , srv993739576:84 , srv1223095407:85 , srv1224762292:85 , srv1326920048:85 , srv1410196361:85 , srv149912640:85 , srv155036785:85 , srv1604370622:85 , srv1607995146:85 , srv1619175433:85 , srv1801196838:85 , srv1833961465:85 , srv1835693735:85 , srv1874992498:85 , srv2023971681:85 , srv2054315196:85 , srv310625105:85 , srv368733197:85 , srv417921098:85 , srv531393155:85 , srv595759939:85 , srv894411423:85 , srv923531385:85 , srv100835559:86 , srv1041484276:86 , srv1256690130:86 , srv1423158536:86 , srv1489798935:86 , srv1610616527:86 , srv174324205:86 , srv2044786991:86 , srv2110953967:86 , srv2117600552:86 , srv236641493:86 , srv290352704:86 , srv341765640:86 , srv363366362:86 , srv550945055:86 , srv578967377:86 , srv629998704:86 , srv632492173:86 , srv634101988:86 , srv67339893:86 , srv815893235:86 , srv868169602:86 , srv90748941:86 , srv944695969:86 , srv1417438932:87 , srv143345846:87 , srv1484876710:87 , srv1585455614:87 , srv1602093905:87 , srv1633520454:87 , srv1655698117:87 , srv1708013057:87 , srv1776509977:87 , srv1913825861:87 , srv1926077459:87 , srv1938617583:87 , srv1997311316:87 , srv293561734:87 , srv342579886:87 , srv352600333:87 , srv415865644:87 , srv486373609:87 , srv557986712:87 , srv580583228:87 , srv645759085:87 , srv657226576:87 , srv826247368:87 , srv107393876:88 , srv292931192:88 , srv533575365:88 , srv776071156:88 , srv1621101028:89 , srv1928604605:89 , srv600449727:536 }
2023-09-29 17:53:17,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-29 17:53:17,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv466345070=71, srv1928604605=47, srv1326920048=10, srv533575365=74, srv155036785=22, srv923531385=96, srv1833961465=40, srv565824015=77, srv826247368=91, srv149912640=20, srv1619175433=29, srv993739576=99, srv1835693735=42, srv236641493=56, srv900144954=94, srv550945055=75, srv160142260=24, srv578967377=78, srv632492173=83, srv629998704=82, srv645759085=85, srv2054315196=53, srv1926077459=46, srv393175383=67, srv776071156=88, srv67339893=87, srv1830452154=39, srv1997311316=49, srv531393155=73, srv2023971681=50, srv310625105=61, srv1461967080=16, srv1938617583=48, srv2110953967=54, srv1273941754=8, srv1776509977=35, srv1489798935=19, srv1174006550=3, srv1585455614=23, srv634101988=84, srv1602093905=25, srv803173882=89, srv2044786991=51, srv290352704=58, srv1607995146=27, srv1874992498=43, srv657226576=86, srv342579886=63, srv90748941=95, srv1484876710=18, srv2117600552=55, srv894411423=93, srv2048635259=52, srv1223095407=4, srv293561734=60, srv174324205=34, srv600449727=81, srv368733197=66, srv1041484276=1, srv1604370622=26, srv1834292165=41, srv416059809=69, srv1417438932=13, srv1913825861=44, srv1655698117=32, srv1633520454=31, srv363366362=65, srv1224762292=5, srv580583228=79, srv100835559=0, srv1610616527=28, srv143345846=15, srv557986712=76, srv1250786983=6, srv1503850397=21, srv352600333=64, srv107393876=2, srv815893235=90, srv1256690130=7, srv1708013057=33, srv341765640=62, srv595759939=80, srv417921098=70, srv1423158536=14, srv944695969=98, srv1389355696=11, srv1621101028=30, srv1920547408=45, srv1826834251=38, srv178094676=36, srv273776115=57, srv1801196838=37, srv868169602=92, srv292931192=59, srv415865644=68, srv1410196361=12, srv1279542695=9, srv486373609=72, srv1463273972=17, srv929571944=97} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-29 17:53:17,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-29 17:53:17,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-29 17:53:17,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-29 17:53:17,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-29 17:53:17,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-29 17:53:17,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-29 17:53:17,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-29 17:53:17,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-29 17:53:17,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-29 17:53:17,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-29 17:53:17,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-29 17:53:17,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-29 17:53:17,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-29 17:53:17,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-29 17:53:17,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-29 17:53:17,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-29 17:53:17,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-29 17:53:17,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-29 17:53:17,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-29 17:53:17,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-29 17:53:17,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-29 17:53:17,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-29 17:53:17,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-29 17:53:17,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-29 17:53:17,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-29 17:53:17,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-29 17:53:17,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-29 17:53:17,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-29 17:53:17,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-29 17:53:17,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-29 17:53:17,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-29 17:53:17,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-29 17:53:17,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-29 17:53:17,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-29 17:53:17,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-29 17:53:17,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-29 17:53:17,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-29 17:53:17,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-29 17:53:17,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-29 17:53:17,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-29 17:53:17,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-29 17:53:17,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-29 17:53:17,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-29 17:53:17,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-29 17:53:17,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-29 17:53:17,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-29 17:53:17,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-29 17:53:17,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-29 17:53:17,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-29 17:53:17,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-29 17:53:17,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-29 17:53:17,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-29 17:53:17,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-29 17:53:17,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-29 17:53:17,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-29 17:53:17,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-29 17:53:17,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-29 17:53:17,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-29 17:53:17,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-29 17:53:17,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-29 17:53:17,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-29 17:53:17,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-29 17:53:17,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-29 17:53:17,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-29 17:53:17,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-29 17:53:17,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-29 17:53:17,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-29 17:53:17,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-29 17:53:17,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-29 17:53:17,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-29 17:53:17,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-29 17:53:17,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-29 17:53:17,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-29 17:53:17,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-29 17:53:17,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-29 17:53:17,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-29 17:53:17,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-29 17:53:17,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-29 17:53:17,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-29 17:53:17,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-29 17:53:17,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-29 17:53:17,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-29 17:53:17,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-29 17:53:17,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-29 17:53:17,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-29 17:53:17,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-29 17:53:17,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-29 17:53:17,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-29 17:53:17,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-29 17:53:17,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-29 17:53:17,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-29 17:53:17,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-29 17:53:17,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-29 17:53:17,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-29 17:53:17,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-29 17:53:17,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-29 17:53:17,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-29 17:53:17,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-29 17:53:17,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-29 17:53:17,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-29 17:53:17,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-29 17:53:17,383 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009129733780762418); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00943998706461097); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.009129733780762418); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004916666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-29 17:53:17,383 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-09-29 17:53:17,383 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=6.791481084144036E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009129733780762418); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00943998706461097); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.009129733780762418); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004916666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-09-29 17:53:17,683 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 413 ms to try 5000 different iterations.  Found a solution that moves 316 regions; Going from a computed imbalance of 6.791481084144036E-4 to a new imbalance of 4.439441288416908E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.470732932414788E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002118805753879094); MoveCostFunction : (multiplier=7.0, imbalance=0.035111111111111114, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.470732932414788E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-29 17:53:17,684 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv149912640:82 , srv293561734:83 , srv657226576:83 , srv100835559:84 , srv107393876:84 , srv1174006550:84 , srv1224762292:84 , srv1326920048:84 , srv143345846:84 , srv1484876710:84 , srv155036785:84 , srv1585455614:84 , srv1610616527:84 , srv1621101028:84 , srv1633520454:84 , srv1833961465:84 , srv1874992498:84 , srv1997311316:84 , srv2117600552:84 , srv273776115:84 , srv290352704:84 , srv292931192:84 , srv352600333:84 , srv415865644:84 , srv417921098:84 , srv531393155:84 , srv550945055:84 , srv67339893:84 , srv776071156:84 , srv803173882:84 , srv868169602:84 , srv90748941:84 , srv929571944:84 , srv944695969:84 , srv1223095407:85 , srv1279542695:85 , srv1410196361:85 , srv1417438932:85 , srv1423158536:85 , srv1461967080:85 , srv1463273972:85 , srv1489798935:85 , srv1503850397:85 , srv160142260:85 , srv1602093905:85 , srv1604370622:85 , srv1619175433:85 , srv1708013057:85 , srv174324205:85 , srv1776509977:85 , srv178094676:85 , srv1826834251:85 , srv1830452154:85 , srv1913825861:85 , srv1926077459:85 , srv1928604605:85 , srv1938617583:85 , srv2023971681:85 , srv2054315196:85 , srv236641493:85 , srv310625105:85 , srv341765640:85 , srv342579886:85 , srv363366362:85 , srv393175383:85 , srv416059809:85 , srv466345070:85 , srv486373609:85 , srv533575365:85 , srv557986712:85 , srv565824015:85 , srv578967377:85 , srv580583228:85 , srv595759939:85 , srv629998704:85 , srv632492173:85 , srv645759085:85 , srv815893235:85 , srv900144954:85 , srv923531385:85 , srv1041484276:86 , srv1250786983:86 , srv1256690130:86 , srv1273941754:86 , srv1389355696:86 , srv1607995146:86 , srv1655698117:86 , srv1801196838:86 , srv1834292165:86 , srv1835693735:86 , srv1920547408:86 , srv2044786991:86 , srv2048635259:86 , srv2110953967:86 , srv368733197:86 , srv634101988:86 , srv826247368:86 , srv993739576:86 , srv894411423:87 , srv600449727:603 }
2023-09-29 17:53:17,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-29 17:53:17,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv466345070=71, srv1928604605=47, srv1326920048=10, srv533575365=74, srv155036785=22, srv923531385=96, srv1833961465=40, srv565824015=77, srv826247368=91, srv149912640=20, srv1619175433=29, srv993739576=99, srv1835693735=42, srv236641493=56, srv900144954=94, srv550945055=75, srv160142260=24, srv578967377=78, srv632492173=83, srv629998704=82, srv645759085=85, srv2054315196=53, srv1926077459=46, srv393175383=67, srv776071156=88, srv67339893=87, srv1830452154=39, srv1997311316=49, srv531393155=73, srv2023971681=50, srv310625105=61, srv1461967080=16, srv1938617583=48, srv2110953967=54, srv1273941754=8, srv1776509977=35, srv1489798935=19, srv1174006550=3, srv1585455614=23, srv634101988=84, srv1602093905=25, srv803173882=89, srv2044786991=51, srv290352704=58, srv1607995146=27, srv1874992498=43, srv657226576=86, srv342579886=63, srv90748941=95, srv1484876710=18, srv2117600552=55, srv894411423=93, srv2048635259=52, srv1223095407=4, srv293561734=60, srv174324205=34, srv600449727=81, srv368733197=66, srv1041484276=1, srv1604370622=26, srv1834292165=41, srv416059809=69, srv1417438932=13, srv1913825861=44, srv1655698117=32, srv1633520454=31, srv363366362=65, srv1224762292=5, srv580583228=79, srv100835559=0, srv1610616527=28, srv143345846=15, srv557986712=76, srv1250786983=6, srv1503850397=21, srv352600333=64, srv107393876=2, srv815893235=90, srv1256690130=7, srv1708013057=33, srv341765640=62, srv595759939=80, srv417921098=70, srv1423158536=14, srv944695969=98, srv1389355696=11, srv1621101028=30, srv1920547408=45, srv1826834251=38, srv178094676=36, srv273776115=57, srv1801196838=37, srv868169602=92, srv292931192=59, srv415865644=68, srv1410196361=12, srv1279542695=9, srv486373609=72, srv1463273972=17, srv929571944=97} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-29 17:53:17,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-29 17:53:17,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-29 17:53:17,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-29 17:53:17,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-29 17:53:17,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-29 17:53:17,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-29 17:53:17,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-29 17:53:17,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-29 17:53:17,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-29 17:53:17,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-29 17:53:17,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-29 17:53:17,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-29 17:53:17,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-29 17:53:17,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-29 17:53:17,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-29 17:53:17,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-29 17:53:17,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-29 17:53:17,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-29 17:53:17,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-29 17:53:17,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-29 17:53:17,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-29 17:53:17,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-29 17:53:17,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-29 17:53:17,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-29 17:53:17,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-29 17:53:17,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-29 17:53:17,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-29 17:53:17,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-29 17:53:17,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-29 17:53:17,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-29 17:53:17,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-29 17:53:17,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-29 17:53:17,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-29 17:53:17,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-29 17:53:17,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-29 17:53:17,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-29 17:53:17,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-29 17:53:17,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-29 17:53:17,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-29 17:53:17,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-29 17:53:17,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-29 17:53:17,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-29 17:53:17,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-29 17:53:17,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-29 17:53:17,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-29 17:53:17,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-29 17:53:17,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-29 17:53:17,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-29 17:53:17,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-29 17:53:17,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-29 17:53:17,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-29 17:53:17,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-29 17:53:17,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-29 17:53:17,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-29 17:53:17,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-29 17:53:17,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-29 17:53:17,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-29 17:53:17,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-29 17:53:17,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-29 17:53:17,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-29 17:53:17,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-29 17:53:17,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-29 17:53:17,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-29 17:53:17,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-29 17:53:17,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-29 17:53:17,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-29 17:53:17,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-29 17:53:17,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-29 17:53:17,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-29 17:53:17,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-29 17:53:17,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-29 17:53:17,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-29 17:53:17,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-29 17:53:17,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-29 17:53:17,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-29 17:53:17,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-29 17:53:17,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-29 17:53:17,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-29 17:53:17,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-29 17:53:17,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-29 17:53:17,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-29 17:53:17,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-29 17:53:17,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-29 17:53:17,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-29 17:53:17,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-29 17:53:17,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-29 17:53:17,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-29 17:53:17,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-29 17:53:17,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-29 17:53:17,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-29 17:53:17,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-29 17:53:17,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-29 17:53:17,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-29 17:53:17,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-29 17:53:17,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-29 17:53:17,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-29 17:53:17,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-29 17:53:17,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-29 17:53:17,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-29 17:53:17,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-29 17:53:17,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-29 17:53:17,812 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.470732932414788E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002118805753879094); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.470732932414788E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-29 17:53:17,812 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-09-29 17:53:17,813 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=4.2181733591626276E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.470732932414788E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002118805753879094); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.470732932414788E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-09-29 17:53:18,031 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 314 ms to try 5000 different iterations.  Found a solution that moves 46 regions; Going from a computed imbalance of 4.2181733591626276E-5 to a new imbalance of 6.3541776240858665E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0013400504203456161); MoveCostFunction : (multiplier=7.0, imbalance=0.005111111111111111); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-29 17:53:18,032 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1250786983:83 , srv1256690130:83 , srv1273941754:83 , srv160142260:83 , srv1602093905:83 , srv1655698117:83 , srv1938617583:83 , srv2044786991:83 , srv580583228:83 , srv634101988:83 , srv815893235:83 , srv826247368:83 , srv100835559:84 , srv1041484276:84 , srv107393876:84 , srv1174006550:84 , srv1223095407:84 , srv1279542695:84 , srv1326920048:84 , srv1389355696:84 , srv1410196361:84 , srv1417438932:84 , srv1423158536:84 , srv1461967080:84 , srv1463273972:84 , srv1484876710:84 , srv1489798935:84 , srv1503850397:84 , srv155036785:84 , srv1585455614:84 , srv1604370622:84 , srv1607995146:84 , srv1610616527:84 , srv1621101028:84 , srv1633520454:84 , srv1708013057:84 , srv174324205:84 , srv1776509977:84 , srv1801196838:84 , srv1833961465:84 , srv1834292165:84 , srv1835693735:84 , srv1874992498:84 , srv1913825861:84 , srv1920547408:84 , srv1926077459:84 , srv1928604605:84 , srv1997311316:84 , srv2023971681:84 , srv2048635259:84 , srv2054315196:84 , srv2110953967:84 , srv2117600552:84 , srv236641493:84 , srv273776115:84 , srv290352704:84 , srv292931192:84 , srv310625105:84 , srv341765640:84 , srv342579886:84 , srv352600333:84 , srv363366362:84 , srv368733197:84 , srv393175383:84 , srv415865644:84 , srv416059809:84 , srv417921098:84 , srv466345070:84 , srv486373609:84 , srv533575365:84 , srv557986712:84 , srv565824015:84 , srv578967377:84 , srv595759939:84 , srv629998704:84 , srv645759085:84 , srv657226576:84 , srv67339893:84 , srv776071156:84 , srv803173882:84 , srv868169602:84 , srv894411423:84 , srv900144954:84 , srv923531385:84 , srv929571944:84 , srv944695969:84 , srv993739576:84 , srv1224762292:85 , srv143345846:85 , srv149912640:85 , srv1619175433:85 , srv178094676:85 , srv1826834251:85 , srv1830452154:85 , srv293561734:85 , srv531393155:85 , srv550945055:85 , srv632492173:85 , srv90748941:85 , srv600449727:684 }
2023-09-29 17:53:18,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-29 17:53:18,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv466345070=71, srv1928604605=47, srv1326920048=10, srv533575365=74, srv155036785=22, srv923531385=96, srv1833961465=40, srv565824015=77, srv826247368=91, srv149912640=20, srv1619175433=29, srv993739576=99, srv1835693735=42, srv236641493=56, srv900144954=94, srv550945055=75, srv160142260=24, srv578967377=78, srv632492173=83, srv629998704=82, srv645759085=85, srv2054315196=53, srv1926077459=46, srv393175383=67, srv776071156=88, srv67339893=87, srv1830452154=39, srv1997311316=49, srv531393155=73, srv2023971681=50, srv310625105=61, srv1461967080=16, srv1938617583=48, srv2110953967=54, srv1273941754=8, srv1776509977=35, srv1489798935=19, srv1174006550=3, srv1585455614=23, srv634101988=84, srv1602093905=25, srv803173882=89, srv2044786991=51, srv290352704=58, srv1607995146=27, srv1874992498=43, srv657226576=86, srv342579886=63, srv90748941=95, srv1484876710=18, srv2117600552=55, srv894411423=93, srv2048635259=52, srv1223095407=4, srv293561734=60, srv174324205=34, srv600449727=81, srv368733197=66, srv1041484276=1, srv1604370622=26, srv1834292165=41, srv416059809=69, srv1417438932=13, srv1913825861=44, srv1655698117=32, srv1633520454=31, srv363366362=65, srv1224762292=5, srv580583228=79, srv100835559=0, srv1610616527=28, srv143345846=15, srv557986712=76, srv1250786983=6, srv1503850397=21, srv352600333=64, srv107393876=2, srv815893235=90, srv1256690130=7, srv1708013057=33, srv341765640=62, srv595759939=80, srv417921098=70, srv1423158536=14, srv944695969=98, srv1389355696=11, srv1621101028=30, srv1920547408=45, srv1826834251=38, srv178094676=36, srv273776115=57, srv1801196838=37, srv868169602=92, srv292931192=59, srv415865644=68, srv1410196361=12, srv1279542695=9, srv486373609=72, srv1463273972=17, srv929571944=97} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-29 17:53:18,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-29 17:53:18,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-29 17:53:18,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-29 17:53:18,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-29 17:53:18,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-29 17:53:18,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-29 17:53:18,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-29 17:53:18,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-29 17:53:18,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-29 17:53:18,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-29 17:53:18,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-29 17:53:18,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-29 17:53:18,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-29 17:53:18,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-29 17:53:18,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-29 17:53:18,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-29 17:53:18,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-29 17:53:18,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-29 17:53:18,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-29 17:53:18,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-29 17:53:18,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-29 17:53:18,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-29 17:53:18,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-29 17:53:18,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-29 17:53:18,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-29 17:53:18,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-29 17:53:18,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-29 17:53:18,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-29 17:53:18,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-29 17:53:18,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-29 17:53:18,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-29 17:53:18,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-29 17:53:18,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-29 17:53:18,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-29 17:53:18,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-29 17:53:18,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-29 17:53:18,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-29 17:53:18,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-29 17:53:18,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-29 17:53:18,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-29 17:53:18,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-29 17:53:18,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-29 17:53:18,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-29 17:53:18,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-29 17:53:18,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-29 17:53:18,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-29 17:53:18,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-29 17:53:18,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-29 17:53:18,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-29 17:53:18,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-29 17:53:18,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-29 17:53:18,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-29 17:53:18,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-29 17:53:18,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-29 17:53:18,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-29 17:53:18,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-29 17:53:18,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-29 17:53:18,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-29 17:53:18,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-29 17:53:18,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-29 17:53:18,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-29 17:53:18,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-29 17:53:18,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-29 17:53:18,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-29 17:53:18,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-29 17:53:18,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-29 17:53:18,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-29 17:53:18,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-29 17:53:18,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-29 17:53:18,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-29 17:53:18,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-29 17:53:18,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-29 17:53:18,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-29 17:53:18,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-29 17:53:18,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-29 17:53:18,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-29 17:53:18,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-29 17:53:18,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-29 17:53:18,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-29 17:53:18,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-29 17:53:18,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-29 17:53:18,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-29 17:53:18,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-29 17:53:18,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-29 17:53:18,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-29 17:53:18,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-29 17:53:18,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-29 17:53:18,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-29 17:53:18,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-29 17:53:18,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-29 17:53:18,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-29 17:53:18,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-29 17:53:18,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-29 17:53:18,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-29 17:53:18,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-29 17:53:18,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-29 17:53:18,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-29 17:53:18,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-29 17:53:18,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-29 17:53:18,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-29 17:53:18,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-29 17:53:18,162 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=6.032078739728369E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0013400504203456161); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-29 17:53:18,163 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1250786983:83 , srv1256690130:83 , srv1273941754:83 , srv160142260:83 , srv1602093905:83 , srv1655698117:83 , srv1938617583:83 , srv2044786991:83 , srv580583228:83 , srv634101988:83 , srv815893235:83 , srv826247368:83 , srv100835559:84 , srv1041484276:84 , srv107393876:84 , srv1174006550:84 , srv1223095407:84 , srv1279542695:84 , srv1326920048:84 , srv1389355696:84 , srv1410196361:84 , srv1417438932:84 , srv1423158536:84 , srv1461967080:84 , srv1463273972:84 , srv1484876710:84 , srv1489798935:84 , srv1503850397:84 , srv155036785:84 , srv1585455614:84 , srv1604370622:84 , srv1607995146:84 , srv1610616527:84 , srv1621101028:84 , srv1633520454:84 , srv1708013057:84 , srv174324205:84 , srv1776509977:84 , srv1801196838:84 , srv1833961465:84 , srv1834292165:84 , srv1835693735:84 , srv1874992498:84 , srv1913825861:84 , srv1920547408:84 , srv1926077459:84 , srv1928604605:84 , srv1997311316:84 , srv2023971681:84 , srv2048635259:84 , srv2054315196:84 , srv2110953967:84 , srv2117600552:84 , srv236641493:84 , srv273776115:84 , srv290352704:84 , srv292931192:84 , srv310625105:84 , srv341765640:84 , srv342579886:84 , srv352600333:84 , srv363366362:84 , srv368733197:84 , srv393175383:84 , srv415865644:84 , srv416059809:84 , srv417921098:84 , srv466345070:84 , srv486373609:84 , srv533575365:84 , srv557986712:84 , srv565824015:84 , srv578967377:84 , srv595759939:84 , srv629998704:84 , srv645759085:84 , srv657226576:84 , srv67339893:84 , srv776071156:84 , srv803173882:84 , srv868169602:84 , srv894411423:84 , srv900144954:84 , srv923531385:84 , srv929571944:84 , srv944695969:84 , srv993739576:84 , srv1224762292:85 , srv143345846:85 , srv149912640:85 , srv1619175433:85 , srv178094676:85 , srv1826834251:85 , srv1830452154:85 , srv293561734:85 , srv531393155:85 , srv550945055:85 , srv632492173:85 , srv90748941:85 , srv600449727:684 }
2023-09-29 17:53:18,190 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=363 (was 333) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 171), AvailableMemoryMB=2476 (was 3087)
2023-09-29 17:53:18,199 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=363, ProcessCount=171, AvailableMemoryMB=2475
2023-09-29 17:53:18,199 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-09-29 17:53:18,200 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-09-29 17:53:18,209 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1034526553:84 , srv1060642690:84 , srv1266342406:84 , srv1270720590:84 , srv1380508430:84 , srv1389392964:84 , srv1410792346:84 , srv1536787582:84 , srv1714014404:84 , srv1775432372:84 , srv1801160634:84 , srv1949285678:84 , srv1968776181:84 , srv2140884160:84 , srv234434430:84 , srv286605007:84 , srv321155752:84 , srv341521388:84 , srv360742523:84 , srv435464566:84 , srv511607598:84 , srv595379035:84 , srv645120139:84 , srv716383482:84 , srv727470919:84 , srv783095030:84 , srv823245929:84 , srv854668812:84 , srv972374313:84 , srv1108977562:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-09-29 17:53:18,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-29 17:53:18,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1034526553=0, srv1949285678=12, srv1775432372=10, srv234434430=15, srv511607598=21, srv2140884160=14, srv1108977562=2, srv716383482=24, srv1266342406=3, srv823245929=27, srv1389392964=6, srv341521388=18, srv645120139=23, srv1060642690=1, srv1270720590=4, srv286605007=16, srv1536787582=8, srv727470919=25, srv1380508430=5, srv783095030=26, srv360742523=19, srv1410792346=7, srv1714014404=9, srv321155752=17, srv1968776181=13, srv854668812=28, srv1801160634=11, srv595379035=22, srv972374313=29, srv435464566=20} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-29 17:53:18,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-29 17:53:18,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-29 17:53:18,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-29 17:53:18,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-29 17:53:18,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-29 17:53:18,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-29 17:53:18,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-29 17:53:18,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-29 17:53:18,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-29 17:53:18,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-29 17:53:18,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-29 17:53:18,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-29 17:53:18,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-29 17:53:18,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-29 17:53:18,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-29 17:53:18,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-29 17:53:18,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-29 17:53:18,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-29 17:53:18,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-29 17:53:18,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-29 17:53:18,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-29 17:53:18,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-29 17:53:18,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-29 17:53:18,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-29 17:53:18,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-29 17:53:18,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-29 17:53:18,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-29 17:53:18,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-29 17:53:18,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-29 17:53:18,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-29 17:53:18,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-09-29 17:53:18,238 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1027022185224717, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-29 17:53:18,239 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912516654601309, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1027022185224717, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-09-29 17:55:18,226 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6178265 different iterations.  Found a solution that moves 1860 regions; Going from a computed imbalance of 0.9912516654601309 to a new imbalance of 4.341332789166274E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6888888888888889, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-29 17:55:18,232 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1034526553:90 , srv1060642690:90 , srv1108977562:90 , srv1266342406:90 , srv1270720590:90 , srv1380508430:90 , srv1389392964:90 , srv1410792346:90 , srv1536787582:90 , srv1714014404:90 , srv1775432372:90 , srv1801160634:90 , srv1949285678:90 , srv1968776181:90 , srv2140884160:90 , srv234434430:90 , srv286605007:90 , srv321155752:90 , srv341521388:90 , srv360742523:90 , srv435464566:90 , srv511607598:90 , srv595379035:90 , srv645120139:90 , srv716383482:90 , srv727470919:90 , srv783095030:90 , srv823245929:90 , srv854668812:90 , srv972374313:90 }
2023-09-29 17:55:18,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-29 17:55:18,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1034526553=0, srv1949285678=12, srv1775432372=10, srv234434430=15, srv511607598=21, srv2140884160=14, srv1108977562=2, srv716383482=24, srv1266342406=3, srv823245929=27, srv1389392964=6, srv341521388=18, srv645120139=23, srv1060642690=1, srv1270720590=4, srv286605007=16, srv1536787582=8, srv727470919=25, srv1380508430=5, srv783095030=26, srv360742523=19, srv1410792346=7, srv1714014404=9, srv321155752=17, srv1968776181=13, srv854668812=28, srv1801160634=11, srv595379035=22, srv972374313=29, srv435464566=20} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-29 17:55:18,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-29 17:55:18,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-29 17:55:18,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-29 17:55:18,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-29 17:55:18,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-29 17:55:18,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-29 17:55:18,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-29 17:55:18,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-29 17:55:18,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-29 17:55:18,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-29 17:55:18,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-29 17:55:18,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-29 17:55:18,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-29 17:55:18,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-29 17:55:18,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-29 17:55:18,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-29 17:55:18,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-29 17:55:18,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-29 17:55:18,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-29 17:55:18,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-29 17:55:18,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-29 17:55:18,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-29 17:55:18,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-29 17:55:18,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-29 17:55:18,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-29 17:55:18,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-29 17:55:18,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-29 17:55:18,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-29 17:55:18,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-29 17:55:18,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-29 17:55:18,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-09-29 17:55:18,250 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-29 17:55:18,250 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1034526553:90 , srv1060642690:90 , srv1108977562:90 , srv1266342406:90 , srv1270720590:90 , srv1380508430:90 , srv1389392964:90 , srv1410792346:90 , srv1536787582:90 , srv1714014404:90 , srv1775432372:90 , srv1801160634:90 , srv1949285678:90 , srv1968776181:90 , srv2140884160:90 , srv234434430:90 , srv286605007:90 , srv321155752:90 , srv341521388:90 , srv360742523:90 , srv435464566:90 , srv511607598:90 , srv595379035:90 , srv645120139:90 , srv716383482:90 , srv727470919:90 , srv783095030:90 , srv823245929:90 , srv854668812:90 , srv972374313:90 }
2023-09-29 17:55:18,263 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=219 (was 363), ProcessCount=171 (was 171), AvailableMemoryMB=1284 (was 2475)