2023-10-01 23:53:26,379 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-10-01 23:53:26,680 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-10-01 23:53:26,784 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-10-01 23:53:26,851 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-01 23:53:26,858 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-10-01 23:53:26,872 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=354, ProcessCount=172, AvailableMemoryMB=2598
2023-10-01 23:53:26,874 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-01 23:53:26,874 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-10-01 23:53:27,013 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1010575405:84 , srv1024759072:84 , srv1028943587:84 , srv1033270026:84 , srv1050886135:84 , srv1087098016:84 , srv1089641496:84 , srv1104840967:84 , srv1120657537:84 , srv1131746397:84 , srv1143040849:84 , srv1165178112:84 , srv118345781:84 , srv1183947208:84 , srv1229067500:84 , srv1262691837:84 , srv1290300511:84 , srv130318113:84 , srv1334008383:84 , srv1334555963:84 , srv1365284647:84 , srv1427475917:84 , srv1429470867:84 , srv1448541947:84 , srv1465246468:84 , srv1562288361:84 , srv1567670177:84 , srv1574948321:84 , srv1578597344:84 , srv1592696041:84 , srv1643637571:84 , srv1745937983:84 , srv1748868057:84 , srv1766312874:84 , srv1793469096:84 , srv1793813840:84 , srv1794380649:84 , srv1873475509:84 , srv1926540423:84 , srv1950628194:84 , srv1962759702:84 , srv1971968263:84 , srv1980581123:84 , srv1999746418:84 , srv2009825325:84 , srv2010866102:84 , srv2020027703:84 , srv2035984762:84 , srv2050424406:84 , srv2058216910:84 , srv2076664770:84 , srv2103492409:84 , srv2105937119:84 , srv2114842794:84 , srv2120554966:84 , srv212501333:84 , srv2125039689:84 , srv213763494:84 , srv218203552:84 , srv252879566:84 , srv276056698:84 , srv312337358:84 , srv331866105:84 , srv334845597:84 , srv355085824:84 , srv374888468:84 , srv400105022:84 , srv416645775:84 , srv436177704:84 , srv443021804:84 , srv455007314:84 , srv493393121:84 , srv552200347:84 , srv567149199:84 , srv580316993:84 , srv590896780:84 , srv596757478:84 , srv620818273:84 , srv663685544:84 , srv690213124:84 , srv697728904:84 , srv706073440:84 , srv707024597:84 , srv729520102:84 , srv74267724:84 , srv753115845:84 , srv75943052:84 , srv78667786:84 , srv828354542:84 , srv851302580:84 , srv867360198:84 , srv872145925:84 , srv883700612:84 , srv902940153:84 , srv929278446:84 , srv932793394:84 , srv9534976:84 , srv957665037:84 , srv996714616:84 , srv101222837:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-10-01 23:53:27,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-01 23:53:27,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv929278446=95, srv1427475917=22, srv443021804=70, srv2058216910=50, srv1794380649=37, srv1793469096=35, srv1766312874=34, srv1365284647=21, srv872145925=92, srv1143040849=11, srv590896780=76, srv1745937983=32, srv1290300511=17, srv334845597=64, srv1183947208=14, srv1089641496=7, srv2050424406=49, srv2010866102=46, srv932793394=96, srv1950628194=40, srv2114842794=54, srv1429470867=23, srv78667786=88, srv331866105=63, srv957665037=98, srv1028943587=3, srv663685544=79, srv867360198=91, srv1873475509=38, srv1334008383=19, srv355085824=65, srv1131746397=10, srv2009825325=45, srv416645775=68, srv1980581123=43, srv1793813840=36, srv2020027703=47, srv252879566=60, srv1574948321=28, srv1578597344=29, srv580316993=75, srv1448541947=24, srv312337358=62, srv130318113=18, srv212501333=56, srv1262691837=16, srv690213124=80, srv2125039689=57, srv493393121=72, srv996714616=99, srv75943052=87, srv1748868057=33, srv1643637571=31, srv1926540423=39, srv1962759702=41, srv1087098016=6, srv1010575405=0, srv1165178112=12, srv276056698=61, srv1999746418=44, srv552200347=73, srv2120554966=55, srv2105937119=53, srv1592696041=30, srv9534976=97, srv902940153=94, srv729520102=84, srv1050886135=5, srv1229067500=15, srv1562288361=26, srv2076664770=51, srv101222837=1, srv706073440=82, srv1024759072=2, srv1120657537=9, srv567149199=74, srv1033270026=4, srv828354542=89, srv1465246468=25, srv753115845=86, srv436177704=69, srv1334555963=20, srv620818273=78, srv218203552=59, srv697728904=81, srv213763494=58, srv1104840967=8, srv455007314=71, srv2103492409=52, srv1567670177=27, srv596757478=77, srv707024597=83, srv883700612=93, srv2035984762=48, srv374888468=66, srv400105022=67, srv118345781=13, srv1971968263=42, srv74267724=85, srv851302580=90} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-01 23:53:27,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-01 23:53:27,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-01 23:53:27,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-01 23:53:27,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-01 23:53:27,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-01 23:53:27,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-01 23:53:27,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-01 23:53:27,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-01 23:53:27,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-01 23:53:27,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-01 23:53:27,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-01 23:53:27,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-01 23:53:27,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-01 23:53:27,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-01 23:53:27,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-01 23:53:27,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-01 23:53:27,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-01 23:53:27,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-01 23:53:27,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-01 23:53:27,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-01 23:53:27,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-01 23:53:27,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-01 23:53:27,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-01 23:53:27,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-01 23:53:27,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-01 23:53:27,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-01 23:53:27,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-01 23:53:27,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-01 23:53:27,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-01 23:53:27,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-01 23:53:27,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-01 23:53:27,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-01 23:53:27,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-01 23:53:27,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-01 23:53:27,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-01 23:53:27,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-01 23:53:27,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-01 23:53:27,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-01 23:53:27,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-01 23:53:27,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-01 23:53:27,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-01 23:53:27,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-01 23:53:27,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-01 23:53:27,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-01 23:53:27,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-01 23:53:27,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-01 23:53:27,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-01 23:53:27,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-01 23:53:27,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-01 23:53:27,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-01 23:53:27,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-01 23:53:27,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-01 23:53:27,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-01 23:53:27,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-01 23:53:27,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-01 23:53:27,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-01 23:53:27,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-01 23:53:27,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-01 23:53:27,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-01 23:53:27,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-01 23:53:27,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-01 23:53:27,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-01 23:53:27,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-01 23:53:27,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-01 23:53:27,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-01 23:53:27,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-01 23:53:27,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-01 23:53:27,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-01 23:53:27,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-01 23:53:27,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-01 23:53:27,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-01 23:53:27,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-01 23:53:27,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-01 23:53:27,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-01 23:53:27,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-01 23:53:27,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-01 23:53:27,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-01 23:53:27,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-01 23:53:27,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-01 23:53:27,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-01 23:53:27,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-01 23:53:27,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-01 23:53:27,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-01 23:53:27,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-01 23:53:27,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-01 23:53:27,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-01 23:53:27,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-01 23:53:27,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-01 23:53:27,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-01 23:53:27,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-01 23:53:27,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-01 23:53:27,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-01 23:53:27,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-01 23:53:27,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-01 23:53:27,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-01 23:53:27,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-01 23:53:27,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-01 23:53:27,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-01 23:53:27,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-01 23:53:27,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-01 23:53:27,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-01 23:53:27,334 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-01 23:53:27,334 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-01 23:53:27,335 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-01 23:53:27,777 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 607 ms to try 5000 different iterations.  Found a solution that moves 4698 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17692337523905247. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.040436266609491525, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.058660697584306316, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.522, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.040436266609491525, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17158333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24391666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-01 23:53:27,798 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv2114842794:80 , srv1104840967:81 , srv493393121:81 , srv707024597:81 , srv932793394:81 , srv1024759072:82 , srv2058216910:82 , srv2076664770:82 , srv374888468:82 , srv400105022:82 , srv580316993:82 , srv957665037:82 , srv1050886135:83 , srv1262691837:83 , srv1793469096:83 , srv1980581123:83 , srv2009825325:83 , srv2035984762:83 , srv2125039689:83 , srv312337358:83 , srv567149199:83 , srv1028943587:84 , srv1567670177:84 , srv1643637571:84 , srv2020027703:84 , srv75943052:84 , srv996714616:84 , srv1010575405:85 , srv1766312874:85 , srv1793813840:85 , srv252879566:85 , srv590896780:85 , srv620818273:85 , srv753115845:85 , srv1120657537:86 , srv1165178112:86 , srv118345781:86 , srv1183947208:86 , srv1334008383:86 , srv1562288361:86 , srv1745937983:86 , srv1748868057:86 , srv1926540423:86 , srv1971968263:86 , srv1999746418:86 , srv436177704:86 , srv552200347:86 , srv697728904:86 , srv78667786:86 , srv1087098016:87 , srv1089641496:87 , srv1229067500:87 , srv1290300511:87 , srv1365284647:87 , srv1429470867:87 , srv1574948321:87 , srv1794380649:87 , srv1950628194:87 , srv1962759702:87 , srv213763494:87 , srv331866105:87 , srv334845597:87 , srv416645775:87 , srv443021804:87 , srv455007314:87 , srv729520102:87 , srv74267724:87 , srv902940153:87 , srv1143040849:88 , srv130318113:88 , srv1448541947:88 , srv2010866102:88 , srv218203552:88 , srv663685544:88 , srv690213124:88 , srv867360198:88 , srv1033270026:89 , srv1131746397:89 , srv1334555963:89 , srv1592696041:89 , srv2105937119:89 , srv212501333:89 , srv355085824:89 , srv872145925:89 , srv883700612:89 , srv929278446:89 , srv9534976:89 , srv1578597344:90 , srv2050424406:90 , srv276056698:90 , srv596757478:90 , srv1427475917:91 , srv1873475509:91 , srv1465246468:92 , srv2120554966:92 , srv706073440:92 , srv851302580:92 , srv2103492409:95 , srv828354542:96 , srv101222837:449 }
2023-10-01 23:53:27,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-01 23:53:27,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv929278446=95, srv1427475917=22, srv443021804=70, srv2058216910=50, srv1794380649=37, srv1793469096=35, srv1766312874=34, srv1365284647=21, srv872145925=92, srv1143040849=11, srv590896780=76, srv1745937983=32, srv1290300511=17, srv334845597=64, srv1183947208=14, srv1089641496=7, srv2050424406=49, srv2010866102=46, srv932793394=96, srv1950628194=40, srv2114842794=54, srv1429470867=23, srv78667786=88, srv331866105=63, srv957665037=98, srv1028943587=3, srv663685544=79, srv867360198=91, srv1873475509=38, srv1334008383=19, srv355085824=65, srv1131746397=10, srv2009825325=45, srv416645775=68, srv1980581123=43, srv1793813840=36, srv2020027703=47, srv252879566=60, srv1574948321=28, srv1578597344=29, srv580316993=75, srv1448541947=24, srv312337358=62, srv130318113=18, srv212501333=56, srv1262691837=16, srv690213124=80, srv2125039689=57, srv493393121=72, srv996714616=99, srv75943052=87, srv1748868057=33, srv1643637571=31, srv1926540423=39, srv1962759702=41, srv1087098016=6, srv1010575405=0, srv1165178112=12, srv276056698=61, srv1999746418=44, srv552200347=73, srv2120554966=55, srv2105937119=53, srv1592696041=30, srv9534976=97, srv902940153=94, srv729520102=84, srv1050886135=5, srv1229067500=15, srv1562288361=26, srv2076664770=51, srv101222837=1, srv706073440=82, srv1024759072=2, srv1120657537=9, srv567149199=74, srv1033270026=4, srv828354542=89, srv1465246468=25, srv753115845=86, srv436177704=69, srv1334555963=20, srv620818273=78, srv218203552=59, srv697728904=81, srv213763494=58, srv1104840967=8, srv455007314=71, srv2103492409=52, srv1567670177=27, srv596757478=77, srv707024597=83, srv883700612=93, srv2035984762=48, srv374888468=66, srv400105022=67, srv118345781=13, srv1971968263=42, srv74267724=85, srv851302580=90} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-01 23:53:27,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-01 23:53:27,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-01 23:53:27,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-01 23:53:27,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-01 23:53:27,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-01 23:53:27,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-01 23:53:27,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-01 23:53:27,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-01 23:53:27,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-01 23:53:27,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-01 23:53:27,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-01 23:53:27,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-01 23:53:27,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-01 23:53:27,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-01 23:53:27,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-01 23:53:27,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-01 23:53:27,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-01 23:53:27,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-01 23:53:27,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-01 23:53:27,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-01 23:53:27,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-01 23:53:27,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-01 23:53:27,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-01 23:53:27,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-01 23:53:27,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-01 23:53:27,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-01 23:53:27,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-01 23:53:27,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-01 23:53:27,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-01 23:53:27,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-01 23:53:27,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-01 23:53:27,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-01 23:53:27,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-01 23:53:27,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-01 23:53:27,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-01 23:53:27,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-01 23:53:27,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-01 23:53:27,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-01 23:53:27,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-01 23:53:27,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-01 23:53:27,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-01 23:53:27,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-01 23:53:27,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-01 23:53:27,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-01 23:53:27,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-01 23:53:27,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-01 23:53:27,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-01 23:53:27,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-01 23:53:27,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-01 23:53:27,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-01 23:53:27,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-01 23:53:27,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-01 23:53:27,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-01 23:53:27,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-01 23:53:27,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-01 23:53:27,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-01 23:53:27,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-01 23:53:27,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-01 23:53:27,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-01 23:53:27,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-01 23:53:27,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-01 23:53:27,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-01 23:53:27,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-01 23:53:27,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-01 23:53:27,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-01 23:53:27,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-01 23:53:27,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-01 23:53:27,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-01 23:53:27,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-01 23:53:27,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-01 23:53:27,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-01 23:53:27,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-01 23:53:27,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-01 23:53:27,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-01 23:53:27,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-01 23:53:27,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-01 23:53:27,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-01 23:53:27,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-01 23:53:27,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-01 23:53:27,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-01 23:53:27,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-01 23:53:27,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-01 23:53:27,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-01 23:53:27,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-01 23:53:27,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-01 23:53:27,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-01 23:53:27,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-01 23:53:27,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-01 23:53:27,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-01 23:53:27,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-01 23:53:27,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-01 23:53:27,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-01 23:53:27,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-01 23:53:27,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-01 23:53:27,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-01 23:53:27,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-01 23:53:27,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-01 23:53:27,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-01 23:53:27,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-01 23:53:27,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-01 23:53:27,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-01 23:53:28,097 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.040436266609491525, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.058660697584306316, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.040436266609491525, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17158333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24391666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-01 23:53:28,097 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-01 23:53:28,097 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17689047913995004, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.040436266609491525, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.058660697584306316, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.040436266609491525, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17158333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24391666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-01 23:53:28,491 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 635 ms to try 5000 different iterations.  Found a solution that moves 2691 regions; Going from a computed imbalance of 0.17689047913995004 to a new imbalance of 0.01553403363111391. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020828338346208095); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.034475385256037216, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.299, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020828338346208095); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012333333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04616666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-01 23:53:28,503 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv706073440:78 , srv1465246468:79 , srv2103492409:79 , srv1427475917:80 , srv828354542:80 , srv1873475509:81 , srv2120554966:81 , srv1334555963:82 , srv596757478:82 , srv851302580:82 , srv1143040849:83 , srv130318113:83 , srv1574948321:83 , srv2050424406:83 , srv729520102:83 , srv74267724:83 , srv883700612:83 , srv929278446:83 , srv1334008383:84 , srv1429470867:84 , srv1578597344:84 , srv1592696041:84 , srv1748868057:84 , srv1950628194:84 , srv2010866102:84 , srv2105937119:84 , srv212501333:84 , srv218203552:84 , srv276056698:84 , srv334845597:84 , srv663685544:84 , srv867360198:84 , srv872145925:84 , srv902940153:84 , srv1033270026:85 , srv1087098016:85 , srv1089641496:85 , srv1120657537:85 , srv1131746397:85 , srv1971968263:85 , srv1999746418:85 , srv252879566:85 , srv355085824:85 , srv416645775:85 , srv590896780:85 , srv690213124:85 , srv697728904:85 , srv9534976:85 , srv1010575405:86 , srv1290300511:86 , srv1365284647:86 , srv1745937983:86 , srv1793813840:86 , srv1794380649:86 , srv213763494:86 , srv436177704:86 , srv455007314:86 , srv620818273:86 , srv753115845:86 , srv75943052:86 , srv78667786:86 , srv1567670177:87 , srv1926540423:87 , srv1962759702:87 , srv1980581123:87 , srv2009825325:87 , srv2020027703:87 , srv331866105:87 , srv443021804:87 , srv552200347:87 , srv1028943587:88 , srv1165178112:88 , srv118345781:88 , srv1229067500:88 , srv1448541947:88 , srv2058216910:88 , srv2076664770:88 , srv312337358:88 , srv400105022:88 , srv580316993:88 , srv996714616:88 , srv1024759072:89 , srv1050886135:89 , srv1183947208:89 , srv1562288361:89 , srv1643637571:89 , srv1766312874:89 , srv567149199:89 , srv1262691837:90 , srv1793469096:90 , srv2035984762:90 , srv2125039689:90 , srv374888468:90 , srv707024597:90 , srv2114842794:91 , srv493393121:91 , srv932793394:91 , srv957665037:91 , srv1104840967:92 , srv101222837:510 }
2023-10-01 23:53:28,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-01 23:53:28,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv929278446=95, srv1427475917=22, srv443021804=70, srv2058216910=50, srv1794380649=37, srv1793469096=35, srv1766312874=34, srv1365284647=21, srv872145925=92, srv1143040849=11, srv590896780=76, srv1745937983=32, srv1290300511=17, srv334845597=64, srv1183947208=14, srv1089641496=7, srv2050424406=49, srv2010866102=46, srv932793394=96, srv1950628194=40, srv2114842794=54, srv1429470867=23, srv78667786=88, srv331866105=63, srv957665037=98, srv1028943587=3, srv663685544=79, srv867360198=91, srv1873475509=38, srv1334008383=19, srv355085824=65, srv1131746397=10, srv2009825325=45, srv416645775=68, srv1980581123=43, srv1793813840=36, srv2020027703=47, srv252879566=60, srv1574948321=28, srv1578597344=29, srv580316993=75, srv1448541947=24, srv312337358=62, srv130318113=18, srv212501333=56, srv1262691837=16, srv690213124=80, srv2125039689=57, srv493393121=72, srv996714616=99, srv75943052=87, srv1748868057=33, srv1643637571=31, srv1926540423=39, srv1962759702=41, srv1087098016=6, srv1010575405=0, srv1165178112=12, srv276056698=61, srv1999746418=44, srv552200347=73, srv2120554966=55, srv2105937119=53, srv1592696041=30, srv9534976=97, srv902940153=94, srv729520102=84, srv1050886135=5, srv1229067500=15, srv1562288361=26, srv2076664770=51, srv101222837=1, srv706073440=82, srv1024759072=2, srv1120657537=9, srv567149199=74, srv1033270026=4, srv828354542=89, srv1465246468=25, srv753115845=86, srv436177704=69, srv1334555963=20, srv620818273=78, srv218203552=59, srv697728904=81, srv213763494=58, srv1104840967=8, srv455007314=71, srv2103492409=52, srv1567670177=27, srv596757478=77, srv707024597=83, srv883700612=93, srv2035984762=48, srv374888468=66, srv400105022=67, srv118345781=13, srv1971968263=42, srv74267724=85, srv851302580=90} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-01 23:53:28,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-01 23:53:28,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-01 23:53:28,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-01 23:53:28,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-01 23:53:28,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-01 23:53:28,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-01 23:53:28,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-01 23:53:28,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-01 23:53:28,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-01 23:53:28,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-01 23:53:28,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-01 23:53:28,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-01 23:53:28,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-01 23:53:28,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-01 23:53:28,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-01 23:53:28,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-01 23:53:28,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-01 23:53:28,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-01 23:53:28,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-01 23:53:28,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-01 23:53:28,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-01 23:53:28,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-01 23:53:28,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-01 23:53:28,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-01 23:53:28,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-01 23:53:28,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-01 23:53:28,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-01 23:53:28,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-01 23:53:28,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-01 23:53:28,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-01 23:53:28,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-01 23:53:28,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-01 23:53:28,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-01 23:53:28,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-01 23:53:28,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-01 23:53:28,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-01 23:53:28,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-01 23:53:28,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-01 23:53:28,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-01 23:53:28,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-01 23:53:28,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-01 23:53:28,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-01 23:53:28,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-01 23:53:28,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-01 23:53:28,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-01 23:53:28,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-01 23:53:28,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-01 23:53:28,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-01 23:53:28,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-01 23:53:28,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-01 23:53:28,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-01 23:53:28,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-01 23:53:28,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-01 23:53:28,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-01 23:53:28,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-01 23:53:28,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-01 23:53:28,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-01 23:53:28,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-01 23:53:28,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-01 23:53:28,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-01 23:53:28,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-01 23:53:28,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-01 23:53:28,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-01 23:53:28,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-01 23:53:28,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-01 23:53:28,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-01 23:53:28,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-01 23:53:28,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-01 23:53:28,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-01 23:53:28,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-01 23:53:28,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-01 23:53:28,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-01 23:53:28,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-01 23:53:28,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-01 23:53:28,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-01 23:53:28,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-01 23:53:28,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-01 23:53:28,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-01 23:53:28,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-01 23:53:28,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-01 23:53:28,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-01 23:53:28,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-01 23:53:28,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-01 23:53:28,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-01 23:53:28,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-01 23:53:28,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-01 23:53:28,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-01 23:53:28,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-01 23:53:28,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-01 23:53:28,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-01 23:53:28,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-01 23:53:28,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-01 23:53:28,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-01 23:53:28,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-01 23:53:28,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-01 23:53:28,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-01 23:53:28,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-01 23:53:28,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-01 23:53:28,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-01 23:53:28,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-01 23:53:28,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-01 23:53:28,702 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020828338346208095); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.034475385256037216, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020828338346208095); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012333333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04616666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-01 23:53:28,702 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-01 23:53:28,702 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.015515190846378998, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020828338346208095); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.034475385256037216, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020828338346208095); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012333333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04616666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-01 23:53:29,073 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 506 ms to try 5000 different iterations.  Found a solution that moves 989 regions; Going from a computed imbalance of 0.015515190846378998 to a new imbalance of 6.660518232179487E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004441637722065092); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00834174659477276); MoveCostFunction : (multiplier=7.0, imbalance=0.10988888888888888, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.004441637722065092); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0033333333333333335); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-01 23:53:29,076 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1448541947:81 , srv828354542:82 , srv1033270026:83 , srv1165178112:83 , srv118345781:83 , srv1183947208:83 , srv1562288361:83 , srv1962759702:83 , srv276056698:83 , srv1104840967:84 , srv1131746397:84 , srv1229067500:84 , srv1365284647:84 , srv1578597344:84 , srv1766312874:84 , srv1793469096:84 , srv2035984762:84 , srv2050424406:84 , srv2103492409:84 , srv2125039689:84 , srv213763494:84 , srv331866105:84 , srv355085824:84 , srv374888468:84 , srv416645775:84 , srv851302580:84 , srv9534976:84 , srv1087098016:85 , srv1089641496:85 , srv1262691837:85 , srv1290300511:85 , srv1592696041:85 , srv1643637571:85 , srv1794380649:85 , srv1873475509:85 , srv1926540423:85 , srv2105937119:85 , srv2120554966:85 , srv212501333:85 , srv436177704:85 , srv443021804:85 , srv493393121:85 , srv552200347:85 , srv567149199:85 , srv690213124:85 , srv872145925:85 , srv883700612:85 , srv932793394:85 , srv957665037:85 , srv1010575405:86 , srv1024759072:86 , srv1028943587:86 , srv1050886135:86 , srv1334555963:86 , srv1745937983:86 , srv1793813840:86 , srv1950628194:86 , srv1971968263:86 , srv1999746418:86 , srv2010866102:86 , srv2020027703:86 , srv218203552:86 , srv312337358:86 , srv334845597:86 , srv590896780:86 , srv596757478:86 , srv620818273:86 , srv663685544:86 , srv753115845:86 , srv867360198:86 , srv929278446:86 , srv996714616:86 , srv1120657537:87 , srv1143040849:87 , srv130318113:87 , srv1334008383:87 , srv1427475917:87 , srv1429470867:87 , srv1465246468:87 , srv1567670177:87 , srv2009825325:87 , srv2058216910:87 , srv2114842794:87 , srv400105022:87 , srv455007314:87 , srv580316993:87 , srv697728904:87 , srv707024597:87 , srv729520102:87 , srv74267724:87 , srv78667786:87 , srv902940153:87 , srv1748868057:88 , srv1980581123:88 , srv252879566:88 , srv706073440:88 , srv75943052:88 , srv1574948321:89 , srv2076664770:89 , srv101222837:538 }
2023-10-01 23:53:29,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-01 23:53:29,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv929278446=95, srv1427475917=22, srv443021804=70, srv2058216910=50, srv1794380649=37, srv1793469096=35, srv1766312874=34, srv1365284647=21, srv872145925=92, srv1143040849=11, srv590896780=76, srv1745937983=32, srv1290300511=17, srv334845597=64, srv1183947208=14, srv1089641496=7, srv2050424406=49, srv2010866102=46, srv932793394=96, srv1950628194=40, srv2114842794=54, srv1429470867=23, srv78667786=88, srv331866105=63, srv957665037=98, srv1028943587=3, srv663685544=79, srv867360198=91, srv1873475509=38, srv1334008383=19, srv355085824=65, srv1131746397=10, srv2009825325=45, srv416645775=68, srv1980581123=43, srv1793813840=36, srv2020027703=47, srv252879566=60, srv1574948321=28, srv1578597344=29, srv580316993=75, srv1448541947=24, srv312337358=62, srv130318113=18, srv212501333=56, srv1262691837=16, srv690213124=80, srv2125039689=57, srv493393121=72, srv996714616=99, srv75943052=87, srv1748868057=33, srv1643637571=31, srv1926540423=39, srv1962759702=41, srv1087098016=6, srv1010575405=0, srv1165178112=12, srv276056698=61, srv1999746418=44, srv552200347=73, srv2120554966=55, srv2105937119=53, srv1592696041=30, srv9534976=97, srv902940153=94, srv729520102=84, srv1050886135=5, srv1229067500=15, srv1562288361=26, srv2076664770=51, srv101222837=1, srv706073440=82, srv1024759072=2, srv1120657537=9, srv567149199=74, srv1033270026=4, srv828354542=89, srv1465246468=25, srv753115845=86, srv436177704=69, srv1334555963=20, srv620818273=78, srv218203552=59, srv697728904=81, srv213763494=58, srv1104840967=8, srv455007314=71, srv2103492409=52, srv1567670177=27, srv596757478=77, srv707024597=83, srv883700612=93, srv2035984762=48, srv374888468=66, srv400105022=67, srv118345781=13, srv1971968263=42, srv74267724=85, srv851302580=90} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-01 23:53:29,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-01 23:53:29,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-01 23:53:29,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-01 23:53:29,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-01 23:53:29,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-01 23:53:29,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-01 23:53:29,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-01 23:53:29,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-01 23:53:29,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-01 23:53:29,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-01 23:53:29,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-01 23:53:29,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-01 23:53:29,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-01 23:53:29,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-01 23:53:29,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-01 23:53:29,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-01 23:53:29,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-01 23:53:29,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-01 23:53:29,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-01 23:53:29,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-01 23:53:29,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-01 23:53:29,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-01 23:53:29,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-01 23:53:29,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-01 23:53:29,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-01 23:53:29,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-01 23:53:29,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-01 23:53:29,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-01 23:53:29,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-01 23:53:29,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-01 23:53:29,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-01 23:53:29,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-01 23:53:29,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-01 23:53:29,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-01 23:53:29,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-01 23:53:29,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-01 23:53:29,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-01 23:53:29,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-01 23:53:29,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-01 23:53:29,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-01 23:53:29,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-01 23:53:29,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-01 23:53:29,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-01 23:53:29,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-01 23:53:29,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-01 23:53:29,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-01 23:53:29,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-01 23:53:29,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-01 23:53:29,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-01 23:53:29,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-01 23:53:29,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-01 23:53:29,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-01 23:53:29,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-01 23:53:29,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-01 23:53:29,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-01 23:53:29,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-01 23:53:29,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-01 23:53:29,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-01 23:53:29,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-01 23:53:29,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-01 23:53:29,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-01 23:53:29,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-01 23:53:29,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-01 23:53:29,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-01 23:53:29,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-01 23:53:29,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-01 23:53:29,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-01 23:53:29,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-01 23:53:29,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-01 23:53:29,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-01 23:53:29,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-01 23:53:29,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-01 23:53:29,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-01 23:53:29,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-01 23:53:29,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-01 23:53:29,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-01 23:53:29,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-01 23:53:29,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-01 23:53:29,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-01 23:53:29,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-01 23:53:29,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-01 23:53:29,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-01 23:53:29,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-01 23:53:29,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-01 23:53:29,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-01 23:53:29,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-01 23:53:29,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-01 23:53:29,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-01 23:53:29,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-01 23:53:29,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-01 23:53:29,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-01 23:53:29,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-01 23:53:29,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-01 23:53:29,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-01 23:53:29,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-01 23:53:29,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-01 23:53:29,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-01 23:53:29,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-01 23:53:29,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-01 23:53:29,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-01 23:53:29,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-01 23:53:29,252 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004441637722065092); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00834174659477276); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.004441637722065092); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0033333333333333335); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-01 23:53:29,253 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-01 23:53:29,253 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=6.591266972042625E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004441637722065092); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00834174659477276); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.004441637722065092); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0033333333333333335); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-01 23:53:29,641 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 500 ms to try 5000 different iterations.  Found a solution that moves 249 regions; Going from a computed imbalance of 6.591266972042625E-4 to a new imbalance of 2.6450052647537564E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.027666666666666666, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-01 23:53:29,642 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv455007314:82 , srv1120657537:83 , srv1229067500:83 , srv1574948321:83 , srv2076664770:83 , srv212501333:83 , srv443021804:83 , srv78667786:83 , srv1028943587:84 , srv1050886135:84 , srv1131746397:84 , srv1183947208:84 , srv1262691837:84 , srv1290300511:84 , srv130318113:84 , srv1427475917:84 , srv1429470867:84 , srv1448541947:84 , srv1465246468:84 , srv1562288361:84 , srv1567670177:84 , srv1578597344:84 , srv1592696041:84 , srv1745937983:84 , srv1748868057:84 , srv1794380649:84 , srv1926540423:84 , srv1980581123:84 , srv2009825325:84 , srv2010866102:84 , srv2103492409:84 , srv2105937119:84 , srv2114842794:84 , srv2120554966:84 , srv218203552:84 , srv252879566:84 , srv331866105:84 , srv355085824:84 , srv493393121:84 , srv552200347:84 , srv596757478:84 , srv620818273:84 , srv663685544:84 , srv690213124:84 , srv697728904:84 , srv706073440:84 , srv75943052:84 , srv851302580:84 , srv867360198:84 , srv872145925:84 , srv883700612:84 , srv902940153:84 , srv929278446:84 , srv9534976:84 , srv957665037:84 , srv996714616:84 , srv1010575405:85 , srv1024759072:85 , srv1033270026:85 , srv1087098016:85 , srv1089641496:85 , srv1104840967:85 , srv1143040849:85 , srv1165178112:85 , srv118345781:85 , srv1334008383:85 , srv1334555963:85 , srv1365284647:85 , srv1643637571:85 , srv1766312874:85 , srv1793469096:85 , srv1793813840:85 , srv1873475509:85 , srv1950628194:85 , srv1962759702:85 , srv1971968263:85 , srv1999746418:85 , srv2020027703:85 , srv2035984762:85 , srv2050424406:85 , srv2125039689:85 , srv213763494:85 , srv276056698:85 , srv312337358:85 , srv334845597:85 , srv400105022:85 , srv436177704:85 , srv567149199:85 , srv580316993:85 , srv707024597:85 , srv729520102:85 , srv74267724:85 , srv828354542:85 , srv932793394:85 , srv2058216910:86 , srv374888468:86 , srv416645775:86 , srv590896780:86 , srv753115845:86 , srv101222837:645 }
2023-10-01 23:53:29,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-01 23:53:29,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv929278446=95, srv1427475917=22, srv443021804=70, srv2058216910=50, srv1794380649=37, srv1793469096=35, srv1766312874=34, srv1365284647=21, srv872145925=92, srv1143040849=11, srv590896780=76, srv1745937983=32, srv1290300511=17, srv334845597=64, srv1183947208=14, srv1089641496=7, srv2050424406=49, srv2010866102=46, srv932793394=96, srv1950628194=40, srv2114842794=54, srv1429470867=23, srv78667786=88, srv331866105=63, srv957665037=98, srv1028943587=3, srv663685544=79, srv867360198=91, srv1873475509=38, srv1334008383=19, srv355085824=65, srv1131746397=10, srv2009825325=45, srv416645775=68, srv1980581123=43, srv1793813840=36, srv2020027703=47, srv252879566=60, srv1574948321=28, srv1578597344=29, srv580316993=75, srv1448541947=24, srv312337358=62, srv130318113=18, srv212501333=56, srv1262691837=16, srv690213124=80, srv2125039689=57, srv493393121=72, srv996714616=99, srv75943052=87, srv1748868057=33, srv1643637571=31, srv1926540423=39, srv1962759702=41, srv1087098016=6, srv1010575405=0, srv1165178112=12, srv276056698=61, srv1999746418=44, srv552200347=73, srv2120554966=55, srv2105937119=53, srv1592696041=30, srv9534976=97, srv902940153=94, srv729520102=84, srv1050886135=5, srv1229067500=15, srv1562288361=26, srv2076664770=51, srv101222837=1, srv706073440=82, srv1024759072=2, srv1120657537=9, srv567149199=74, srv1033270026=4, srv828354542=89, srv1465246468=25, srv753115845=86, srv436177704=69, srv1334555963=20, srv620818273=78, srv218203552=59, srv697728904=81, srv213763494=58, srv1104840967=8, srv455007314=71, srv2103492409=52, srv1567670177=27, srv596757478=77, srv707024597=83, srv883700612=93, srv2035984762=48, srv374888468=66, srv400105022=67, srv118345781=13, srv1971968263=42, srv74267724=85, srv851302580=90} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-01 23:53:29,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-01 23:53:29,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-01 23:53:29,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-01 23:53:29,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-01 23:53:29,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-01 23:53:29,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-01 23:53:29,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-01 23:53:29,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-01 23:53:29,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-01 23:53:29,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-01 23:53:29,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-01 23:53:29,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-01 23:53:29,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-01 23:53:29,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-01 23:53:29,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-01 23:53:29,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-01 23:53:29,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-01 23:53:29,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-01 23:53:29,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-01 23:53:29,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-01 23:53:29,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-01 23:53:29,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-01 23:53:29,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-01 23:53:29,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-01 23:53:29,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-01 23:53:29,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-01 23:53:29,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-01 23:53:29,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-01 23:53:29,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-01 23:53:29,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-01 23:53:29,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-01 23:53:29,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-01 23:53:29,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-01 23:53:29,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-01 23:53:29,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-01 23:53:29,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-01 23:53:29,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-01 23:53:29,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-01 23:53:29,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-01 23:53:29,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-01 23:53:29,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-01 23:53:29,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-01 23:53:29,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-01 23:53:29,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-01 23:53:29,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-01 23:53:29,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-01 23:53:29,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-01 23:53:29,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-01 23:53:29,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-01 23:53:29,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-01 23:53:29,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-01 23:53:29,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-01 23:53:29,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-01 23:53:29,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-01 23:53:29,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-01 23:53:29,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-01 23:53:29,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-01 23:53:29,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-01 23:53:29,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-01 23:53:29,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-01 23:53:29,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-01 23:53:29,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-01 23:53:29,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-01 23:53:29,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-01 23:53:29,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-01 23:53:29,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-01 23:53:29,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-01 23:53:29,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-01 23:53:29,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-01 23:53:29,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-01 23:53:29,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-01 23:53:29,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-01 23:53:29,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-01 23:53:29,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-01 23:53:29,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-01 23:53:29,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-01 23:53:29,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-01 23:53:29,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-01 23:53:29,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-01 23:53:29,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-01 23:53:29,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-01 23:53:29,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-01 23:53:29,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-01 23:53:29,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-01 23:53:29,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-01 23:53:29,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-01 23:53:29,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-01 23:53:29,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-01 23:53:29,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-01 23:53:29,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-01 23:53:29,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-01 23:53:29,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-01 23:53:29,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-01 23:53:29,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-01 23:53:29,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-01 23:53:29,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-01 23:53:29,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-01 23:53:29,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-01 23:53:29,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-01 23:53:29,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-01 23:53:29,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-01 23:53:29,822 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-01 23:53:29,822 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-01 23:53:29,822 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.470651738221111E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-01 23:53:30,204 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 518 ms to try 5000 different iterations.  Found a solution that moves 20 regions; Going from a computed imbalance of 2.470651738221111E-5 to a new imbalance of 6.172121732927281E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0013400504203456161); MoveCostFunction : (multiplier=7.0, imbalance=0.0022222222222222222); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-01 23:53:30,205 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1143040849:83 , srv1643637571:83 , srv1766312874:83 , srv2058216910:83 , srv707024597:83 , srv753115845:83 , srv828354542:83 , srv1010575405:84 , srv1024759072:84 , srv1028943587:84 , srv1033270026:84 , srv1050886135:84 , srv1087098016:84 , srv1089641496:84 , srv1104840967:84 , srv1131746397:84 , srv1165178112:84 , srv118345781:84 , srv1183947208:84 , srv1229067500:84 , srv1262691837:84 , srv1290300511:84 , srv130318113:84 , srv1334008383:84 , srv1334555963:84 , srv1365284647:84 , srv1427475917:84 , srv1429470867:84 , srv1465246468:84 , srv1562288361:84 , srv1567670177:84 , srv1574948321:84 , srv1578597344:84 , srv1592696041:84 , srv1745937983:84 , srv1748868057:84 , srv1793469096:84 , srv1793813840:84 , srv1794380649:84 , srv1873475509:84 , srv1926540423:84 , srv1950628194:84 , srv1962759702:84 , srv1971968263:84 , srv1980581123:84 , srv1999746418:84 , srv2010866102:84 , srv2020027703:84 , srv2035984762:84 , srv2050424406:84 , srv2076664770:84 , srv2103492409:84 , srv2105937119:84 , srv2114842794:84 , srv2120554966:84 , srv2125039689:84 , srv213763494:84 , srv218203552:84 , srv252879566:84 , srv276056698:84 , srv312337358:84 , srv331866105:84 , srv334845597:84 , srv355085824:84 , srv374888468:84 , srv400105022:84 , srv416645775:84 , srv436177704:84 , srv443021804:84 , srv455007314:84 , srv552200347:84 , srv567149199:84 , srv580316993:84 , srv590896780:84 , srv596757478:84 , srv663685544:84 , srv690213124:84 , srv697728904:84 , srv706073440:84 , srv729520102:84 , srv74267724:84 , srv75943052:84 , srv78667786:84 , srv851302580:84 , srv867360198:84 , srv872145925:84 , srv902940153:84 , srv929278446:84 , srv932793394:84 , srv9534976:84 , srv957665037:84 , srv996714616:84 , srv1120657537:85 , srv1448541947:85 , srv2009825325:85 , srv212501333:85 , srv493393121:85 , srv620818273:85 , srv883700612:85 , srv101222837:684 }
2023-10-01 23:53:30,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-01 23:53:30,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv929278446=95, srv1427475917=22, srv443021804=70, srv2058216910=50, srv1794380649=37, srv1793469096=35, srv1766312874=34, srv1365284647=21, srv872145925=92, srv1143040849=11, srv590896780=76, srv1745937983=32, srv1290300511=17, srv334845597=64, srv1183947208=14, srv1089641496=7, srv2050424406=49, srv2010866102=46, srv932793394=96, srv1950628194=40, srv2114842794=54, srv1429470867=23, srv78667786=88, srv331866105=63, srv957665037=98, srv1028943587=3, srv663685544=79, srv867360198=91, srv1873475509=38, srv1334008383=19, srv355085824=65, srv1131746397=10, srv2009825325=45, srv416645775=68, srv1980581123=43, srv1793813840=36, srv2020027703=47, srv252879566=60, srv1574948321=28, srv1578597344=29, srv580316993=75, srv1448541947=24, srv312337358=62, srv130318113=18, srv212501333=56, srv1262691837=16, srv690213124=80, srv2125039689=57, srv493393121=72, srv996714616=99, srv75943052=87, srv1748868057=33, srv1643637571=31, srv1926540423=39, srv1962759702=41, srv1087098016=6, srv1010575405=0, srv1165178112=12, srv276056698=61, srv1999746418=44, srv552200347=73, srv2120554966=55, srv2105937119=53, srv1592696041=30, srv9534976=97, srv902940153=94, srv729520102=84, srv1050886135=5, srv1229067500=15, srv1562288361=26, srv2076664770=51, srv101222837=1, srv706073440=82, srv1024759072=2, srv1120657537=9, srv567149199=74, srv1033270026=4, srv828354542=89, srv1465246468=25, srv753115845=86, srv436177704=69, srv1334555963=20, srv620818273=78, srv218203552=59, srv697728904=81, srv213763494=58, srv1104840967=8, srv455007314=71, srv2103492409=52, srv1567670177=27, srv596757478=77, srv707024597=83, srv883700612=93, srv2035984762=48, srv374888468=66, srv400105022=67, srv118345781=13, srv1971968263=42, srv74267724=85, srv851302580=90} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-01 23:53:30,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-01 23:53:30,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-01 23:53:30,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-01 23:53:30,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-01 23:53:30,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-01 23:53:30,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-01 23:53:30,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-01 23:53:30,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-01 23:53:30,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-01 23:53:30,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-01 23:53:30,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-01 23:53:30,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-01 23:53:30,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-01 23:53:30,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-01 23:53:30,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-01 23:53:30,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-01 23:53:30,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-01 23:53:30,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-01 23:53:30,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-01 23:53:30,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-01 23:53:30,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-01 23:53:30,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-01 23:53:30,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-01 23:53:30,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-01 23:53:30,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-01 23:53:30,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-01 23:53:30,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-01 23:53:30,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-01 23:53:30,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-01 23:53:30,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-01 23:53:30,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-01 23:53:30,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-01 23:53:30,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-01 23:53:30,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-01 23:53:30,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-01 23:53:30,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-01 23:53:30,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-01 23:53:30,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-01 23:53:30,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-01 23:53:30,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-01 23:53:30,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-01 23:53:30,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-01 23:53:30,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-01 23:53:30,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-01 23:53:30,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-01 23:53:30,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-01 23:53:30,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-01 23:53:30,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-01 23:53:30,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-01 23:53:30,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-01 23:53:30,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-01 23:53:30,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-01 23:53:30,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-01 23:53:30,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-01 23:53:30,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-01 23:53:30,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-01 23:53:30,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-01 23:53:30,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-01 23:53:30,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-01 23:53:30,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-01 23:53:30,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-01 23:53:30,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-01 23:53:30,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-01 23:53:30,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-01 23:53:30,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-01 23:53:30,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-01 23:53:30,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-01 23:53:30,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-01 23:53:30,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-01 23:53:30,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-01 23:53:30,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-01 23:53:30,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-01 23:53:30,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-01 23:53:30,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-01 23:53:30,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-01 23:53:30,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-01 23:53:30,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-01 23:53:30,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-01 23:53:30,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-01 23:53:30,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-01 23:53:30,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-01 23:53:30,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-01 23:53:30,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-01 23:53:30,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-01 23:53:30,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-01 23:53:30,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-01 23:53:30,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-01 23:53:30,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-01 23:53:30,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-01 23:53:30,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-01 23:53:30,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-01 23:53:30,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-01 23:53:30,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-01 23:53:30,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-01 23:53:30,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-01 23:53:30,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-01 23:53:30,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-01 23:53:30,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-01 23:53:30,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-01 23:53:30,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-01 23:53:30,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-01 23:53:30,389 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=6.032078739728369E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0013400504203456161); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-01 23:53:30,390 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1143040849:83 , srv1643637571:83 , srv1766312874:83 , srv2058216910:83 , srv707024597:83 , srv753115845:83 , srv828354542:83 , srv1010575405:84 , srv1024759072:84 , srv1028943587:84 , srv1033270026:84 , srv1050886135:84 , srv1087098016:84 , srv1089641496:84 , srv1104840967:84 , srv1131746397:84 , srv1165178112:84 , srv118345781:84 , srv1183947208:84 , srv1229067500:84 , srv1262691837:84 , srv1290300511:84 , srv130318113:84 , srv1334008383:84 , srv1334555963:84 , srv1365284647:84 , srv1427475917:84 , srv1429470867:84 , srv1465246468:84 , srv1562288361:84 , srv1567670177:84 , srv1574948321:84 , srv1578597344:84 , srv1592696041:84 , srv1745937983:84 , srv1748868057:84 , srv1793469096:84 , srv1793813840:84 , srv1794380649:84 , srv1873475509:84 , srv1926540423:84 , srv1950628194:84 , srv1962759702:84 , srv1971968263:84 , srv1980581123:84 , srv1999746418:84 , srv2010866102:84 , srv2020027703:84 , srv2035984762:84 , srv2050424406:84 , srv2076664770:84 , srv2103492409:84 , srv2105937119:84 , srv2114842794:84 , srv2120554966:84 , srv2125039689:84 , srv213763494:84 , srv218203552:84 , srv252879566:84 , srv276056698:84 , srv312337358:84 , srv331866105:84 , srv334845597:84 , srv355085824:84 , srv374888468:84 , srv400105022:84 , srv416645775:84 , srv436177704:84 , srv443021804:84 , srv455007314:84 , srv552200347:84 , srv567149199:84 , srv580316993:84 , srv590896780:84 , srv596757478:84 , srv663685544:84 , srv690213124:84 , srv697728904:84 , srv706073440:84 , srv729520102:84 , srv74267724:84 , srv75943052:84 , srv78667786:84 , srv851302580:84 , srv867360198:84 , srv872145925:84 , srv902940153:84 , srv929278446:84 , srv932793394:84 , srv9534976:84 , srv957665037:84 , srv996714616:84 , srv1120657537:85 , srv1448541947:85 , srv2009825325:85 , srv212501333:85 , srv493393121:85 , srv620818273:85 , srv883700612:85 , srv101222837:684 }
2023-10-01 23:53:30,427 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=354 (was 354), ProcessCount=179 (was 172) - ProcessCount LEAK? -, AvailableMemoryMB=2574 (was 2598)
2023-10-01 23:53:30,439 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=354, ProcessCount=178, AvailableMemoryMB=2574
2023-10-01 23:53:30,439 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-01 23:53:30,440 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-10-01 23:53:30,452 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1041472571:84 , srv1261741408:84 , srv1285399271:84 , srv1304452990:84 , srv1472491913:84 , srv1573905233:84 , srv16118389:84 , srv1801311691:84 , srv1809617742:84 , srv1815727082:84 , srv1885250567:84 , srv1923456464:84 , srv1987549921:84 , srv2050823070:84 , srv2083281823:84 , srv2126968324:84 , srv2146532984:84 , srv229894038:84 , srv233973345:84 , srv258705517:84 , srv28436286:84 , srv429049922:84 , srv46316371:84 , srv705695227:84 , srv726210798:84 , srv746746441:84 , srv914260434:84 , srv92562290:84 , srv965657414:84 , srv1258383795:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-10-01 23:53:30,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-01 23:53:30,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2050823070=14, srv28436286=21, srv233973345=19, srv429049922=22, srv1885250567=11, srv1573905233=6, srv726210798=25, srv1285399271=3, srv1815727082=10, srv1987549921=13, srv914260434=27, srv1809617742=9, srv1923456464=12, srv1041472571=0, srv1258383795=1, srv92562290=28, srv1472491913=5, srv2126968324=16, srv2146532984=17, srv229894038=18, srv16118389=7, srv746746441=26, srv965657414=29, srv1304452990=4, srv258705517=20, srv46316371=23, srv2083281823=15, srv1261741408=2, srv1801311691=8, srv705695227=24} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-01 23:53:30,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-01 23:53:30,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-01 23:53:30,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-01 23:53:30,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-01 23:53:30,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-01 23:53:30,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-01 23:53:30,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-01 23:53:30,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-01 23:53:30,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-01 23:53:30,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-01 23:53:30,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-01 23:53:30,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-01 23:53:30,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-01 23:53:30,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-01 23:53:30,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-01 23:53:30,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-01 23:53:30,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-01 23:53:30,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-01 23:53:30,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-01 23:53:30,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-01 23:53:30,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-01 23:53:30,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-01 23:53:30,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-01 23:53:30,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-01 23:53:30,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-01 23:53:30,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-01 23:53:30,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-01 23:53:30,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-01 23:53:30,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-01 23:53:30,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-01 23:53:30,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-10-01 23:53:30,490 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0433486413614586, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-01 23:53:30,490 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912329633417748, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0433486413614586, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-10-01 23:55:30,474 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5568689 different iterations.  Found a solution that moves 1867 regions; Going from a computed imbalance of 0.9912329633417748 to a new imbalance of 4.3576711383728133E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6914814814814815, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-01 23:55:30,481 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1041472571:90 , srv1258383795:90 , srv1261741408:90 , srv1285399271:90 , srv1304452990:90 , srv1472491913:90 , srv1573905233:90 , srv16118389:90 , srv1801311691:90 , srv1809617742:90 , srv1815727082:90 , srv1885250567:90 , srv1923456464:90 , srv1987549921:90 , srv2050823070:90 , srv2083281823:90 , srv2126968324:90 , srv2146532984:90 , srv229894038:90 , srv233973345:90 , srv258705517:90 , srv28436286:90 , srv429049922:90 , srv46316371:90 , srv705695227:90 , srv726210798:90 , srv746746441:90 , srv914260434:90 , srv92562290:90 , srv965657414:90 }
2023-10-01 23:55:30,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-01 23:55:30,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2050823070=14, srv28436286=21, srv233973345=19, srv429049922=22, srv1885250567=11, srv1573905233=6, srv726210798=25, srv1285399271=3, srv1815727082=10, srv1987549921=13, srv914260434=27, srv1809617742=9, srv1923456464=12, srv1041472571=0, srv1258383795=1, srv92562290=28, srv1472491913=5, srv2126968324=16, srv2146532984=17, srv229894038=18, srv16118389=7, srv746746441=26, srv965657414=29, srv1304452990=4, srv258705517=20, srv46316371=23, srv2083281823=15, srv1261741408=2, srv1801311691=8, srv705695227=24} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-01 23:55:30,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-01 23:55:30,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-01 23:55:30,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-01 23:55:30,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-01 23:55:30,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-01 23:55:30,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-01 23:55:30,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-01 23:55:30,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-01 23:55:30,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-01 23:55:30,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-01 23:55:30,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-01 23:55:30,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-01 23:55:30,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-01 23:55:30,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-01 23:55:30,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-01 23:55:30,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-01 23:55:30,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-01 23:55:30,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-01 23:55:30,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-01 23:55:30,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-01 23:55:30,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-01 23:55:30,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-01 23:55:30,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-01 23:55:30,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-01 23:55:30,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-01 23:55:30,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-01 23:55:30,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-01 23:55:30,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-01 23:55:30,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-01 23:55:30,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-01 23:55:30,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-10-01 23:55:30,500 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-01 23:55:30,501 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1041472571:90 , srv1258383795:90 , srv1261741408:90 , srv1285399271:90 , srv1304452990:90 , srv1472491913:90 , srv1573905233:90 , srv16118389:90 , srv1801311691:90 , srv1809617742:90 , srv1815727082:90 , srv1885250567:90 , srv1923456464:90 , srv1987549921:90 , srv2050823070:90 , srv2083281823:90 , srv2126968324:90 , srv2146532984:90 , srv229894038:90 , srv233973345:90 , srv258705517:90 , srv28436286:90 , srv429049922:90 , srv46316371:90 , srv705695227:90 , srv726210798:90 , srv746746441:90 , srv914260434:90 , srv92562290:90 , srv965657414:90 }
2023-10-01 23:55:30,516 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=183 (was 354), ProcessCount=210 (was 178) - ProcessCount LEAK? -, AvailableMemoryMB=1356 (was 2574)