2023-11-07 15:55:27,482 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-11-07 15:55:27,750 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-11-07 15:55:27,853 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-11-07 15:55:27,911 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-11-07 15:55:27,918 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-11-07 15:55:27,930 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=206, ProcessCount=167, AvailableMemoryMB=8278
2023-11-07 15:55:27,932 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-11-07 15:55:27,932 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-11-07 15:55:28,045 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1006401304:84 , srv1006960420:84 , srv1073211645:84 , srv1092042260:84 , srv1149847923:84 , srv1164243724:84 , srv1180452241:84 , srv1209923360:84 , srv1247120938:84 , srv1261672659:84 , srv1286411964:84 , srv1316567750:84 , srv1317074439:84 , srv1334135185:84 , srv1351170063:84 , srv1369720749:84 , srv1393493995:84 , srv1420517587:84 , srv1442360350:84 , srv1471752275:84 , srv1472825670:84 , srv1493681110:84 , srv1545192300:84 , srv1575809715:84 , srv1595702455:84 , srv1610820980:84 , srv1612736088:84 , srv1652325908:84 , srv1654642428:84 , srv1661206303:84 , srv1669969860:84 , srv1708271259:84 , srv17477347:84 , srv1788144250:84 , srv1796395399:84 , srv1806263837:84 , srv1845535711:84 , srv1848888547:84 , srv1852050646:84 , srv1878654517:84 , srv1925043264:84 , srv1927696963:84 , srv1928021695:84 , srv1932978880:84 , srv1934015302:84 , srv1935137564:84 , srv1951763923:84 , srv196859042:84 , srv1992464628:84 , srv204469087:84 , srv2053709207:84 , srv2125641615:84 , srv2134716622:84 , srv234938856:84 , srv239423807:84 , srv258247870:84 , srv261634810:84 , srv263746771:84 , srv287512140:84 , srv294709308:84 , srv309439095:84 , srv314718383:84 , srv328527389:84 , srv349563696:84 , srv360330910:84 , srv361088364:84 , srv365507441:84 , srv390950910:84 , srv39827124:84 , srv403777051:84 , srv404123619:84 , srv459762062:84 , srv464463111:84 , srv513340614:84 , srv569435079:84 , srv593824217:84 , srv60523310:84 , srv606337216:84 , srv631189991:84 , srv642237963:84 , srv656558556:84 , srv662074311:84 , srv664018562:84 , srv665687219:84 , srv670871252:84 , srv758707877:84 , srv77267273:84 , srv77477511:84 , srv784124632:84 , srv787537513:84 , srv810104101:84 , srv821551793:84 , srv837386615:84 , srv839067345:84 , srv839952130:84 , srv858609890:84 , srv887995149:84 , srv906413767:84 , srv907162911:84 , srv286961839:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-11-07 15:55:28,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-07 15:55:28,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv286961839=58, srv261634810=56, srv670871252=85, srv1661206303=29, srv1471752275=19, srv1992464628=48, srv328527389=63, srv1316567750=11, srv258247870=55, srv1247120938=8, srv1852050646=38, srv642237963=80, srv60523310=77, srv839952130=95, srv1806263837=35, srv360330910=65, srv196859042=47, srv77267273=87, srv662074311=82, srv907162911=99, srv1472825670=20, srv1209923360=7, srv1442360350=18, srv239423807=54, srv390950910=68, srv1796395399=34, srv569435079=75, srv361088364=66, srv404123619=71, srv1493681110=21, srv1261672659=9, srv204469087=49, srv1612736088=26, srv349563696=64, srv1848888547=37, srv1927696963=41, srv2053709207=50, srv1164243724=5, srv1878654517=39, srv656558556=81, srv1669969860=30, srv1932978880=43, srv631189991=79, srv821551793=92, srv1006401304=0, srv1610820980=25, srv1334135185=13, srv403777051=70, srv1369720749=15, srv1708271259=31, srv1575809715=23, srv1092042260=3, srv887995149=97, srv1652325908=27, srv309439095=61, srv17477347=32, srv758707877=86, srv1545192300=22, srv1286411964=10, srv1934015302=44, srv287512140=59, srv1351170063=14, srv459762062=72, srv314718383=62, srv365507441=67, srv1149847923=4, srv1420517587=17, srv294709308=60, srv464463111=73, srv664018562=83, srv784124632=89, srv837386615=93, srv1180452241=6, srv787537513=90, srv906413767=98, srv593824217=76, srv1935137564=45, srv1317074439=12, srv1073211645=2, srv1951763923=46, srv810104101=91, srv1788144250=33, srv1595702455=24, srv665687219=84, srv2125641615=51, srv513340614=74, srv1845535711=36, srv1006960420=1, srv263746771=57, srv1654642428=28, srv234938856=53, srv606337216=78, srv858609890=96, srv2134716622=52, srv77477511=88, srv1925043264=40, srv1928021695=42, srv1393493995=16, srv39827124=69, srv839067345=94} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-07 15:55:28,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-07 15:55:28,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-07 15:55:28,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-07 15:55:28,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-07 15:55:28,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-07 15:55:28,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-07 15:55:28,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-07 15:55:28,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-07 15:55:28,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-07 15:55:28,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-07 15:55:28,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-07 15:55:28,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-07 15:55:28,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-07 15:55:28,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-07 15:55:28,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-07 15:55:28,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-07 15:55:28,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-07 15:55:28,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-07 15:55:28,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-07 15:55:28,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-07 15:55:28,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-07 15:55:28,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-07 15:55:28,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-07 15:55:28,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-07 15:55:28,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-07 15:55:28,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-07 15:55:28,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-07 15:55:28,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-07 15:55:28,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-07 15:55:28,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-07 15:55:28,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-07 15:55:28,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-07 15:55:28,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-07 15:55:28,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-07 15:55:28,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-07 15:55:28,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-07 15:55:28,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-07 15:55:28,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-07 15:55:28,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-07 15:55:28,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-07 15:55:28,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-07 15:55:28,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-07 15:55:28,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-07 15:55:28,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-07 15:55:28,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-07 15:55:28,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-07 15:55:28,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-07 15:55:28,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-07 15:55:28,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-07 15:55:28,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-07 15:55:28,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-07 15:55:28,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-07 15:55:28,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-07 15:55:28,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-07 15:55:28,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-07 15:55:28,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-07 15:55:28,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-07 15:55:28,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-07 15:55:28,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-07 15:55:28,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-07 15:55:28,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-07 15:55:28,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-07 15:55:28,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-07 15:55:28,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-07 15:55:28,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-07 15:55:28,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-07 15:55:28,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-07 15:55:28,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-07 15:55:28,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-07 15:55:28,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-07 15:55:28,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-07 15:55:28,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-07 15:55:28,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-07 15:55:28,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-07 15:55:28,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-07 15:55:28,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-07 15:55:28,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-07 15:55:28,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-07 15:55:28,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-07 15:55:28,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-07 15:55:28,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-07 15:55:28,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-07 15:55:28,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-07 15:55:28,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-07 15:55:28,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-07 15:55:28,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-07 15:55:28,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-07 15:55:28,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-07 15:55:28,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-07 15:55:28,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-07 15:55:28,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-07 15:55:28,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-07 15:55:28,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-07 15:55:28,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-07 15:55:28,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-07 15:55:28,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-07 15:55:28,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-07 15:55:28,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-07 15:55:28,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-07 15:55:28,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-07 15:55:28,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-07 15:55:28,411 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-07 15:55:28,411 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-07 15:55:28,411 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-07 15:55:28,769 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 609 ms to try 5000 different iterations.  Found a solution that moves 4715 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.1779136724851784. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0359017934150963, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05348463387372172, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5238888888888888, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0359017934150963, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17308333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24041666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-07 15:55:28,779 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1209923360:82 , srv1654642428:82 , srv1164243724:83 , srv1595702455:83 , srv1951763923:83 , srv234938856:83 , srv261634810:83 , srv664018562:83 , srv1471752275:84 , srv1935137564:84 , srv258247870:84 , srv459762062:84 , srv758707877:84 , srv887995149:84 , srv1092042260:85 , srv1261672659:85 , srv1612736088:85 , srv1652325908:85 , srv1708271259:85 , srv17477347:85 , srv196859042:85 , srv1992464628:85 , srv328527389:85 , srv390950910:85 , srv569435079:85 , srv60523310:85 , srv642237963:85 , srv77477511:85 , srv784124632:85 , srv839067345:85 , srv839952130:85 , srv858609890:85 , srv1316567750:86 , srv1317074439:86 , srv1442360350:86 , srv1472825670:86 , srv1575809715:86 , srv204469087:86 , srv2125641615:86 , srv2134716622:86 , srv287512140:86 , srv361088364:86 , srv365507441:86 , srv404123619:86 , srv464463111:86 , srv513340614:86 , srv656558556:86 , srv810104101:86 , srv837386615:86 , srv1006401304:87 , srv1149847923:87 , srv1334135185:87 , srv1369720749:87 , srv1393493995:87 , srv1610820980:87 , srv1661206303:87 , srv1788144250:87 , srv1806263837:87 , srv1848888547:87 , srv1852050646:87 , srv1932978880:87 , srv294709308:87 , srv314718383:87 , srv403777051:87 , srv662074311:87 , srv665687219:87 , srv670871252:87 , srv1796395399:88 , srv1845535711:88 , srv1925043264:88 , srv1927696963:88 , srv1934015302:88 , srv239423807:88 , srv349563696:88 , srv360330910:88 , srv593824217:88 , srv606337216:88 , srv787537513:88 , srv1180452241:89 , srv1420517587:89 , srv77267273:89 , srv821551793:89 , srv1247120938:90 , srv1545192300:90 , srv1669969860:90 , srv1878654517:90 , srv263746771:90 , srv309439095:90 , srv39827124:90 , srv631189991:90 , srv907162911:90 , srv1006960420:91 , srv1073211645:91 , srv1286411964:91 , srv1493681110:91 , srv906413767:91 , srv1928021695:92 , srv2053709207:92 , srv1351170063:94 , srv286961839:409 }
2023-11-07 15:55:28,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-07 15:55:28,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv286961839=58, srv261634810=56, srv670871252=85, srv1661206303=29, srv1471752275=19, srv1992464628=48, srv328527389=63, srv1316567750=11, srv258247870=55, srv1247120938=8, srv1852050646=38, srv642237963=80, srv60523310=77, srv839952130=95, srv1806263837=35, srv360330910=65, srv196859042=47, srv77267273=87, srv662074311=82, srv907162911=99, srv1472825670=20, srv1209923360=7, srv1442360350=18, srv239423807=54, srv390950910=68, srv1796395399=34, srv569435079=75, srv361088364=66, srv404123619=71, srv1493681110=21, srv1261672659=9, srv204469087=49, srv1612736088=26, srv349563696=64, srv1848888547=37, srv1927696963=41, srv2053709207=50, srv1164243724=5, srv1878654517=39, srv656558556=81, srv1669969860=30, srv1932978880=43, srv631189991=79, srv821551793=92, srv1006401304=0, srv1610820980=25, srv1334135185=13, srv403777051=70, srv1369720749=15, srv1708271259=31, srv1575809715=23, srv1092042260=3, srv887995149=97, srv1652325908=27, srv309439095=61, srv17477347=32, srv758707877=86, srv1545192300=22, srv1286411964=10, srv1934015302=44, srv287512140=59, srv1351170063=14, srv459762062=72, srv314718383=62, srv365507441=67, srv1149847923=4, srv1420517587=17, srv294709308=60, srv464463111=73, srv664018562=83, srv784124632=89, srv837386615=93, srv1180452241=6, srv787537513=90, srv906413767=98, srv593824217=76, srv1935137564=45, srv1317074439=12, srv1073211645=2, srv1951763923=46, srv810104101=91, srv1788144250=33, srv1595702455=24, srv665687219=84, srv2125641615=51, srv513340614=74, srv1845535711=36, srv1006960420=1, srv263746771=57, srv1654642428=28, srv234938856=53, srv606337216=78, srv858609890=96, srv2134716622=52, srv77477511=88, srv1925043264=40, srv1928021695=42, srv1393493995=16, srv39827124=69, srv839067345=94} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-07 15:55:28,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-07 15:55:28,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-07 15:55:28,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-07 15:55:28,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-07 15:55:28,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-07 15:55:28,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-07 15:55:28,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-07 15:55:28,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-07 15:55:28,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-07 15:55:28,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-07 15:55:28,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-07 15:55:28,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-07 15:55:28,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-07 15:55:28,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-07 15:55:28,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-07 15:55:28,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-07 15:55:28,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-07 15:55:28,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-07 15:55:28,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-07 15:55:28,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-07 15:55:28,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-07 15:55:28,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-07 15:55:28,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-07 15:55:28,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-07 15:55:28,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-07 15:55:28,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-07 15:55:28,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-07 15:55:28,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-07 15:55:28,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-07 15:55:28,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-07 15:55:28,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-07 15:55:28,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-07 15:55:28,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-07 15:55:28,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-07 15:55:28,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-07 15:55:28,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-07 15:55:28,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-07 15:55:28,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-07 15:55:28,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-07 15:55:28,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-07 15:55:28,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-07 15:55:28,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-07 15:55:28,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-07 15:55:28,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-07 15:55:28,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-07 15:55:28,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-07 15:55:28,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-07 15:55:28,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-07 15:55:28,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-07 15:55:28,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-07 15:55:28,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-07 15:55:28,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-07 15:55:28,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-07 15:55:28,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-07 15:55:28,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-07 15:55:28,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-07 15:55:28,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-07 15:55:28,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-07 15:55:28,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-07 15:55:28,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-07 15:55:28,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-07 15:55:28,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-07 15:55:28,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-07 15:55:28,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-07 15:55:28,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-07 15:55:28,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-07 15:55:28,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-07 15:55:28,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-07 15:55:28,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-07 15:55:28,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-07 15:55:28,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-07 15:55:28,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-07 15:55:28,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-07 15:55:28,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-07 15:55:28,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-07 15:55:28,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-07 15:55:28,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-07 15:55:28,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-07 15:55:28,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-07 15:55:28,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-07 15:55:28,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-07 15:55:28,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-07 15:55:28,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-07 15:55:28,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-07 15:55:28,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-07 15:55:28,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-07 15:55:28,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-07 15:55:28,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-07 15:55:28,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-07 15:55:28,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-07 15:55:28,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-07 15:55:28,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-07 15:55:28,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-07 15:55:28,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-07 15:55:28,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-07 15:55:28,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-07 15:55:28,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-07 15:55:28,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-07 15:55:28,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-07 15:55:28,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-07 15:55:28,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-07 15:55:29,003 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0359017934150963, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05348463387372172, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0359017934150963, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17308333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24041666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-07 15:55:29,003 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-07 15:55:29,003 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17788065734953173, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0359017934150963, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05348463387372172, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0359017934150963, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17308333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24041666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-07 15:55:29,255 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 427 ms to try 5000 different iterations.  Found a solution that moves 2643 regions; Going from a computed imbalance of 0.17788065734953173 to a new imbalance of 0.016413833293093767. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.019817725328268167); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03274908862603872, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2936666666666667, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.019817725328268167); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01325); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04691666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-07 15:55:29,267 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1006960420:77 , srv1351170063:77 , srv1493681110:79 , srv2053709207:80 , srv906413767:80 , srv1073211645:81 , srv1928021695:81 , srv77267273:81 , srv1006401304:82 , srv1247120938:82 , srv1286411964:82 , srv1545192300:82 , srv1669969860:82 , srv1878654517:82 , srv263746771:82 , srv1393493995:83 , srv1420517587:83 , srv1796395399:83 , srv349563696:83 , srv360330910:83 , srv593824217:83 , srv907162911:83 , srv1180452241:84 , srv1316567750:84 , srv1788144250:84 , srv1806263837:84 , srv1845535711:84 , srv1925043264:84 , srv1927696963:84 , srv204469087:84 , srv239423807:84 , srv39827124:84 , srv631189991:84 , srv665687219:84 , srv821551793:84 , srv1149847923:85 , srv1317074439:85 , srv1934015302:85 , srv287512140:85 , srv294709308:85 , srv361088364:85 , srv390950910:85 , srv606337216:85 , srv670871252:85 , srv758707877:85 , srv837386615:85 , srv1334135185:86 , srv1575809715:86 , srv1610820980:86 , srv1652325908:86 , srv1932978880:86 , srv196859042:86 , srv309439095:86 , srv314718383:86 , srv464463111:86 , srv513340614:86 , srv569435079:86 , srv656558556:86 , srv662074311:86 , srv787537513:86 , srv810104101:86 , srv839952130:86 , srv1442360350:87 , srv1472825670:87 , srv1595702455:87 , srv1848888547:87 , srv1852050646:87 , srv2125641615:87 , srv328527389:87 , srv365507441:87 , srv403777051:87 , srv404123619:87 , srv77477511:87 , srv1092042260:88 , srv1369720749:88 , srv1612736088:88 , srv1654642428:88 , srv1661206303:88 , srv1708271259:88 , srv1992464628:88 , srv234938856:88 , srv642237963:88 , srv858609890:88 , srv1164243724:89 , srv1209923360:89 , srv1471752275:89 , srv17477347:89 , srv1935137564:89 , srv2134716622:89 , srv258247870:89 , srv261634810:89 , srv459762062:89 , srv60523310:89 , srv784124632:89 , srv839067345:89 , srv1261672659:90 , srv1951763923:90 , srv664018562:90 , srv887995149:90 , srv286961839:541 }
2023-11-07 15:55:29,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-07 15:55:29,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv286961839=58, srv261634810=56, srv670871252=85, srv1661206303=29, srv1471752275=19, srv1992464628=48, srv328527389=63, srv1316567750=11, srv258247870=55, srv1247120938=8, srv1852050646=38, srv642237963=80, srv60523310=77, srv839952130=95, srv1806263837=35, srv360330910=65, srv196859042=47, srv77267273=87, srv662074311=82, srv907162911=99, srv1472825670=20, srv1209923360=7, srv1442360350=18, srv239423807=54, srv390950910=68, srv1796395399=34, srv569435079=75, srv361088364=66, srv404123619=71, srv1493681110=21, srv1261672659=9, srv204469087=49, srv1612736088=26, srv349563696=64, srv1848888547=37, srv1927696963=41, srv2053709207=50, srv1164243724=5, srv1878654517=39, srv656558556=81, srv1669969860=30, srv1932978880=43, srv631189991=79, srv821551793=92, srv1006401304=0, srv1610820980=25, srv1334135185=13, srv403777051=70, srv1369720749=15, srv1708271259=31, srv1575809715=23, srv1092042260=3, srv887995149=97, srv1652325908=27, srv309439095=61, srv17477347=32, srv758707877=86, srv1545192300=22, srv1286411964=10, srv1934015302=44, srv287512140=59, srv1351170063=14, srv459762062=72, srv314718383=62, srv365507441=67, srv1149847923=4, srv1420517587=17, srv294709308=60, srv464463111=73, srv664018562=83, srv784124632=89, srv837386615=93, srv1180452241=6, srv787537513=90, srv906413767=98, srv593824217=76, srv1935137564=45, srv1317074439=12, srv1073211645=2, srv1951763923=46, srv810104101=91, srv1788144250=33, srv1595702455=24, srv665687219=84, srv2125641615=51, srv513340614=74, srv1845535711=36, srv1006960420=1, srv263746771=57, srv1654642428=28, srv234938856=53, srv606337216=78, srv858609890=96, srv2134716622=52, srv77477511=88, srv1925043264=40, srv1928021695=42, srv1393493995=16, srv39827124=69, srv839067345=94} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-07 15:55:29,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-07 15:55:29,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-07 15:55:29,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-07 15:55:29,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-07 15:55:29,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-07 15:55:29,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-07 15:55:29,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-07 15:55:29,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-07 15:55:29,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-07 15:55:29,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-07 15:55:29,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-07 15:55:29,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-07 15:55:29,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-07 15:55:29,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-07 15:55:29,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-07 15:55:29,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-07 15:55:29,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-07 15:55:29,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-07 15:55:29,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-07 15:55:29,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-07 15:55:29,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-07 15:55:29,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-07 15:55:29,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-07 15:55:29,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-07 15:55:29,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-07 15:55:29,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-07 15:55:29,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-07 15:55:29,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-07 15:55:29,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-07 15:55:29,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-07 15:55:29,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-07 15:55:29,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-07 15:55:29,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-07 15:55:29,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-07 15:55:29,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-07 15:55:29,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-07 15:55:29,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-07 15:55:29,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-07 15:55:29,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-07 15:55:29,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-07 15:55:29,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-07 15:55:29,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-07 15:55:29,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-07 15:55:29,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-07 15:55:29,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-07 15:55:29,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-07 15:55:29,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-07 15:55:29,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-07 15:55:29,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-07 15:55:29,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-07 15:55:29,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-07 15:55:29,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-07 15:55:29,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-07 15:55:29,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-07 15:55:29,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-07 15:55:29,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-07 15:55:29,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-07 15:55:29,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-07 15:55:29,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-07 15:55:29,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-07 15:55:29,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-07 15:55:29,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-07 15:55:29,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-07 15:55:29,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-07 15:55:29,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-07 15:55:29,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-07 15:55:29,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-07 15:55:29,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-07 15:55:29,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-07 15:55:29,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-07 15:55:29,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-07 15:55:29,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-07 15:55:29,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-07 15:55:29,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-07 15:55:29,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-07 15:55:29,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-07 15:55:29,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-07 15:55:29,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-07 15:55:29,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-07 15:55:29,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-07 15:55:29,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-07 15:55:29,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-07 15:55:29,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-07 15:55:29,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-07 15:55:29,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-07 15:55:29,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-07 15:55:29,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-07 15:55:29,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-07 15:55:29,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-07 15:55:29,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-07 15:55:29,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-07 15:55:29,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-07 15:55:29,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-07 15:55:29,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-07 15:55:29,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-07 15:55:29,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-07 15:55:29,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-07 15:55:29,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-07 15:55:29,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-07 15:55:29,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-07 15:55:29,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-07 15:55:29,463 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.019817725328268167); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03274908862603872, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.019817725328268167); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01325); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04691666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-07 15:55:29,463 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-07 15:55:29,463 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.01639532661154253, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.019817725328268167); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03274908862603872, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.019817725328268167); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01325); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04691666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-07 15:55:29,729 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 404 ms to try 5000 different iterations.  Found a solution that moves 1020 regions; Going from a computed imbalance of 0.01639532661154253 to a new imbalance of 5.214920792865867E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006311133241610871); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010845305479975394); MoveCostFunction : (multiplier=7.0, imbalance=0.11333333333333333, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006311133241610871); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0031666666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-07 15:55:29,732 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1261672659:82 , srv1369720749:82 , srv1661206303:82 , srv2134716622:82 , srv309439095:82 , srv1852050646:83 , srv403777051:83 , srv60523310:83 , srv631189991:83 , srv784124632:83 , srv839067345:83 , srv1180452241:84 , srv1334135185:84 , srv1472825670:84 , srv17477347:84 , srv1848888547:84 , srv1928021695:84 , srv1932978880:84 , srv1934015302:84 , srv1935137564:84 , srv1951763923:84 , srv314718383:84 , srv39827124:84 , srv404123619:84 , srv459762062:84 , srv606337216:84 , srv642237963:84 , srv787537513:84 , srv858609890:84 , srv887995149:84 , srv1092042260:85 , srv1164243724:85 , srv1247120938:85 , srv1286411964:85 , srv1420517587:85 , srv1442360350:85 , srv1471752275:85 , srv1545192300:85 , srv1575809715:85 , srv1610820980:85 , srv1612736088:85 , srv1669969860:85 , srv1708271259:85 , srv1925043264:85 , srv1992464628:85 , srv2053709207:85 , srv2125641615:85 , srv239423807:85 , srv258247870:85 , srv261634810:85 , srv263746771:85 , srv365507441:85 , srv464463111:85 , srv662074311:85 , srv664018562:85 , srv821551793:85 , srv907162911:85 , srv1073211645:86 , srv1149847923:86 , srv1209923360:86 , srv1317074439:86 , srv1351170063:86 , srv1788144250:86 , srv1796395399:86 , srv1806263837:86 , srv1845535711:86 , srv1878654517:86 , srv1927696963:86 , srv328527389:86 , srv361088364:86 , srv513340614:86 , srv569435079:86 , srv593824217:86 , srv656558556:86 , srv665687219:86 , srv670871252:86 , srv77477511:86 , srv810104101:86 , srv839952130:86 , srv906413767:86 , srv1316567750:87 , srv1393493995:87 , srv1493681110:87 , srv1652325908:87 , srv1654642428:87 , srv196859042:87 , srv204469087:87 , srv234938856:87 , srv287512140:87 , srv294709308:87 , srv349563696:87 , srv360330910:87 , srv77267273:87 , srv837386615:87 , srv1006401304:88 , srv1595702455:88 , srv390950910:88 , srv758707877:88 , srv1006960420:89 , srv286961839:564 }
2023-11-07 15:55:29,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-07 15:55:29,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv286961839=58, srv261634810=56, srv670871252=85, srv1661206303=29, srv1471752275=19, srv1992464628=48, srv328527389=63, srv1316567750=11, srv258247870=55, srv1247120938=8, srv1852050646=38, srv642237963=80, srv60523310=77, srv839952130=95, srv1806263837=35, srv360330910=65, srv196859042=47, srv77267273=87, srv662074311=82, srv907162911=99, srv1472825670=20, srv1209923360=7, srv1442360350=18, srv239423807=54, srv390950910=68, srv1796395399=34, srv569435079=75, srv361088364=66, srv404123619=71, srv1493681110=21, srv1261672659=9, srv204469087=49, srv1612736088=26, srv349563696=64, srv1848888547=37, srv1927696963=41, srv2053709207=50, srv1164243724=5, srv1878654517=39, srv656558556=81, srv1669969860=30, srv1932978880=43, srv631189991=79, srv821551793=92, srv1006401304=0, srv1610820980=25, srv1334135185=13, srv403777051=70, srv1369720749=15, srv1708271259=31, srv1575809715=23, srv1092042260=3, srv887995149=97, srv1652325908=27, srv309439095=61, srv17477347=32, srv758707877=86, srv1545192300=22, srv1286411964=10, srv1934015302=44, srv287512140=59, srv1351170063=14, srv459762062=72, srv314718383=62, srv365507441=67, srv1149847923=4, srv1420517587=17, srv294709308=60, srv464463111=73, srv664018562=83, srv784124632=89, srv837386615=93, srv1180452241=6, srv787537513=90, srv906413767=98, srv593824217=76, srv1935137564=45, srv1317074439=12, srv1073211645=2, srv1951763923=46, srv810104101=91, srv1788144250=33, srv1595702455=24, srv665687219=84, srv2125641615=51, srv513340614=74, srv1845535711=36, srv1006960420=1, srv263746771=57, srv1654642428=28, srv234938856=53, srv606337216=78, srv858609890=96, srv2134716622=52, srv77477511=88, srv1925043264=40, srv1928021695=42, srv1393493995=16, srv39827124=69, srv839067345=94} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-07 15:55:29,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-07 15:55:29,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-07 15:55:29,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-07 15:55:29,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-07 15:55:29,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-07 15:55:29,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-07 15:55:29,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-07 15:55:29,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-07 15:55:29,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-07 15:55:29,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-07 15:55:29,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-07 15:55:29,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-07 15:55:29,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-07 15:55:29,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-07 15:55:29,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-07 15:55:29,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-07 15:55:29,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-07 15:55:29,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-07 15:55:29,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-07 15:55:29,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-07 15:55:29,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-07 15:55:29,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-07 15:55:29,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-07 15:55:29,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-07 15:55:29,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-07 15:55:29,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-07 15:55:29,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-07 15:55:29,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-07 15:55:29,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-07 15:55:29,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-07 15:55:29,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-07 15:55:29,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-07 15:55:29,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-07 15:55:29,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-07 15:55:29,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-07 15:55:29,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-07 15:55:29,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-07 15:55:29,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-07 15:55:29,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-07 15:55:29,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-07 15:55:29,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-07 15:55:29,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-07 15:55:29,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-07 15:55:29,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-07 15:55:29,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-07 15:55:29,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-07 15:55:29,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-07 15:55:29,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-07 15:55:29,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-07 15:55:29,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-07 15:55:29,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-07 15:55:29,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-07 15:55:29,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-07 15:55:29,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-07 15:55:29,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-07 15:55:29,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-07 15:55:29,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-07 15:55:29,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-07 15:55:29,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-07 15:55:29,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-07 15:55:29,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-07 15:55:29,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-07 15:55:29,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-07 15:55:29,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-07 15:55:29,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-07 15:55:29,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-07 15:55:29,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-07 15:55:29,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-07 15:55:29,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-07 15:55:29,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-07 15:55:29,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-07 15:55:29,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-07 15:55:29,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-07 15:55:29,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-07 15:55:29,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-07 15:55:29,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-07 15:55:29,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-07 15:55:29,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-07 15:55:29,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-07 15:55:29,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-07 15:55:29,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-07 15:55:29,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-07 15:55:29,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-07 15:55:29,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-07 15:55:29,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-07 15:55:29,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-07 15:55:29,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-07 15:55:29,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-07 15:55:29,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-07 15:55:29,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-07 15:55:29,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-07 15:55:29,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-07 15:55:29,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-07 15:55:29,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-07 15:55:29,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-07 15:55:29,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-07 15:55:29,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-07 15:55:29,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-07 15:55:29,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-07 15:55:29,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-07 15:55:29,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-07 15:55:29,871 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006311133241610871); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010845305479975394); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006311133241610871); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0031666666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-07 15:55:29,871 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-07 15:55:29,871 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=5.143498866334421E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006311133241610871); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010845305479975394); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006311133241610871); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0031666666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-07 15:55:30,232 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 455 ms to try 5000 different iterations.  Found a solution that moves 196 regions; Going from a computed imbalance of 5.143498866334421E-4 to a new imbalance of 1.8125684962769497E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0016412198797244363); MoveCostFunction : (multiplier=7.0, imbalance=0.021777777777777778); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-07 15:55:30,232 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1073211645:83 , srv1092042260:84 , srv1286411964:84 , srv1351170063:84 , srv1420517587:84 , srv1442360350:84 , srv1471752275:84 , srv1595702455:84 , srv1610820980:84 , srv1612736088:84 , srv1652325908:84 , srv1708271259:84 , srv1845535711:84 , srv1848888547:84 , srv1852050646:84 , srv1878654517:84 , srv1951763923:84 , srv196859042:84 , srv1992464628:84 , srv2125641615:84 , srv234938856:84 , srv239423807:84 , srv258247870:84 , srv287512140:84 , srv294709308:84 , srv309439095:84 , srv328527389:84 , srv349563696:84 , srv360330910:84 , srv365507441:84 , srv390950910:84 , srv39827124:84 , srv513340614:84 , srv656558556:84 , srv662074311:84 , srv664018562:84 , srv670871252:84 , srv77477511:84 , srv787537513:84 , srv810104101:84 , srv821551793:84 , srv837386615:84 , srv887995149:84 , srv907162911:84 , srv1006401304:85 , srv1006960420:85 , srv1149847923:85 , srv1164243724:85 , srv1180452241:85 , srv1209923360:85 , srv1247120938:85 , srv1261672659:85 , srv1316567750:85 , srv1317074439:85 , srv1334135185:85 , srv1369720749:85 , srv1393493995:85 , srv1472825670:85 , srv1493681110:85 , srv1545192300:85 , srv1575809715:85 , srv1654642428:85 , srv1661206303:85 , srv1669969860:85 , srv17477347:85 , srv1788144250:85 , srv1796395399:85 , srv1806263837:85 , srv1925043264:85 , srv1927696963:85 , srv1928021695:85 , srv1932978880:85 , srv1934015302:85 , srv1935137564:85 , srv204469087:85 , srv2053709207:85 , srv2134716622:85 , srv263746771:85 , srv314718383:85 , srv361088364:85 , srv403777051:85 , srv404123619:85 , srv459762062:85 , srv464463111:85 , srv569435079:85 , srv593824217:85 , srv60523310:85 , srv606337216:85 , srv631189991:85 , srv642237963:85 , srv758707877:85 , srv77267273:85 , srv784124632:85 , srv839067345:85 , srv839952130:85 , srv858609890:85 , srv906413767:85 , srv261634810:86 , srv665687219:86 , srv286961839:628 }
2023-11-07 15:55:30,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-07 15:55:30,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv286961839=58, srv261634810=56, srv670871252=85, srv1661206303=29, srv1471752275=19, srv1992464628=48, srv328527389=63, srv1316567750=11, srv258247870=55, srv1247120938=8, srv1852050646=38, srv642237963=80, srv60523310=77, srv839952130=95, srv1806263837=35, srv360330910=65, srv196859042=47, srv77267273=87, srv662074311=82, srv907162911=99, srv1472825670=20, srv1209923360=7, srv1442360350=18, srv239423807=54, srv390950910=68, srv1796395399=34, srv569435079=75, srv361088364=66, srv404123619=71, srv1493681110=21, srv1261672659=9, srv204469087=49, srv1612736088=26, srv349563696=64, srv1848888547=37, srv1927696963=41, srv2053709207=50, srv1164243724=5, srv1878654517=39, srv656558556=81, srv1669969860=30, srv1932978880=43, srv631189991=79, srv821551793=92, srv1006401304=0, srv1610820980=25, srv1334135185=13, srv403777051=70, srv1369720749=15, srv1708271259=31, srv1575809715=23, srv1092042260=3, srv887995149=97, srv1652325908=27, srv309439095=61, srv17477347=32, srv758707877=86, srv1545192300=22, srv1286411964=10, srv1934015302=44, srv287512140=59, srv1351170063=14, srv459762062=72, srv314718383=62, srv365507441=67, srv1149847923=4, srv1420517587=17, srv294709308=60, srv464463111=73, srv664018562=83, srv784124632=89, srv837386615=93, srv1180452241=6, srv787537513=90, srv906413767=98, srv593824217=76, srv1935137564=45, srv1317074439=12, srv1073211645=2, srv1951763923=46, srv810104101=91, srv1788144250=33, srv1595702455=24, srv665687219=84, srv2125641615=51, srv513340614=74, srv1845535711=36, srv1006960420=1, srv263746771=57, srv1654642428=28, srv234938856=53, srv606337216=78, srv858609890=96, srv2134716622=52, srv77477511=88, srv1925043264=40, srv1928021695=42, srv1393493995=16, srv39827124=69, srv839067345=94} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-07 15:55:30,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-07 15:55:30,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-07 15:55:30,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-07 15:55:30,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-07 15:55:30,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-07 15:55:30,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-07 15:55:30,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-07 15:55:30,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-07 15:55:30,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-07 15:55:30,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-07 15:55:30,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-07 15:55:30,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-07 15:55:30,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-07 15:55:30,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-07 15:55:30,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-07 15:55:30,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-07 15:55:30,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-07 15:55:30,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-07 15:55:30,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-07 15:55:30,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-07 15:55:30,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-07 15:55:30,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-07 15:55:30,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-07 15:55:30,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-07 15:55:30,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-07 15:55:30,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-07 15:55:30,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-07 15:55:30,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-07 15:55:30,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-07 15:55:30,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-07 15:55:30,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-07 15:55:30,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-07 15:55:30,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-07 15:55:30,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-07 15:55:30,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-07 15:55:30,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-07 15:55:30,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-07 15:55:30,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-07 15:55:30,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-07 15:55:30,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-07 15:55:30,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-07 15:55:30,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-07 15:55:30,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-07 15:55:30,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-07 15:55:30,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-07 15:55:30,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-07 15:55:30,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-07 15:55:30,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-07 15:55:30,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-07 15:55:30,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-07 15:55:30,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-07 15:55:30,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-07 15:55:30,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-07 15:55:30,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-07 15:55:30,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-07 15:55:30,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-07 15:55:30,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-07 15:55:30,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-07 15:55:30,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-07 15:55:30,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-07 15:55:30,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-07 15:55:30,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-07 15:55:30,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-07 15:55:30,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-07 15:55:30,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-07 15:55:30,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-07 15:55:30,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-07 15:55:30,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-07 15:55:30,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-07 15:55:30,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-07 15:55:30,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-07 15:55:30,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-07 15:55:30,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-07 15:55:30,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-07 15:55:30,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-07 15:55:30,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-07 15:55:30,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-07 15:55:30,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-07 15:55:30,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-07 15:55:30,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-07 15:55:30,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-07 15:55:30,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-07 15:55:30,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-07 15:55:30,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-07 15:55:30,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-07 15:55:30,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-07 15:55:30,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-07 15:55:30,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-07 15:55:30,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-07 15:55:30,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-07 15:55:30,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-07 15:55:30,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-07 15:55:30,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-07 15:55:30,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-07 15:55:30,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-07 15:55:30,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-07 15:55:30,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-07 15:55:30,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-07 15:55:30,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-07 15:55:30,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-07 15:55:30,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-07 15:55:30,356 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=1.675326362942016E-5 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0016412198797244363); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-07 15:55:30,357 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1073211645:83 , srv1092042260:84 , srv1286411964:84 , srv1351170063:84 , srv1420517587:84 , srv1442360350:84 , srv1471752275:84 , srv1595702455:84 , srv1610820980:84 , srv1612736088:84 , srv1652325908:84 , srv1708271259:84 , srv1845535711:84 , srv1848888547:84 , srv1852050646:84 , srv1878654517:84 , srv1951763923:84 , srv196859042:84 , srv1992464628:84 , srv2125641615:84 , srv234938856:84 , srv239423807:84 , srv258247870:84 , srv287512140:84 , srv294709308:84 , srv309439095:84 , srv328527389:84 , srv349563696:84 , srv360330910:84 , srv365507441:84 , srv390950910:84 , srv39827124:84 , srv513340614:84 , srv656558556:84 , srv662074311:84 , srv664018562:84 , srv670871252:84 , srv77477511:84 , srv787537513:84 , srv810104101:84 , srv821551793:84 , srv837386615:84 , srv887995149:84 , srv907162911:84 , srv1006401304:85 , srv1006960420:85 , srv1149847923:85 , srv1164243724:85 , srv1180452241:85 , srv1209923360:85 , srv1247120938:85 , srv1261672659:85 , srv1316567750:85 , srv1317074439:85 , srv1334135185:85 , srv1369720749:85 , srv1393493995:85 , srv1472825670:85 , srv1493681110:85 , srv1545192300:85 , srv1575809715:85 , srv1654642428:85 , srv1661206303:85 , srv1669969860:85 , srv17477347:85 , srv1788144250:85 , srv1796395399:85 , srv1806263837:85 , srv1925043264:85 , srv1927696963:85 , srv1928021695:85 , srv1932978880:85 , srv1934015302:85 , srv1935137564:85 , srv204469087:85 , srv2053709207:85 , srv2134716622:85 , srv263746771:85 , srv314718383:85 , srv361088364:85 , srv403777051:85 , srv404123619:85 , srv459762062:85 , srv464463111:85 , srv569435079:85 , srv593824217:85 , srv60523310:85 , srv606337216:85 , srv631189991:85 , srv642237963:85 , srv758707877:85 , srv77267273:85 , srv784124632:85 , srv839067345:85 , srv839952130:85 , srv858609890:85 , srv906413767:85 , srv261634810:86 , srv665687219:86 , srv286961839:628 }
2023-11-07 15:55:30,386 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=206 (was 206), ProcessCount=167 (was 167), AvailableMemoryMB=7791 (was 8278)
2023-11-07 15:55:30,394 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=206, ProcessCount=167, AvailableMemoryMB=7791
2023-11-07 15:55:30,394 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-11-07 15:55:30,394 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-11-07 15:55:30,407 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1062850986:84 , srv1066071082:84 , srv1086349423:84 , srv1268613108:84 , srv1314545780:84 , srv1372560554:84 , srv1563541448:84 , srv1565859258:84 , srv158380414:84 , srv1620244183:84 , srv1744939440:84 , srv1751732556:84 , srv1752725579:84 , srv1765226375:84 , srv1812002623:84 , srv1907077914:84 , srv1950993513:84 , srv1996503484:84 , srv2077894456:84 , srv2098506444:84 , srv232255971:84 , srv237784413:84 , srv330281905:84 , srv431348534:84 , srv458380023:84 , srv613302986:84 , srv614784735:84 , srv741462486:84 , srv794354254:84 , srv413710079:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-11-07 15:55:30,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-07 15:55:30,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1563541448=6, srv2077894456=18, srv1086349423=2, srv1565859258=7, srv330281905=22, srv613302986=26, srv1765226375=13, srv158380414=8, srv2098506444=19, srv1372560554=5, srv741462486=28, srv1907077914=15, srv1620244183=9, srv1812002623=14, srv1062850986=0, srv614784735=27, srv1744939440=10, srv794354254=29, srv1268613108=3, srv1314545780=4, srv1950993513=16, srv1066071082=1, srv431348534=24, srv1751732556=11, srv237784413=21, srv458380023=25, srv1752725579=12, srv1996503484=17, srv413710079=23, srv232255971=20} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-07 15:55:30,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-07 15:55:30,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-07 15:55:30,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-07 15:55:30,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-07 15:55:30,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-07 15:55:30,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-07 15:55:30,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-07 15:55:30,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-07 15:55:30,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-07 15:55:30,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-07 15:55:30,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-07 15:55:30,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-07 15:55:30,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-07 15:55:30,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-07 15:55:30,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-07 15:55:30,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-07 15:55:30,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-07 15:55:30,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-07 15:55:30,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-07 15:55:30,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-07 15:55:30,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-07 15:55:30,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-07 15:55:30,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-07 15:55:30,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-07 15:55:30,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-07 15:55:30,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-07 15:55:30,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-07 15:55:30,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-07 15:55:30,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-07 15:55:30,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-07 15:55:30,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-11-07 15:55:30,450 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.140168818279439, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-07 15:55:30,450 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912634710633745, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.140168818279439, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-11-07 15:57:30,431 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5537266 different iterations.  Found a solution that moves 1880 regions; Going from a computed imbalance of 0.9912634710633745 to a new imbalance of 4.388013786899245E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6962962962962963, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-07 15:57:30,437 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1062850986:90 , srv1066071082:90 , srv1086349423:90 , srv1268613108:90 , srv1314545780:90 , srv1372560554:90 , srv1563541448:90 , srv1565859258:90 , srv158380414:90 , srv1620244183:90 , srv1744939440:90 , srv1751732556:90 , srv1752725579:90 , srv1765226375:90 , srv1812002623:90 , srv1907077914:90 , srv1950993513:90 , srv1996503484:90 , srv2077894456:90 , srv2098506444:90 , srv232255971:90 , srv237784413:90 , srv330281905:90 , srv413710079:90 , srv431348534:90 , srv458380023:90 , srv613302986:90 , srv614784735:90 , srv741462486:90 , srv794354254:90 }
2023-11-07 15:57:30,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-07 15:57:30,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1563541448=6, srv2077894456=18, srv1086349423=2, srv1565859258=7, srv330281905=22, srv613302986=26, srv1765226375=13, srv158380414=8, srv2098506444=19, srv1372560554=5, srv741462486=28, srv1907077914=15, srv1620244183=9, srv1812002623=14, srv1062850986=0, srv614784735=27, srv1744939440=10, srv794354254=29, srv1268613108=3, srv1314545780=4, srv1950993513=16, srv1066071082=1, srv431348534=24, srv1751732556=11, srv237784413=21, srv458380023=25, srv1752725579=12, srv1996503484=17, srv413710079=23, srv232255971=20} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-07 15:57:30,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-07 15:57:30,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-07 15:57:30,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-07 15:57:30,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-07 15:57:30,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-07 15:57:30,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-07 15:57:30,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-07 15:57:30,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-07 15:57:30,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-07 15:57:30,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-07 15:57:30,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-07 15:57:30,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-07 15:57:30,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-07 15:57:30,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-07 15:57:30,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-07 15:57:30,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-07 15:57:30,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-07 15:57:30,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-07 15:57:30,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-07 15:57:30,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-07 15:57:30,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-07 15:57:30,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-07 15:57:30,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-07 15:57:30,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-07 15:57:30,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-07 15:57:30,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-07 15:57:30,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-07 15:57:30,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-07 15:57:30,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-07 15:57:30,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-07 15:57:30,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-11-07 15:57:30,456 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-07 15:57:30,457 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1062850986:90 , srv1066071082:90 , srv1086349423:90 , srv1268613108:90 , srv1314545780:90 , srv1372560554:90 , srv1563541448:90 , srv1565859258:90 , srv158380414:90 , srv1620244183:90 , srv1744939440:90 , srv1751732556:90 , srv1752725579:90 , srv1765226375:90 , srv1812002623:90 , srv1907077914:90 , srv1950993513:90 , srv1996503484:90 , srv2077894456:90 , srv2098506444:90 , srv232255971:90 , srv237784413:90 , srv330281905:90 , srv413710079:90 , srv431348534:90 , srv458380023:90 , srv613302986:90 , srv614784735:90 , srv741462486:90 , srv794354254:90 }
2023-11-07 15:57:30,471 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=210 (was 206) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 167), AvailableMemoryMB=7802 (was 7791) - AvailableMemoryMB LEAK? -