2023-07-11 14:16:19,238 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-07-11 14:16:19,574 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-07-11 14:16:19,679 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-07-11 14:16:19,742 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-07-11 14:16:19,750 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-07-11 14:16:19,764 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=574, ProcessCount=175, AvailableMemoryMB=4486
2023-07-11 14:16:19,766 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-07-11 14:16:19,767 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-07-11 14:16:19,913 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1002283153:84 , srv1030880338:84 , srv1063271472:84 , srv10829098:84 , srv1152062588:84 , srv1152336506:84 , srv1153259700:84 , srv1179167385:84 , srv1187746888:84 , srv1238109004:84 , srv1252294191:84 , srv1278876084:84 , srv1280633089:84 , srv1287028990:84 , srv1290427473:84 , srv1298423032:84 , srv129853433:84 , srv1396933500:84 , srv1420843706:84 , srv1429221697:84 , srv1436520986:84 , srv1442843006:84 , srv1467971539:84 , srv1486569866:84 , srv1489939893:84 , srv1490072707:84 , srv1512265717:84 , srv154948824:84 , srv1573323379:84 , srv1595598577:84 , srv1631393007:84 , srv1635201676:84 , srv1638420871:84 , srv1707471343:84 , srv1770126775:84 , srv1817946595:84 , srv1828248372:84 , srv1837801862:84 , srv1852335384:84 , srv1886895367:84 , srv1920495311:84 , srv1944829682:84 , srv1948360215:84 , srv1952348088:84 , srv1993103257:84 , srv2013845870:84 , srv2015699739:84 , srv2027895833:84 , srv2041624360:84 , srv2070874850:84 , srv209714375:84 , srv2114747895:84 , srv226016009:84 , srv247497419:84 , srv251436051:84 , srv252897185:84 , srv261380967:84 , srv318136153:84 , srv331154190:84 , srv336481768:84 , srv337756211:84 , srv369660442:84 , srv403006804:84 , srv404543541:84 , srv410925597:84 , srv435252223:84 , srv463382139:84 , srv531119260:84 , srv543192646:84 , srv558296020:84 , srv560930172:84 , srv585790061:84 , srv59747523:84 , srv617024072:84 , srv640747696:84 , srv643178142:84 , srv657151733:84 , srv659029127:84 , srv681774074:84 , srv712145796:84 , srv718511763:84 , srv723157668:84 , srv725487606:84 , srv762231942:84 , srv768427009:84 , srv769338904:84 , srv785662877:84 , srv805818532:84 , srv806497693:84 , srv826559345:84 , srv862862764:84 , srv904289876:84 , srv910402249:84 , srv92214664:84 , srv952165755:84 , srv962417699:84 , srv971304104:84 , srv981613478:84 , srv993329064:84 , srv1709599228:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-07-11 14:16:19,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-11 14:16:19,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv435252223=66, srv403006804=63, srv723157668=82, srv725487606=83, srv862862764=91, srv463382139=67, srv1278876084=11, srv1429221697=19, srv247497419=54, srv209714375=51, srv1489939893=24, srv1709599228=34, srv768427009=85, srv1944829682=42, srv769338904=86, srv993329064=99, srv1635201676=31, srv59747523=73, srv1886895367=40, srv910402249=93, srv2041624360=49, srv226016009=53, srv1396933500=17, srv1063271472=2, srv805818532=88, srv1770126775=35, srv585790061=72, srv1952348088=44, srv2015699739=47, srv543192646=69, srv1512265717=26, srv1852335384=39, srv404543541=64, srv826559345=90, srv336481768=60, srv617024072=74, srv154948824=27, srv952165755=95, srv981613478=98, srv1490072707=25, srv337756211=61, srv1436520986=20, srv971304104=97, srv1002283153=0, srv560930172=71, srv1828248372=37, srv2027895833=48, srv129853433=16, srv1420843706=18, srv1817946595=36, srv1153259700=6, srv904289876=92, srv640747696=75, srv1238109004=9, srv1290427473=14, srv410925597=65, srv785662877=87, srv1152336506=5, srv1030880338=1, srv762231942=84, srv962417699=96, srv1252294191=10, srv318136153=58, srv1152062588=4, srv261380967=57, srv1187746888=8, srv681774074=79, srv1920495311=41, srv1467971539=22, srv531119260=68, srv1595598577=29, srv659029127=78, srv1948360215=43, srv712145796=80, srv1486569866=23, srv1287028990=13, srv251436051=55, srv2013845870=46, srv657151733=77, srv1631393007=30, srv1638420871=32, srv1298423032=15, srv1837801862=38, srv806497693=89, srv331154190=59, srv1993103257=45, srv1573323379=28, srv1707471343=33, srv2070874850=50, srv718511763=81, srv1179167385=7, srv1280633089=12, srv10829098=3, srv252897185=56, srv2114747895=52, srv643178142=76, srv558296020=70, srv1442843006=21, srv369660442=62, srv92214664=94} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-11 14:16:20,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-11 14:16:20,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-11 14:16:20,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-11 14:16:20,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-11 14:16:20,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-11 14:16:20,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-11 14:16:20,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-11 14:16:20,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-11 14:16:20,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-11 14:16:20,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-11 14:16:20,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-11 14:16:20,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-11 14:16:20,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-11 14:16:20,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-11 14:16:20,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-11 14:16:20,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-11 14:16:20,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-11 14:16:20,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-11 14:16:20,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-11 14:16:20,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-11 14:16:20,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-11 14:16:20,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-11 14:16:20,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-11 14:16:20,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-11 14:16:20,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-11 14:16:20,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-11 14:16:20,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-11 14:16:20,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-11 14:16:20,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-11 14:16:20,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-11 14:16:20,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-11 14:16:20,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-11 14:16:20,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-11 14:16:20,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-11 14:16:20,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-11 14:16:20,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-11 14:16:20,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-11 14:16:20,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-11 14:16:20,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-11 14:16:20,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-11 14:16:20,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-11 14:16:20,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-11 14:16:20,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-11 14:16:20,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-11 14:16:20,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-11 14:16:20,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-11 14:16:20,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-11 14:16:20,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-11 14:16:20,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-11 14:16:20,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-11 14:16:20,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-11 14:16:20,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-11 14:16:20,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-11 14:16:20,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-11 14:16:20,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-11 14:16:20,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-11 14:16:20,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-11 14:16:20,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-11 14:16:20,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-11 14:16:20,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-11 14:16:20,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-11 14:16:20,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-11 14:16:20,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-11 14:16:20,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-11 14:16:20,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-11 14:16:20,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-11 14:16:20,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-11 14:16:20,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-11 14:16:20,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-11 14:16:20,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-11 14:16:20,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-11 14:16:20,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-11 14:16:20,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-11 14:16:20,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-11 14:16:20,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-11 14:16:20,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-11 14:16:20,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-11 14:16:20,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-11 14:16:20,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-11 14:16:20,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-11 14:16:20,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-11 14:16:20,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-11 14:16:20,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-11 14:16:20,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-11 14:16:20,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-11 14:16:20,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-11 14:16:20,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-11 14:16:20,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-11 14:16:20,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-11 14:16:20,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-11 14:16:20,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-11 14:16:20,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-11 14:16:20,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-11 14:16:20,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-11 14:16:20,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-11 14:16:20,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-11 14:16:20,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-11 14:16:20,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-11 14:16:20,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-11 14:16:20,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-11 14:16:20,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-11 14:16:20,227 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-11 14:16:20,227 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-11 14:16:20,228 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-11 14:16:20,570 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 526 ms to try 5000 different iterations.  Found a solution that moves 4696 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17850693458845018. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04081810835672904, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.058382615065300694, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5217777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04081810835672904, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17366666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24066666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-11 14:16:20,594 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv952165755:82 , srv1290427473:83 , srv1944829682:83 , srv226016009:83 , srv261380967:83 , srv435252223:83 , srv643178142:83 , srv806497693:83 , srv1152336506:84 , srv1187746888:84 , srv1238109004:84 , srv1287028990:84 , srv1489939893:84 , srv1631393007:84 , srv1635201676:84 , srv1993103257:84 , srv2015699739:84 , srv2027895833:84 , srv2041624360:84 , srv209714375:84 , srv318136153:84 , srv410925597:84 , srv585790061:84 , srv904289876:84 , srv993329064:84 , srv129853433:85 , srv1429221697:85 , srv1595598577:85 , srv1707471343:85 , srv1770126775:85 , srv2114747895:85 , srv331154190:85 , srv617024072:85 , srv640747696:85 , srv1030880338:86 , srv1396933500:86 , srv154948824:86 , srv1573323379:86 , srv1817946595:86 , srv1852335384:86 , srv1948360215:86 , srv2013845870:86 , srv403006804:86 , srv560930172:86 , srv657151733:86 , srv712145796:86 , srv723157668:86 , srv762231942:86 , srv769338904:86 , srv785662877:86 , srv805818532:86 , srv92214664:86 , srv962417699:86 , srv1063271472:87 , srv10829098:87 , srv1153259700:87 , srv1442843006:87 , srv1828248372:87 , srv1837801862:87 , srv1952348088:87 , srv2070874850:87 , srv247497419:87 , srv336481768:87 , srv337756211:87 , srv369660442:87 , srv404543541:87 , srv463382139:87 , srv531119260:87 , srv681774074:87 , srv768427009:87 , srv826559345:87 , srv862862764:87 , srv971304104:87 , srv1002283153:88 , srv1152062588:88 , srv1280633089:88 , srv1298423032:88 , srv1486569866:88 , srv1886895367:88 , srv251436051:88 , srv252897185:88 , srv543192646:88 , srv59747523:88 , srv659029127:88 , srv718511763:88 , srv910402249:88 , srv1278876084:89 , srv1420843706:89 , srv1490072707:89 , srv1512265717:89 , srv1638420871:89 , srv1920495311:89 , srv725487606:89 , srv981613478:89 , srv1467971539:90 , srv558296020:90 , srv1436520986:92 , srv1252294191:93 , srv1179167385:96 , srv1709599228:453 }
2023-07-11 14:16:20,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-11 14:16:20,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv435252223=66, srv403006804=63, srv723157668=82, srv725487606=83, srv862862764=91, srv463382139=67, srv1278876084=11, srv1429221697=19, srv247497419=54, srv209714375=51, srv1489939893=24, srv1709599228=34, srv768427009=85, srv1944829682=42, srv769338904=86, srv993329064=99, srv1635201676=31, srv59747523=73, srv1886895367=40, srv910402249=93, srv2041624360=49, srv226016009=53, srv1396933500=17, srv1063271472=2, srv805818532=88, srv1770126775=35, srv585790061=72, srv1952348088=44, srv2015699739=47, srv543192646=69, srv1512265717=26, srv1852335384=39, srv404543541=64, srv826559345=90, srv336481768=60, srv617024072=74, srv154948824=27, srv952165755=95, srv981613478=98, srv1490072707=25, srv337756211=61, srv1436520986=20, srv971304104=97, srv1002283153=0, srv560930172=71, srv1828248372=37, srv2027895833=48, srv129853433=16, srv1420843706=18, srv1817946595=36, srv1153259700=6, srv904289876=92, srv640747696=75, srv1238109004=9, srv1290427473=14, srv410925597=65, srv785662877=87, srv1152336506=5, srv1030880338=1, srv762231942=84, srv962417699=96, srv1252294191=10, srv318136153=58, srv1152062588=4, srv261380967=57, srv1187746888=8, srv681774074=79, srv1920495311=41, srv1467971539=22, srv531119260=68, srv1595598577=29, srv659029127=78, srv1948360215=43, srv712145796=80, srv1486569866=23, srv1287028990=13, srv251436051=55, srv2013845870=46, srv657151733=77, srv1631393007=30, srv1638420871=32, srv1298423032=15, srv1837801862=38, srv806497693=89, srv331154190=59, srv1993103257=45, srv1573323379=28, srv1707471343=33, srv2070874850=50, srv718511763=81, srv1179167385=7, srv1280633089=12, srv10829098=3, srv252897185=56, srv2114747895=52, srv643178142=76, srv558296020=70, srv1442843006=21, srv369660442=62, srv92214664=94} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-11 14:16:20,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-11 14:16:20,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-11 14:16:20,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-11 14:16:20,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-11 14:16:20,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-11 14:16:20,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-11 14:16:20,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-11 14:16:20,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-11 14:16:20,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-11 14:16:20,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-11 14:16:20,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-11 14:16:20,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-11 14:16:20,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-11 14:16:20,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-11 14:16:20,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-11 14:16:20,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-11 14:16:20,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-11 14:16:20,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-11 14:16:20,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-11 14:16:20,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-11 14:16:20,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-11 14:16:20,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-11 14:16:20,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-11 14:16:20,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-11 14:16:20,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-11 14:16:20,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-11 14:16:20,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-11 14:16:20,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-11 14:16:20,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-11 14:16:20,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-11 14:16:20,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-11 14:16:20,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-11 14:16:20,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-11 14:16:20,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-11 14:16:20,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-11 14:16:20,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-11 14:16:20,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-11 14:16:20,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-11 14:16:20,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-11 14:16:20,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-11 14:16:20,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-11 14:16:20,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-11 14:16:20,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-11 14:16:20,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-11 14:16:20,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-11 14:16:20,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-11 14:16:20,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-11 14:16:20,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-11 14:16:20,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-11 14:16:20,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-11 14:16:20,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-11 14:16:20,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-11 14:16:20,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-11 14:16:20,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-11 14:16:20,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-11 14:16:20,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-11 14:16:20,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-11 14:16:20,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-11 14:16:20,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-11 14:16:20,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-11 14:16:20,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-11 14:16:20,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-11 14:16:20,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-11 14:16:20,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-11 14:16:20,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-11 14:16:20,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-11 14:16:20,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-11 14:16:20,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-11 14:16:20,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-11 14:16:20,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-11 14:16:20,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-11 14:16:20,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-11 14:16:20,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-11 14:16:20,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-11 14:16:20,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-11 14:16:20,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-11 14:16:20,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-11 14:16:20,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-11 14:16:20,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-11 14:16:20,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-11 14:16:20,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-11 14:16:20,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-11 14:16:20,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-11 14:16:20,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-11 14:16:20,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-11 14:16:20,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-11 14:16:20,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-11 14:16:20,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-11 14:16:20,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-11 14:16:20,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-11 14:16:20,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-11 14:16:20,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-11 14:16:20,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-11 14:16:20,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-11 14:16:20,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-11 14:16:20,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-11 14:16:20,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-11 14:16:20,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-11 14:16:20,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-11 14:16:20,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-11 14:16:20,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-11 14:16:20,760 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04081810835672904, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.058382615065300694, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04081810835672904, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17366666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24066666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-11 14:16:20,760 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-11 14:16:20,760 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.1784740524936471, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04081810835672904, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.058382615065300694, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04081810835672904, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17366666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24066666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-11 14:16:21,040 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 393 ms to try 5000 different iterations.  Found a solution that moves 2633 regions; Going from a computed imbalance of 0.1784740524936471 to a new imbalance of 0.013902484841670901. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020928086059956226); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03200378765462651, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29255555555555557, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020928086059956226); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010833333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043166666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-11 14:16:21,052 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1179167385:74 , srv1252294191:79 , srv1436520986:79 , srv558296020:81 , srv1490072707:82 , srv1512265717:82 , srv252897185:82 , srv725487606:82 , srv1278876084:83 , srv1280633089:83 , srv1298423032:83 , srv1467971539:83 , srv1486569866:83 , srv1638420871:83 , srv543192646:83 , srv659029127:83 , srv910402249:83 , srv10829098:84 , srv403006804:84 , srv404543541:84 , srv560930172:84 , srv718511763:84 , srv769338904:84 , srv805818532:84 , srv981613478:84 , srv1030880338:85 , srv1063271472:85 , srv1152062588:85 , srv1153259700:85 , srv1420843706:85 , srv1817946595:85 , srv1828248372:85 , srv1952348088:85 , srv2070874850:85 , srv251436051:85 , srv463382139:85 , srv681774074:85 , srv762231942:85 , srv768427009:85 , srv971304104:85 , srv1002283153:86 , srv1396933500:86 , srv1770126775:86 , srv1837801862:86 , srv1886895367:86 , srv1920495311:86 , srv247497419:86 , srv369660442:86 , srv410925597:86 , srv531119260:86 , srv59747523:86 , srv617024072:86 , srv657151733:86 , srv712145796:86 , srv826559345:86 , srv862862764:86 , srv962417699:86 , srv1187746888:87 , srv1238109004:87 , srv1287028990:87 , srv1290427473:87 , srv1707471343:87 , srv1852335384:87 , srv2013845870:87 , srv2015699739:87 , srv209714375:87 , srv226016009:87 , srv337756211:87 , srv435252223:87 , srv585790061:87 , srv643178142:87 , srv723157668:87 , srv785662877:87 , srv129853433:88 , srv1429221697:88 , srv1442843006:88 , srv1489939893:88 , srv1573323379:88 , srv1595598577:88 , srv1635201676:88 , srv1948360215:88 , srv1993103257:88 , srv2027895833:88 , srv2114747895:88 , srv331154190:88 , srv336481768:88 , srv640747696:88 , srv806497693:88 , srv904289876:88 , srv92214664:88 , srv993329064:88 , srv154948824:89 , srv1631393007:89 , srv1152336506:90 , srv2041624360:90 , srv318136153:90 , srv952165755:90 , srv1944829682:91 , srv261380967:91 , srv1709599228:507 }
2023-07-11 14:16:21,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-11 14:16:21,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv435252223=66, srv403006804=63, srv723157668=82, srv725487606=83, srv862862764=91, srv463382139=67, srv1278876084=11, srv1429221697=19, srv247497419=54, srv209714375=51, srv1489939893=24, srv1709599228=34, srv768427009=85, srv1944829682=42, srv769338904=86, srv993329064=99, srv1635201676=31, srv59747523=73, srv1886895367=40, srv910402249=93, srv2041624360=49, srv226016009=53, srv1396933500=17, srv1063271472=2, srv805818532=88, srv1770126775=35, srv585790061=72, srv1952348088=44, srv2015699739=47, srv543192646=69, srv1512265717=26, srv1852335384=39, srv404543541=64, srv826559345=90, srv336481768=60, srv617024072=74, srv154948824=27, srv952165755=95, srv981613478=98, srv1490072707=25, srv337756211=61, srv1436520986=20, srv971304104=97, srv1002283153=0, srv560930172=71, srv1828248372=37, srv2027895833=48, srv129853433=16, srv1420843706=18, srv1817946595=36, srv1153259700=6, srv904289876=92, srv640747696=75, srv1238109004=9, srv1290427473=14, srv410925597=65, srv785662877=87, srv1152336506=5, srv1030880338=1, srv762231942=84, srv962417699=96, srv1252294191=10, srv318136153=58, srv1152062588=4, srv261380967=57, srv1187746888=8, srv681774074=79, srv1920495311=41, srv1467971539=22, srv531119260=68, srv1595598577=29, srv659029127=78, srv1948360215=43, srv712145796=80, srv1486569866=23, srv1287028990=13, srv251436051=55, srv2013845870=46, srv657151733=77, srv1631393007=30, srv1638420871=32, srv1298423032=15, srv1837801862=38, srv806497693=89, srv331154190=59, srv1993103257=45, srv1573323379=28, srv1707471343=33, srv2070874850=50, srv718511763=81, srv1179167385=7, srv1280633089=12, srv10829098=3, srv252897185=56, srv2114747895=52, srv643178142=76, srv558296020=70, srv1442843006=21, srv369660442=62, srv92214664=94} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-11 14:16:21,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-11 14:16:21,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-11 14:16:21,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-11 14:16:21,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-11 14:16:21,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-11 14:16:21,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-11 14:16:21,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-11 14:16:21,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-11 14:16:21,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-11 14:16:21,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-11 14:16:21,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-11 14:16:21,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-11 14:16:21,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-11 14:16:21,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-11 14:16:21,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-11 14:16:21,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-11 14:16:21,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-11 14:16:21,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-11 14:16:21,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-11 14:16:21,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-11 14:16:21,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-11 14:16:21,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-11 14:16:21,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-11 14:16:21,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-11 14:16:21,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-11 14:16:21,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-11 14:16:21,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-11 14:16:21,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-11 14:16:21,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-11 14:16:21,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-11 14:16:21,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-11 14:16:21,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-11 14:16:21,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-11 14:16:21,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-11 14:16:21,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-11 14:16:21,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-11 14:16:21,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-11 14:16:21,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-11 14:16:21,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-11 14:16:21,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-11 14:16:21,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-11 14:16:21,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-11 14:16:21,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-11 14:16:21,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-11 14:16:21,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-11 14:16:21,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-11 14:16:21,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-11 14:16:21,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-11 14:16:21,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-11 14:16:21,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-11 14:16:21,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-11 14:16:21,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-11 14:16:21,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-11 14:16:21,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-11 14:16:21,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-11 14:16:21,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-11 14:16:21,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-11 14:16:21,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-11 14:16:21,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-11 14:16:21,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-11 14:16:21,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-11 14:16:21,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-11 14:16:21,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-11 14:16:21,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-11 14:16:21,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-11 14:16:21,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-11 14:16:21,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-11 14:16:21,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-11 14:16:21,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-11 14:16:21,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-11 14:16:21,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-11 14:16:21,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-11 14:16:21,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-11 14:16:21,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-11 14:16:21,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-11 14:16:21,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-11 14:16:21,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-11 14:16:21,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-11 14:16:21,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-11 14:16:21,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-11 14:16:21,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-11 14:16:21,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-11 14:16:21,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-11 14:16:21,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-11 14:16:21,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-11 14:16:21,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-11 14:16:21,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-11 14:16:21,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-11 14:16:21,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-11 14:16:21,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-11 14:16:21,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-11 14:16:21,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-11 14:16:21,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-11 14:16:21,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-11 14:16:21,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-11 14:16:21,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-11 14:16:21,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-11 14:16:21,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-11 14:16:21,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-11 14:16:21,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-11 14:16:21,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-11 14:16:21,237 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020928086059956226); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03200378765462651, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020928086059956226); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010833333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043166666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-11 14:16:21,237 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-11 14:16:21,238 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.013884048181616265, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020928086059956226); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03200378765462651, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020928086059956226); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010833333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043166666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-11 14:16:21,587 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 472 ms to try 5000 different iterations.  Found a solution that moves 988 regions; Going from a computed imbalance of 0.013884048181616265 to a new imbalance of 4.3260680523783863E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005984558423028655); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008164965809277261); MoveCostFunction : (multiplier=7.0, imbalance=0.10977777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005984558423028655); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0031666666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-11 14:16:21,590 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv154948824:82 , srv1573323379:83 , srv1920495311:83 , srv1944829682:83 , srv2041624360:83 , srv261380967:83 , srv336481768:83 , srv59747523:83 , srv1002283153:84 , srv1152336506:84 , srv1420843706:84 , srv1429221697:84 , srv1442843006:84 , srv1467971539:84 , srv1595598577:84 , srv1707471343:84 , srv1886895367:84 , srv1948360215:84 , srv247497419:84 , srv251436051:84 , srv318136153:84 , srv331154190:84 , srv337756211:84 , srv369660442:84 , srv531119260:84 , srv640747696:84 , srv723157668:84 , srv785662877:84 , srv826559345:84 , srv92214664:84 , srv981613478:84 , srv1063271472:85 , srv1152062588:85 , srv1489939893:85 , srv1631393007:85 , srv1638420871:85 , srv1828248372:85 , srv1837801862:85 , srv1852335384:85 , srv1952348088:85 , srv1993103257:85 , srv2013845870:85 , srv2027895833:85 , srv2114747895:85 , srv463382139:85 , srv681774074:85 , srv712145796:85 , srv718511763:85 , srv862862764:85 , srv952165755:85 , srv1030880338:86 , srv10829098:86 , srv1153259700:86 , srv1187746888:86 , srv1238109004:86 , srv1278876084:86 , srv1280633089:86 , srv1287028990:86 , srv1298423032:86 , srv129853433:86 , srv1396933500:86 , srv1490072707:86 , srv1512265717:86 , srv1635201676:86 , srv1817946595:86 , srv2015699739:86 , srv2070874850:86 , srv209714375:86 , srv404543541:86 , srv543192646:86 , srv558296020:86 , srv617024072:86 , srv657151733:86 , srv659029127:86 , srv725487606:86 , srv762231942:86 , srv768427009:86 , srv904289876:86 , srv962417699:86 , srv971304104:86 , srv993329064:86 , srv1252294191:87 , srv1290427473:87 , srv1436520986:87 , srv1486569866:87 , srv1770126775:87 , srv435252223:87 , srv643178142:87 , srv769338904:87 , srv805818532:87 , srv806497693:87 , srv910402249:87 , srv1179167385:88 , srv226016009:88 , srv252897185:88 , srv403006804:88 , srv410925597:88 , srv560930172:88 , srv585790061:88 , srv1709599228:551 }
2023-07-11 14:16:21,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-11 14:16:21,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv435252223=66, srv403006804=63, srv723157668=82, srv725487606=83, srv862862764=91, srv463382139=67, srv1278876084=11, srv1429221697=19, srv247497419=54, srv209714375=51, srv1489939893=24, srv1709599228=34, srv768427009=85, srv1944829682=42, srv769338904=86, srv993329064=99, srv1635201676=31, srv59747523=73, srv1886895367=40, srv910402249=93, srv2041624360=49, srv226016009=53, srv1396933500=17, srv1063271472=2, srv805818532=88, srv1770126775=35, srv585790061=72, srv1952348088=44, srv2015699739=47, srv543192646=69, srv1512265717=26, srv1852335384=39, srv404543541=64, srv826559345=90, srv336481768=60, srv617024072=74, srv154948824=27, srv952165755=95, srv981613478=98, srv1490072707=25, srv337756211=61, srv1436520986=20, srv971304104=97, srv1002283153=0, srv560930172=71, srv1828248372=37, srv2027895833=48, srv129853433=16, srv1420843706=18, srv1817946595=36, srv1153259700=6, srv904289876=92, srv640747696=75, srv1238109004=9, srv1290427473=14, srv410925597=65, srv785662877=87, srv1152336506=5, srv1030880338=1, srv762231942=84, srv962417699=96, srv1252294191=10, srv318136153=58, srv1152062588=4, srv261380967=57, srv1187746888=8, srv681774074=79, srv1920495311=41, srv1467971539=22, srv531119260=68, srv1595598577=29, srv659029127=78, srv1948360215=43, srv712145796=80, srv1486569866=23, srv1287028990=13, srv251436051=55, srv2013845870=46, srv657151733=77, srv1631393007=30, srv1638420871=32, srv1298423032=15, srv1837801862=38, srv806497693=89, srv331154190=59, srv1993103257=45, srv1573323379=28, srv1707471343=33, srv2070874850=50, srv718511763=81, srv1179167385=7, srv1280633089=12, srv10829098=3, srv252897185=56, srv2114747895=52, srv643178142=76, srv558296020=70, srv1442843006=21, srv369660442=62, srv92214664=94} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-11 14:16:21,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-11 14:16:21,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-11 14:16:21,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-11 14:16:21,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-11 14:16:21,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-11 14:16:21,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-11 14:16:21,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-11 14:16:21,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-11 14:16:21,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-11 14:16:21,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-11 14:16:21,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-11 14:16:21,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-11 14:16:21,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-11 14:16:21,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-11 14:16:21,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-11 14:16:21,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-11 14:16:21,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-11 14:16:21,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-11 14:16:21,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-11 14:16:21,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-11 14:16:21,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-11 14:16:21,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-11 14:16:21,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-11 14:16:21,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-11 14:16:21,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-11 14:16:21,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-11 14:16:21,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-11 14:16:21,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-11 14:16:21,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-11 14:16:21,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-11 14:16:21,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-11 14:16:21,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-11 14:16:21,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-11 14:16:21,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-11 14:16:21,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-11 14:16:21,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-11 14:16:21,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-11 14:16:21,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-11 14:16:21,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-11 14:16:21,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-11 14:16:21,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-11 14:16:21,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-11 14:16:21,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-11 14:16:21,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-11 14:16:21,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-11 14:16:21,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-11 14:16:21,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-11 14:16:21,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-11 14:16:21,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-11 14:16:21,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-11 14:16:21,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-11 14:16:21,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-11 14:16:21,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-11 14:16:21,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-11 14:16:21,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-11 14:16:21,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-11 14:16:21,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-11 14:16:21,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-11 14:16:21,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-11 14:16:21,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-11 14:16:21,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-11 14:16:21,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-11 14:16:21,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-11 14:16:21,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-11 14:16:21,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-11 14:16:21,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-11 14:16:21,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-11 14:16:21,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-11 14:16:21,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-11 14:16:21,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-11 14:16:21,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-11 14:16:21,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-11 14:16:21,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-11 14:16:21,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-11 14:16:21,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-11 14:16:21,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-11 14:16:21,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-11 14:16:21,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-11 14:16:21,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-11 14:16:21,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-11 14:16:21,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-11 14:16:21,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-11 14:16:21,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-11 14:16:21,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-11 14:16:21,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-11 14:16:21,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-11 14:16:21,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-11 14:16:21,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-11 14:16:21,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-11 14:16:21,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-11 14:16:21,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-11 14:16:21,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-11 14:16:21,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-11 14:16:21,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-11 14:16:21,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-11 14:16:21,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-11 14:16:21,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-11 14:16:21,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-11 14:16:21,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-11 14:16:21,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-11 14:16:21,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-11 14:16:21,792 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005984558423028655); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008164965809277261); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005984558423028655); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0031666666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-11 14:16:21,793 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-11 14:16:21,793 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=4.2568868137381243E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005984558423028655); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008164965809277261); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005984558423028655); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0031666666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-11 14:16:22,114 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 459 ms to try 5000 different iterations.  Found a solution that moves 267 regions; Going from a computed imbalance of 4.2568868137381243E-4 to a new imbalance of 1.3317073038923515E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0020651563939657444); MoveCostFunction : (multiplier=7.0, imbalance=0.029666666666666668, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-11 14:16:22,115 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1153259700:83 , srv1252294191:83 , srv129853433:83 , srv1420843706:83 , srv1442843006:83 , srv92214664:83 , srv1002283153:84 , srv1063271472:84 , srv1152062588:84 , srv1152336506:84 , srv1179167385:84 , srv1278876084:84 , srv1290427473:84 , srv1396933500:84 , srv1486569866:84 , srv1512265717:84 , srv154948824:84 , srv1631393007:84 , srv1635201676:84 , srv1770126775:84 , srv1837801862:84 , srv1852335384:84 , srv1886895367:84 , srv1920495311:84 , srv1948360215:84 , srv2013845870:84 , srv2070874850:84 , srv2114747895:84 , srv226016009:84 , srv252897185:84 , srv318136153:84 , srv336481768:84 , srv337756211:84 , srv403006804:84 , srv410925597:84 , srv585790061:84 , srv657151733:84 , srv768427009:84 , srv806497693:84 , srv826559345:84 , srv862862764:84 , srv910402249:84 , srv962417699:84 , srv971304104:84 , srv993329064:84 , srv1030880338:85 , srv10829098:85 , srv1187746888:85 , srv1238109004:85 , srv1280633089:85 , srv1298423032:85 , srv1429221697:85 , srv1436520986:85 , srv1467971539:85 , srv1489939893:85 , srv1490072707:85 , srv1595598577:85 , srv1638420871:85 , srv1828248372:85 , srv1944829682:85 , srv1952348088:85 , srv1993103257:85 , srv2015699739:85 , srv2027895833:85 , srv2041624360:85 , srv209714375:85 , srv247497419:85 , srv251436051:85 , srv261380967:85 , srv331154190:85 , srv369660442:85 , srv404543541:85 , srv435252223:85 , srv463382139:85 , srv531119260:85 , srv543192646:85 , srv558296020:85 , srv560930172:85 , srv59747523:85 , srv617024072:85 , srv640747696:85 , srv659029127:85 , srv681774074:85 , srv712145796:85 , srv718511763:85 , srv723157668:85 , srv725487606:85 , srv762231942:85 , srv769338904:85 , srv785662877:85 , srv805818532:85 , srv904289876:85 , srv952165755:85 , srv981613478:85 , srv1287028990:86 , srv1573323379:86 , srv1707471343:86 , srv1817946595:86 , srv643178142:86 , srv1709599228:631 }
2023-07-11 14:16:22,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-11 14:16:22,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv435252223=66, srv403006804=63, srv723157668=82, srv725487606=83, srv862862764=91, srv463382139=67, srv1278876084=11, srv1429221697=19, srv247497419=54, srv209714375=51, srv1489939893=24, srv1709599228=34, srv768427009=85, srv1944829682=42, srv769338904=86, srv993329064=99, srv1635201676=31, srv59747523=73, srv1886895367=40, srv910402249=93, srv2041624360=49, srv226016009=53, srv1396933500=17, srv1063271472=2, srv805818532=88, srv1770126775=35, srv585790061=72, srv1952348088=44, srv2015699739=47, srv543192646=69, srv1512265717=26, srv1852335384=39, srv404543541=64, srv826559345=90, srv336481768=60, srv617024072=74, srv154948824=27, srv952165755=95, srv981613478=98, srv1490072707=25, srv337756211=61, srv1436520986=20, srv971304104=97, srv1002283153=0, srv560930172=71, srv1828248372=37, srv2027895833=48, srv129853433=16, srv1420843706=18, srv1817946595=36, srv1153259700=6, srv904289876=92, srv640747696=75, srv1238109004=9, srv1290427473=14, srv410925597=65, srv785662877=87, srv1152336506=5, srv1030880338=1, srv762231942=84, srv962417699=96, srv1252294191=10, srv318136153=58, srv1152062588=4, srv261380967=57, srv1187746888=8, srv681774074=79, srv1920495311=41, srv1467971539=22, srv531119260=68, srv1595598577=29, srv659029127=78, srv1948360215=43, srv712145796=80, srv1486569866=23, srv1287028990=13, srv251436051=55, srv2013845870=46, srv657151733=77, srv1631393007=30, srv1638420871=32, srv1298423032=15, srv1837801862=38, srv806497693=89, srv331154190=59, srv1993103257=45, srv1573323379=28, srv1707471343=33, srv2070874850=50, srv718511763=81, srv1179167385=7, srv1280633089=12, srv10829098=3, srv252897185=56, srv2114747895=52, srv643178142=76, srv558296020=70, srv1442843006=21, srv369660442=62, srv92214664=94} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-11 14:16:22,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-11 14:16:22,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-11 14:16:22,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-11 14:16:22,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-11 14:16:22,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-11 14:16:22,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-11 14:16:22,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-11 14:16:22,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-11 14:16:22,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-11 14:16:22,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-11 14:16:22,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-11 14:16:22,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-11 14:16:22,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-11 14:16:22,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-11 14:16:22,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-11 14:16:22,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-11 14:16:22,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-11 14:16:22,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-11 14:16:22,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-11 14:16:22,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-11 14:16:22,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-11 14:16:22,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-11 14:16:22,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-11 14:16:22,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-11 14:16:22,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-11 14:16:22,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-11 14:16:22,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-11 14:16:22,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-11 14:16:22,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-11 14:16:22,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-11 14:16:22,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-11 14:16:22,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-11 14:16:22,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-11 14:16:22,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-11 14:16:22,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-11 14:16:22,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-11 14:16:22,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-11 14:16:22,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-11 14:16:22,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-11 14:16:22,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-11 14:16:22,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-11 14:16:22,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-11 14:16:22,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-11 14:16:22,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-11 14:16:22,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-11 14:16:22,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-11 14:16:22,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-11 14:16:22,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-11 14:16:22,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-11 14:16:22,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-11 14:16:22,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-11 14:16:22,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-11 14:16:22,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-11 14:16:22,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-11 14:16:22,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-11 14:16:22,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-11 14:16:22,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-11 14:16:22,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-11 14:16:22,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-11 14:16:22,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-11 14:16:22,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-11 14:16:22,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-11 14:16:22,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-11 14:16:22,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-11 14:16:22,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-11 14:16:22,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-11 14:16:22,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-11 14:16:22,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-11 14:16:22,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-11 14:16:22,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-11 14:16:22,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-11 14:16:22,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-11 14:16:22,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-11 14:16:22,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-11 14:16:22,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-11 14:16:22,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-11 14:16:22,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-11 14:16:22,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-11 14:16:22,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-11 14:16:22,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-11 14:16:22,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-11 14:16:22,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-11 14:16:22,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-11 14:16:22,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-11 14:16:22,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-11 14:16:22,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-11 14:16:22,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-11 14:16:22,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-11 14:16:22,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-11 14:16:22,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-11 14:16:22,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-11 14:16:22,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-11 14:16:22,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-11 14:16:22,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-11 14:16:22,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-11 14:16:22,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-11 14:16:22,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-11 14:16:22,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-11 14:16:22,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-11 14:16:22,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-11 14:16:22,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-11 14:16:22,248 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=1.1447499079718037E-5 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0020651563939657444); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-11 14:16:22,248 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1153259700:83 , srv1252294191:83 , srv129853433:83 , srv1420843706:83 , srv1442843006:83 , srv92214664:83 , srv1002283153:84 , srv1063271472:84 , srv1152062588:84 , srv1152336506:84 , srv1179167385:84 , srv1278876084:84 , srv1290427473:84 , srv1396933500:84 , srv1486569866:84 , srv1512265717:84 , srv154948824:84 , srv1631393007:84 , srv1635201676:84 , srv1770126775:84 , srv1837801862:84 , srv1852335384:84 , srv1886895367:84 , srv1920495311:84 , srv1948360215:84 , srv2013845870:84 , srv2070874850:84 , srv2114747895:84 , srv226016009:84 , srv252897185:84 , srv318136153:84 , srv336481768:84 , srv337756211:84 , srv403006804:84 , srv410925597:84 , srv585790061:84 , srv657151733:84 , srv768427009:84 , srv806497693:84 , srv826559345:84 , srv862862764:84 , srv910402249:84 , srv962417699:84 , srv971304104:84 , srv993329064:84 , srv1030880338:85 , srv10829098:85 , srv1187746888:85 , srv1238109004:85 , srv1280633089:85 , srv1298423032:85 , srv1429221697:85 , srv1436520986:85 , srv1467971539:85 , srv1489939893:85 , srv1490072707:85 , srv1595598577:85 , srv1638420871:85 , srv1828248372:85 , srv1944829682:85 , srv1952348088:85 , srv1993103257:85 , srv2015699739:85 , srv2027895833:85 , srv2041624360:85 , srv209714375:85 , srv247497419:85 , srv251436051:85 , srv261380967:85 , srv331154190:85 , srv369660442:85 , srv404543541:85 , srv435252223:85 , srv463382139:85 , srv531119260:85 , srv543192646:85 , srv558296020:85 , srv560930172:85 , srv59747523:85 , srv617024072:85 , srv640747696:85 , srv659029127:85 , srv681774074:85 , srv712145796:85 , srv718511763:85 , srv723157668:85 , srv725487606:85 , srv762231942:85 , srv769338904:85 , srv785662877:85 , srv805818532:85 , srv904289876:85 , srv952165755:85 , srv981613478:85 , srv1287028990:86 , srv1573323379:86 , srv1707471343:86 , srv1817946595:86 , srv643178142:86 , srv1709599228:631 }
2023-07-11 14:16:22,283 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=574 (was 574), ProcessCount=175 (was 175), AvailableMemoryMB=3974 (was 4486)
2023-07-11 14:16:22,291 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=574, ProcessCount=175, AvailableMemoryMB=3974
2023-07-11 14:16:22,292 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-07-11 14:16:22,292 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-07-11 14:16:22,304 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1005532428:84 , srv1090183383:84 , srv1220980164:84 , srv1363859463:84 , srv1396335637:84 , srv1504705821:84 , srv1590906417:84 , srv161861076:84 , srv1627248228:84 , srv1718658629:84 , srv1733691463:84 , srv1808160318:84 , srv1962830590:84 , srv1982617670:84 , srv205970237:84 , srv2098452051:84 , srv2102034825:84 , srv2103445525:84 , srv25927954:84 , srv294491628:84 , srv349877989:84 , srv499248554:84 , srv505171708:84 , srv608541412:84 , srv666315818:84 , srv69600625:84 , srv709666100:84 , srv737092288:84 , srv999311782:84 , srv189145769:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-07-11 14:16:22,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-11 14:16:22,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv709666100=27, srv205970237=15, srv1590906417=6, srv2103445525=18, srv1718658629=9, srv499248554=22, srv1220980164=2, srv2102034825=17, srv349877989=21, srv189145769=12, srv1982617670=14, srv666315818=25, srv161861076=7, srv294491628=20, srv1733691463=10, srv1808160318=11, srv2098452051=16, srv608541412=24, srv69600625=26, srv737092288=28, srv1962830590=13, srv25927954=19, srv1363859463=3, srv1396335637=4, srv1090183383=1, srv999311782=29, srv1504705821=5, srv1627248228=8, srv1005532428=0, srv505171708=23} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-11 14:16:22,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-11 14:16:22,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-11 14:16:22,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-11 14:16:22,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-11 14:16:22,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-11 14:16:22,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-11 14:16:22,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-11 14:16:22,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-11 14:16:22,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-11 14:16:22,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-11 14:16:22,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-11 14:16:22,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-11 14:16:22,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-11 14:16:22,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-11 14:16:22,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-11 14:16:22,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-11 14:16:22,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-11 14:16:22,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-11 14:16:22,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-11 14:16:22,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-11 14:16:22,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-11 14:16:22,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-11 14:16:22,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-11 14:16:22,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-11 14:16:22,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-11 14:16:22,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-11 14:16:22,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-11 14:16:22,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-11 14:16:22,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-11 14:16:22,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-11 14:16:22,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-07-11 14:16:22,345 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1082394181906687, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-11 14:16:22,346 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912534102136656, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1082394181906687, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-07-11 14:18:22,324 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6198885 different iterations.  Found a solution that moves 1861 regions; Going from a computed imbalance of 0.9912534102136656 to a new imbalance of 4.3436668390529226E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6892592592592592, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-11 14:18:22,331 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1005532428:90 , srv1090183383:90 , srv1220980164:90 , srv1363859463:90 , srv1396335637:90 , srv1504705821:90 , srv1590906417:90 , srv161861076:90 , srv1627248228:90 , srv1718658629:90 , srv1733691463:90 , srv1808160318:90 , srv189145769:90 , srv1962830590:90 , srv1982617670:90 , srv205970237:90 , srv2098452051:90 , srv2102034825:90 , srv2103445525:90 , srv25927954:90 , srv294491628:90 , srv349877989:90 , srv499248554:90 , srv505171708:90 , srv608541412:90 , srv666315818:90 , srv69600625:90 , srv709666100:90 , srv737092288:90 , srv999311782:90 }
2023-07-11 14:18:22,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-11 14:18:22,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv709666100=27, srv205970237=15, srv1590906417=6, srv2103445525=18, srv1718658629=9, srv499248554=22, srv1220980164=2, srv2102034825=17, srv349877989=21, srv189145769=12, srv1982617670=14, srv666315818=25, srv161861076=7, srv294491628=20, srv1733691463=10, srv1808160318=11, srv2098452051=16, srv608541412=24, srv69600625=26, srv737092288=28, srv1962830590=13, srv25927954=19, srv1363859463=3, srv1396335637=4, srv1090183383=1, srv999311782=29, srv1504705821=5, srv1627248228=8, srv1005532428=0, srv505171708=23} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-11 14:18:22,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-11 14:18:22,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-11 14:18:22,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-11 14:18:22,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-11 14:18:22,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-11 14:18:22,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-11 14:18:22,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-11 14:18:22,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-11 14:18:22,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-11 14:18:22,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-11 14:18:22,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-11 14:18:22,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-11 14:18:22,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-11 14:18:22,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-11 14:18:22,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-11 14:18:22,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-11 14:18:22,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-11 14:18:22,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-11 14:18:22,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-11 14:18:22,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-11 14:18:22,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-11 14:18:22,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-11 14:18:22,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-11 14:18:22,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-11 14:18:22,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-11 14:18:22,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-11 14:18:22,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-11 14:18:22,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-11 14:18:22,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-11 14:18:22,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-11 14:18:22,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-07-11 14:18:22,357 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-11 14:18:22,357 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1005532428:90 , srv1090183383:90 , srv1220980164:90 , srv1363859463:90 , srv1396335637:90 , srv1504705821:90 , srv1590906417:90 , srv161861076:90 , srv1627248228:90 , srv1718658629:90 , srv1733691463:90 , srv1808160318:90 , srv189145769:90 , srv1962830590:90 , srv1982617670:90 , srv205970237:90 , srv2098452051:90 , srv2102034825:90 , srv2103445525:90 , srv25927954:90 , srv294491628:90 , srv349877989:90 , srv499248554:90 , srv505171708:90 , srv608541412:90 , srv666315818:90 , srv69600625:90 , srv709666100:90 , srv737092288:90 , srv999311782:90 }
2023-07-11 14:18:22,372 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=264 (was 574), ProcessCount=173 (was 175), AvailableMemoryMB=7461 (was 3974) - AvailableMemoryMB LEAK? -