2023-07-23 17:53:11,298 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-07-23 17:53:11,615 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-07-23 17:53:11,729 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-07-23 17:53:11,801 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-07-23 17:53:11,808 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-07-23 17:53:11,821 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=246, ProcessCount=174, AvailableMemoryMB=10563
2023-07-23 17:53:11,823 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-07-23 17:53:11,824 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-07-23 17:53:11,965 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1026132257:84 , srv1038108793:84 , srv1043965138:84 , srv1070168211:84 , srv1074645899:84 , srv108367670:84 , srv1098517744:84 , srv1154287879:84 , srv1179984521:84 , srv1182170981:84 , srv1195179167:84 , srv1225194972:84 , srv1266023635:84 , srv1314037533:84 , srv1333087563:84 , srv1386036703:84 , srv1425981447:84 , srv1476768739:84 , srv1493955740:84 , srv1509205829:84 , srv1514598295:84 , srv1523512938:84 , srv1566106415:84 , srv1567972856:84 , srv1571736054:84 , srv1581967531:84 , srv1582714663:84 , srv1584672690:84 , srv1592038276:84 , srv15997351:84 , srv1604084870:84 , srv1607448531:84 , srv1614599808:84 , srv1618075018:84 , srv1627542057:84 , srv1653134492:84 , srv1663677215:84 , srv1721513684:84 , srv1743734514:84 , srv1760849343:84 , srv1787353636:84 , srv1805117798:84 , srv1921601338:84 , srv1943906676:84 , srv1958217999:84 , srv1959130881:84 , srv1964298712:84 , srv197744701:84 , srv1981890804:84 , srv1987778246:84 , srv1995934728:84 , srv1996400331:84 , srv2000274323:84 , srv2030302952:84 , srv2037860749:84 , srv2051603702:84 , srv2102780599:84 , srv2126774585:84 , srv2137472808:84 , srv2143399234:84 , srv222749964:84 , srv236992540:84 , srv241081046:84 , srv273112334:84 , srv273479339:84 , srv281440323:84 , srv286016110:84 , srv28640591:84 , srv286662511:84 , srv374583850:84 , srv389874984:84 , srv405330462:84 , srv423403712:84 , srv458272094:84 , srv463047960:84 , srv475370953:84 , srv531551753:84 , srv602167672:84 , srv621364257:84 , srv652092324:84 , srv659288383:84 , srv710078644:84 , srv723368041:84 , srv750310608:84 , srv75338010:84 , srv757564823:84 , srv758799271:84 , srv760453011:84 , srv797514644:84 , srv799428265:84 , srv828584090:84 , srv852116196:84 , srv868560850:84 , srv871273419:84 , srv872282391:84 , srv960402953:84 , srv969654616:84 , srv981725030:84 , srv994746404:84 , srv31462775:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-07-23 17:53:11,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-23 17:53:11,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv273479339=64, srv760453011=88, srv1043965138=2, srv710078644=82, srv1996400331=51, srv2051603702=55, srv1154287879=7, srv1582714663=26, srv1567972856=23, srv1584672690=27, srv1592038276=28, srv286662511=68, srv1566106415=22, srv2037860749=54, srv960402953=96, srv1614599808=32, srv1038108793=1, srv423403712=73, srv1509205829=19, srv981725030=98, srv1070168211=3, srv1493955740=18, srv1098517744=6, srv28640591=67, srv1604084870=30, srv1959130881=45, srv2102780599=56, srv222749964=60, srv1333087563=14, srv75338010=85, srv1995934728=50, srv852116196=92, srv1964298712=46, srv1179984521=8, srv389874984=71, srv2030302952=53, srv872282391=95, srv286016110=66, srv1663677215=36, srv1743734514=38, srv2000274323=52, srv758799271=87, srv1514598295=20, srv1787353636=40, srv1195179167=10, srv1386036703=15, srv659288383=81, srv652092324=80, srv1805117798=41, srv241081046=62, srv1266023635=12, srv2126774585=57, srv1921601338=42, srv281440323=65, srv1425981447=16, srv602167672=78, srv31462775=69, srv1618075018=33, srv236992540=61, srv463047960=75, srv1987778246=49, srv1943906676=43, srv1581967531=25, srv2137472808=58, srv750310608=84, srv969654616=97, srv1074645899=4, srv621364257=79, srv405330462=72, srv108367670=5, srv1571736054=24, srv1314037533=13, srv1958217999=44, srv1182170981=9, srv1026132257=0, srv1476768739=17, srv1523512938=21, srv458272094=74, srv475370953=76, srv871273419=94, srv797514644=89, srv1653134492=35, srv1627542057=34, srv197744701=47, srv799428265=90, srv723368041=83, srv757564823=86, srv2143399234=59, srv531551753=77, srv1981890804=48, srv1225194972=11, srv994746404=99, srv828584090=91, srv15997351=29, srv868560850=93, srv1760849343=39, srv273112334=63, srv1607448531=31, srv1721513684=37, srv374583850=70} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-23 17:53:12,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-23 17:53:12,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-23 17:53:12,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-23 17:53:12,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-23 17:53:12,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-23 17:53:12,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-23 17:53:12,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-23 17:53:12,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-23 17:53:12,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-23 17:53:12,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-23 17:53:12,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-23 17:53:12,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-23 17:53:12,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-23 17:53:12,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-23 17:53:12,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-23 17:53:12,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-23 17:53:12,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-23 17:53:12,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-23 17:53:12,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-23 17:53:12,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-23 17:53:12,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-23 17:53:12,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-23 17:53:12,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-23 17:53:12,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-23 17:53:12,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-23 17:53:12,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-23 17:53:12,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-23 17:53:12,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-23 17:53:12,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-23 17:53:12,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-23 17:53:12,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-23 17:53:12,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-23 17:53:12,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-23 17:53:12,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-23 17:53:12,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-23 17:53:12,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-23 17:53:12,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-23 17:53:12,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-23 17:53:12,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-23 17:53:12,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-23 17:53:12,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-23 17:53:12,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-23 17:53:12,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-23 17:53:12,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-23 17:53:12,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-23 17:53:12,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-23 17:53:12,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-23 17:53:12,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-23 17:53:12,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-23 17:53:12,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-23 17:53:12,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-23 17:53:12,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-23 17:53:12,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-23 17:53:12,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-23 17:53:12,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-23 17:53:12,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-23 17:53:12,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-23 17:53:12,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-23 17:53:12,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-23 17:53:12,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-23 17:53:12,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-23 17:53:12,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-23 17:53:12,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-23 17:53:12,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-23 17:53:12,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-23 17:53:12,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-23 17:53:12,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-23 17:53:12,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-23 17:53:12,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-23 17:53:12,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-23 17:53:12,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-23 17:53:12,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-23 17:53:12,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-23 17:53:12,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-23 17:53:12,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-23 17:53:12,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-23 17:53:12,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-23 17:53:12,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-23 17:53:12,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-23 17:53:12,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-23 17:53:12,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-23 17:53:12,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-23 17:53:12,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-23 17:53:12,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-23 17:53:12,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-23 17:53:12,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-23 17:53:12,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-23 17:53:12,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-23 17:53:12,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-23 17:53:12,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-23 17:53:12,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-23 17:53:12,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-23 17:53:12,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-23 17:53:12,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-23 17:53:12,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-23 17:53:12,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-23 17:53:12,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-23 17:53:12,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-23 17:53:12,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-23 17:53:12,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-23 17:53:12,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-23 17:53:12,410 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-23 17:53:12,411 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-23 17:53:12,411 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-23 17:53:12,780 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 649 ms to try 5000 different iterations.  Found a solution that moves 4697 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17976715893254724. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03975012362522255, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0561543487776701, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5218888888888888, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03975012362522255, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17525, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.239, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-23 17:53:12,802 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv2051603702:81 , srv1614599808:82 , srv1996400331:82 , srv281440323:82 , srv659288383:82 , srv1425981447:83 , srv1571736054:83 , srv1805117798:83 , srv2030302952:83 , srv2037860749:83 , srv799428265:83 , srv1179984521:84 , srv1333087563:84 , srv1509205829:84 , srv1523512938:84 , srv1584672690:84 , srv1760849343:84 , srv1958217999:84 , srv2000274323:84 , srv405330462:84 , srv423403712:84 , srv1070168211:85 , srv1154287879:85 , srv1266023635:85 , srv1314037533:85 , srv1581967531:85 , srv15997351:85 , srv1618075018:85 , srv1627542057:85 , srv1653134492:85 , srv1721513684:85 , srv1743734514:85 , srv1787353636:85 , srv197744701:85 , srv2126774585:85 , srv286016110:85 , srv374583850:85 , srv463047960:85 , srv475370953:85 , srv621364257:85 , srv828584090:85 , srv994746404:85 , srv1043965138:86 , srv1514598295:86 , srv1567972856:86 , srv1921601338:86 , srv1943906676:86 , srv1959130881:86 , srv1964298712:86 , srv1981890804:86 , srv2143399234:86 , srv236992540:86 , srv28640591:86 , srv286662511:86 , srv389874984:86 , srv758799271:86 , srv797514644:86 , srv981725030:86 , srv1038108793:87 , srv1074645899:87 , srv1195179167:87 , srv1607448531:87 , srv1663677215:87 , srv2137472808:87 , srv273479339:87 , srv750310608:87 , srv757564823:87 , srv872282391:87 , srv1026132257:88 , srv108367670:88 , srv1182170981:88 , srv1225194972:88 , srv1476768739:88 , srv1566106415:88 , srv1592038276:88 , srv1987778246:88 , srv222749964:88 , srv241081046:88 , srv531551753:88 , srv760453011:88 , srv852116196:88 , srv868560850:88 , srv1098517744:89 , srv1493955740:89 , srv1582714663:89 , srv273112334:89 , srv710078644:89 , srv75338010:89 , srv871273419:89 , srv960402953:89 , srv1386036703:90 , srv1604084870:90 , srv458272094:90 , srv2102780599:91 , srv602167672:92 , srv723368041:92 , srv652092324:94 , srv1995934728:95 , srv969654616:101 , srv31462775:443 }
2023-07-23 17:53:12,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-23 17:53:12,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv273479339=64, srv760453011=88, srv1043965138=2, srv710078644=82, srv1996400331=51, srv2051603702=55, srv1154287879=7, srv1582714663=26, srv1567972856=23, srv1584672690=27, srv1592038276=28, srv286662511=68, srv1566106415=22, srv2037860749=54, srv960402953=96, srv1614599808=32, srv1038108793=1, srv423403712=73, srv1509205829=19, srv981725030=98, srv1070168211=3, srv1493955740=18, srv1098517744=6, srv28640591=67, srv1604084870=30, srv1959130881=45, srv2102780599=56, srv222749964=60, srv1333087563=14, srv75338010=85, srv1995934728=50, srv852116196=92, srv1964298712=46, srv1179984521=8, srv389874984=71, srv2030302952=53, srv872282391=95, srv286016110=66, srv1663677215=36, srv1743734514=38, srv2000274323=52, srv758799271=87, srv1514598295=20, srv1787353636=40, srv1195179167=10, srv1386036703=15, srv659288383=81, srv652092324=80, srv1805117798=41, srv241081046=62, srv1266023635=12, srv2126774585=57, srv1921601338=42, srv281440323=65, srv1425981447=16, srv602167672=78, srv31462775=69, srv1618075018=33, srv236992540=61, srv463047960=75, srv1987778246=49, srv1943906676=43, srv1581967531=25, srv2137472808=58, srv750310608=84, srv969654616=97, srv1074645899=4, srv621364257=79, srv405330462=72, srv108367670=5, srv1571736054=24, srv1314037533=13, srv1958217999=44, srv1182170981=9, srv1026132257=0, srv1476768739=17, srv1523512938=21, srv458272094=74, srv475370953=76, srv871273419=94, srv797514644=89, srv1653134492=35, srv1627542057=34, srv197744701=47, srv799428265=90, srv723368041=83, srv757564823=86, srv2143399234=59, srv531551753=77, srv1981890804=48, srv1225194972=11, srv994746404=99, srv828584090=91, srv15997351=29, srv868560850=93, srv1760849343=39, srv273112334=63, srv1607448531=31, srv1721513684=37, srv374583850=70} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-23 17:53:12,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-23 17:53:12,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-23 17:53:12,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-23 17:53:12,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-23 17:53:12,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-23 17:53:12,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-23 17:53:12,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-23 17:53:12,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-23 17:53:12,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-23 17:53:12,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-23 17:53:12,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-23 17:53:12,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-23 17:53:12,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-23 17:53:12,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-23 17:53:12,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-23 17:53:12,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-23 17:53:12,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-23 17:53:12,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-23 17:53:12,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-23 17:53:12,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-23 17:53:12,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-23 17:53:12,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-23 17:53:12,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-23 17:53:12,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-23 17:53:12,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-23 17:53:12,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-23 17:53:12,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-23 17:53:12,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-23 17:53:12,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-23 17:53:12,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-23 17:53:12,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-23 17:53:12,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-23 17:53:12,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-23 17:53:12,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-23 17:53:12,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-23 17:53:12,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-23 17:53:12,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-23 17:53:12,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-23 17:53:12,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-23 17:53:12,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-23 17:53:12,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-23 17:53:12,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-23 17:53:12,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-23 17:53:12,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-23 17:53:12,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-23 17:53:12,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-23 17:53:12,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-23 17:53:12,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-23 17:53:12,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-23 17:53:12,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-23 17:53:12,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-23 17:53:12,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-23 17:53:12,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-23 17:53:12,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-23 17:53:12,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-23 17:53:12,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-23 17:53:12,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-23 17:53:12,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-23 17:53:12,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-23 17:53:12,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-23 17:53:12,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-23 17:53:12,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-23 17:53:12,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-23 17:53:12,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-23 17:53:12,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-23 17:53:12,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-23 17:53:12,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-23 17:53:12,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-23 17:53:12,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-23 17:53:12,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-23 17:53:12,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-23 17:53:12,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-23 17:53:12,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-23 17:53:12,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-23 17:53:12,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-23 17:53:12,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-23 17:53:12,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-23 17:53:12,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-23 17:53:12,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-23 17:53:12,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-23 17:53:12,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-23 17:53:12,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-23 17:53:12,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-23 17:53:12,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-23 17:53:12,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-23 17:53:12,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-23 17:53:12,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-23 17:53:12,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-23 17:53:12,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-23 17:53:12,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-23 17:53:12,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-23 17:53:12,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-23 17:53:12,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-23 17:53:12,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-23 17:53:12,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-23 17:53:12,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-23 17:53:12,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-23 17:53:12,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-23 17:53:12,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-23 17:53:12,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-23 17:53:12,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-23 17:53:12,977 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03975012362522255, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0561543487776701, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03975012362522255, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17525, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.239, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-23 17:53:12,977 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-23 17:53:12,977 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17973426983559448, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03975012362522255, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0561543487776701, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03975012362522255, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17525, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.239, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-23 17:53:13,321 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 468 ms to try 5000 different iterations.  Found a solution that moves 2649 regions; Going from a computed imbalance of 0.17973426983559448 to a new imbalance of 0.015217617142171326. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022611075951957705); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03400666733333464, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29433333333333334, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022611075951957705); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011833333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04758333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-23 17:53:13,335 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv969654616:70 , srv652092324:79 , srv1995934728:80 , srv2102780599:80 , srv1386036703:81 , srv602167672:81 , srv723368041:81 , srv1182170981:82 , srv1195179167:82 , srv1225194972:82 , srv1592038276:82 , srv871273419:82 , srv960402953:82 , srv1098517744:83 , srv1476768739:83 , srv1604084870:83 , srv273112334:83 , srv75338010:83 , srv1038108793:84 , srv1074645899:84 , srv108367670:84 , srv1314037533:84 , srv1493955740:84 , srv1582714663:84 , srv1607448531:84 , srv1943906676:84 , srv1964298712:84 , srv1987778246:84 , srv241081046:84 , srv458272094:84 , srv463047960:84 , srv531551753:84 , srv852116196:84 , srv868560850:84 , srv1566106415:85 , srv1567972856:85 , srv1618075018:85 , srv1663677215:85 , srv1921601338:85 , srv1981890804:85 , srv222749964:85 , srv236992540:85 , srv389874984:85 , srv1026132257:86 , srv1179984521:86 , srv1581967531:86 , srv15997351:86 , srv197744701:86 , srv2143399234:86 , srv286016110:86 , srv28640591:86 , srv286662511:86 , srv374583850:86 , srv621364257:86 , srv750310608:86 , srv757564823:86 , srv758799271:86 , srv760453011:86 , srv797514644:86 , srv828584090:86 , srv872282391:86 , srv1043965138:87 , srv1070168211:87 , srv1266023635:87 , srv1333087563:87 , srv1627542057:87 , srv1721513684:87 , srv1743734514:87 , srv1958217999:87 , srv2000274323:87 , srv2137472808:87 , srv273479339:87 , srv710078644:87 , srv981725030:87 , srv994746404:87 , srv1154287879:88 , srv1425981447:88 , srv1584672690:88 , srv1653134492:88 , srv1787353636:88 , srv1805117798:88 , srv1959130881:88 , srv423403712:88 , srv475370953:88 , srv659288383:88 , srv1514598295:89 , srv1523512938:89 , srv1571736054:89 , srv1760849343:89 , srv1996400331:89 , srv2037860749:89 , srv2051603702:89 , srv2126774585:89 , srv1509205829:90 , srv1614599808:90 , srv281440323:90 , srv405330462:90 , srv799428265:90 , srv2030302952:92 , srv31462775:532 }
2023-07-23 17:53:13,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-23 17:53:13,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv273479339=64, srv760453011=88, srv1043965138=2, srv710078644=82, srv1996400331=51, srv2051603702=55, srv1154287879=7, srv1582714663=26, srv1567972856=23, srv1584672690=27, srv1592038276=28, srv286662511=68, srv1566106415=22, srv2037860749=54, srv960402953=96, srv1614599808=32, srv1038108793=1, srv423403712=73, srv1509205829=19, srv981725030=98, srv1070168211=3, srv1493955740=18, srv1098517744=6, srv28640591=67, srv1604084870=30, srv1959130881=45, srv2102780599=56, srv222749964=60, srv1333087563=14, srv75338010=85, srv1995934728=50, srv852116196=92, srv1964298712=46, srv1179984521=8, srv389874984=71, srv2030302952=53, srv872282391=95, srv286016110=66, srv1663677215=36, srv1743734514=38, srv2000274323=52, srv758799271=87, srv1514598295=20, srv1787353636=40, srv1195179167=10, srv1386036703=15, srv659288383=81, srv652092324=80, srv1805117798=41, srv241081046=62, srv1266023635=12, srv2126774585=57, srv1921601338=42, srv281440323=65, srv1425981447=16, srv602167672=78, srv31462775=69, srv1618075018=33, srv236992540=61, srv463047960=75, srv1987778246=49, srv1943906676=43, srv1581967531=25, srv2137472808=58, srv750310608=84, srv969654616=97, srv1074645899=4, srv621364257=79, srv405330462=72, srv108367670=5, srv1571736054=24, srv1314037533=13, srv1958217999=44, srv1182170981=9, srv1026132257=0, srv1476768739=17, srv1523512938=21, srv458272094=74, srv475370953=76, srv871273419=94, srv797514644=89, srv1653134492=35, srv1627542057=34, srv197744701=47, srv799428265=90, srv723368041=83, srv757564823=86, srv2143399234=59, srv531551753=77, srv1981890804=48, srv1225194972=11, srv994746404=99, srv828584090=91, srv15997351=29, srv868560850=93, srv1760849343=39, srv273112334=63, srv1607448531=31, srv1721513684=37, srv374583850=70} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-23 17:53:13,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-23 17:53:13,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-23 17:53:13,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-23 17:53:13,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-23 17:53:13,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-23 17:53:13,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-23 17:53:13,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-23 17:53:13,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-23 17:53:13,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-23 17:53:13,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-23 17:53:13,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-23 17:53:13,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-23 17:53:13,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-23 17:53:13,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-23 17:53:13,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-23 17:53:13,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-23 17:53:13,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-23 17:53:13,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-23 17:53:13,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-23 17:53:13,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-23 17:53:13,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-23 17:53:13,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-23 17:53:13,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-23 17:53:13,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-23 17:53:13,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-23 17:53:13,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-23 17:53:13,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-23 17:53:13,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-23 17:53:13,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-23 17:53:13,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-23 17:53:13,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-23 17:53:13,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-23 17:53:13,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-23 17:53:13,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-23 17:53:13,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-23 17:53:13,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-23 17:53:13,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-23 17:53:13,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-23 17:53:13,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-23 17:53:13,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-23 17:53:13,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-23 17:53:13,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-23 17:53:13,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-23 17:53:13,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-23 17:53:13,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-23 17:53:13,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-23 17:53:13,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-23 17:53:13,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-23 17:53:13,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-23 17:53:13,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-23 17:53:13,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-23 17:53:13,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-23 17:53:13,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-23 17:53:13,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-23 17:53:13,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-23 17:53:13,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-23 17:53:13,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-23 17:53:13,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-23 17:53:13,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-23 17:53:13,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-23 17:53:13,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-23 17:53:13,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-23 17:53:13,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-23 17:53:13,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-23 17:53:13,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-23 17:53:13,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-23 17:53:13,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-23 17:53:13,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-23 17:53:13,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-23 17:53:13,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-23 17:53:13,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-23 17:53:13,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-23 17:53:13,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-23 17:53:13,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-23 17:53:13,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-23 17:53:13,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-23 17:53:13,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-23 17:53:13,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-23 17:53:13,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-23 17:53:13,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-23 17:53:13,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-23 17:53:13,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-23 17:53:13,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-23 17:53:13,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-23 17:53:13,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-23 17:53:13,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-23 17:53:13,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-23 17:53:13,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-23 17:53:13,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-23 17:53:13,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-23 17:53:13,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-23 17:53:13,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-23 17:53:13,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-23 17:53:13,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-23 17:53:13,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-23 17:53:13,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-23 17:53:13,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-23 17:53:13,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-23 17:53:13,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-23 17:53:13,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-23 17:53:13,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-23 17:53:13,538 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022611075951957705); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03400666733333464, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022611075951957705); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011833333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04758333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-23 17:53:13,538 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-23 17:53:13,538 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.01519906844772213, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022611075951957705); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03400666733333464, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022611075951957705); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011833333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04758333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-23 17:53:13,783 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 364 ms to try 5000 different iterations.  Found a solution that moves 999 regions; Going from a computed imbalance of 0.01519906844772213 to a new imbalance of 5.983041833532963E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008126693517330957); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010999438818457406); MoveCostFunction : (multiplier=7.0, imbalance=0.111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.008126693517330957); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0030833333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-23 17:53:13,785 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1514598295:82 , srv2030302952:82 , srv1026132257:83 , srv1653134492:83 , srv1959130881:83 , srv2126774585:83 , srv273479339:83 , srv710078644:83 , srv750310608:83 , srv981725030:83 , srv1043965138:84 , srv1154287879:84 , srv1509205829:84 , srv1523512938:84 , srv1566106415:84 , srv1604084870:84 , srv1663677215:84 , srv1743734514:84 , srv1995934728:84 , srv222749964:84 , srv273112334:84 , srv405330462:84 , srv458272094:84 , srv602167672:84 , srv75338010:84 , srv757564823:84 , srv760453011:84 , srv799428265:84 , srv1070168211:85 , srv108367670:85 , srv1098517744:85 , srv1493955740:85 , srv1582714663:85 , srv1584672690:85 , srv1614599808:85 , srv1627542057:85 , srv1721513684:85 , srv1760849343:85 , srv1787353636:85 , srv1921601338:85 , srv1987778246:85 , srv1996400331:85 , srv2000274323:85 , srv2037860749:85 , srv2137472808:85 , srv2143399234:85 , srv236992540:85 , srv281440323:85 , srv28640591:85 , srv423403712:85 , srv475370953:85 , srv652092324:85 , srv758799271:85 , srv797514644:85 , srv852116196:85 , srv872282391:85 , srv1038108793:86 , srv1074645899:86 , srv1266023635:86 , srv1333087563:86 , srv1386036703:86 , srv1425981447:86 , srv1567972856:86 , srv1571736054:86 , srv1581967531:86 , srv15997351:86 , srv1607448531:86 , srv1805117798:86 , srv1943906676:86 , srv2102780599:86 , srv241081046:86 , srv286662511:86 , srv374583850:86 , srv389874984:86 , srv531551753:86 , srv723368041:86 , srv871273419:86 , srv960402953:86 , srv969654616:86 , srv994746404:86 , srv1182170981:87 , srv1225194972:87 , srv1476768739:87 , srv1592038276:87 , srv1618075018:87 , srv1958217999:87 , srv1964298712:87 , srv1981890804:87 , srv2051603702:87 , srv286016110:87 , srv659288383:87 , srv868560850:87 , srv1179984521:88 , srv1195179167:88 , srv1314037533:88 , srv197744701:88 , srv621364257:88 , srv828584090:88 , srv463047960:89 , srv31462775:555 }
2023-07-23 17:53:13,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-23 17:53:13,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv273479339=64, srv760453011=88, srv1043965138=2, srv710078644=82, srv1996400331=51, srv2051603702=55, srv1154287879=7, srv1582714663=26, srv1567972856=23, srv1584672690=27, srv1592038276=28, srv286662511=68, srv1566106415=22, srv2037860749=54, srv960402953=96, srv1614599808=32, srv1038108793=1, srv423403712=73, srv1509205829=19, srv981725030=98, srv1070168211=3, srv1493955740=18, srv1098517744=6, srv28640591=67, srv1604084870=30, srv1959130881=45, srv2102780599=56, srv222749964=60, srv1333087563=14, srv75338010=85, srv1995934728=50, srv852116196=92, srv1964298712=46, srv1179984521=8, srv389874984=71, srv2030302952=53, srv872282391=95, srv286016110=66, srv1663677215=36, srv1743734514=38, srv2000274323=52, srv758799271=87, srv1514598295=20, srv1787353636=40, srv1195179167=10, srv1386036703=15, srv659288383=81, srv652092324=80, srv1805117798=41, srv241081046=62, srv1266023635=12, srv2126774585=57, srv1921601338=42, srv281440323=65, srv1425981447=16, srv602167672=78, srv31462775=69, srv1618075018=33, srv236992540=61, srv463047960=75, srv1987778246=49, srv1943906676=43, srv1581967531=25, srv2137472808=58, srv750310608=84, srv969654616=97, srv1074645899=4, srv621364257=79, srv405330462=72, srv108367670=5, srv1571736054=24, srv1314037533=13, srv1958217999=44, srv1182170981=9, srv1026132257=0, srv1476768739=17, srv1523512938=21, srv458272094=74, srv475370953=76, srv871273419=94, srv797514644=89, srv1653134492=35, srv1627542057=34, srv197744701=47, srv799428265=90, srv723368041=83, srv757564823=86, srv2143399234=59, srv531551753=77, srv1981890804=48, srv1225194972=11, srv994746404=99, srv828584090=91, srv15997351=29, srv868560850=93, srv1760849343=39, srv273112334=63, srv1607448531=31, srv1721513684=37, srv374583850=70} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-23 17:53:13,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-23 17:53:13,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-23 17:53:13,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-23 17:53:13,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-23 17:53:13,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-23 17:53:13,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-23 17:53:13,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-23 17:53:13,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-23 17:53:13,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-23 17:53:13,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-23 17:53:13,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-23 17:53:13,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-23 17:53:13,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-23 17:53:13,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-23 17:53:13,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-23 17:53:13,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-23 17:53:13,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-23 17:53:13,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-23 17:53:13,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-23 17:53:13,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-23 17:53:13,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-23 17:53:13,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-23 17:53:13,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-23 17:53:13,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-23 17:53:13,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-23 17:53:13,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-23 17:53:13,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-23 17:53:13,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-23 17:53:13,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-23 17:53:13,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-23 17:53:13,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-23 17:53:13,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-23 17:53:13,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-23 17:53:13,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-23 17:53:13,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-23 17:53:13,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-23 17:53:13,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-23 17:53:13,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-23 17:53:13,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-23 17:53:13,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-23 17:53:13,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-23 17:53:13,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-23 17:53:13,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-23 17:53:13,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-23 17:53:13,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-23 17:53:13,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-23 17:53:13,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-23 17:53:13,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-23 17:53:13,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-23 17:53:13,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-23 17:53:13,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-23 17:53:13,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-23 17:53:13,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-23 17:53:13,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-23 17:53:13,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-23 17:53:13,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-23 17:53:13,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-23 17:53:13,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-23 17:53:13,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-23 17:53:13,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-23 17:53:13,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-23 17:53:13,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-23 17:53:13,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-23 17:53:13,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-23 17:53:13,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-23 17:53:13,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-23 17:53:13,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-23 17:53:13,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-23 17:53:13,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-23 17:53:13,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-23 17:53:13,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-23 17:53:13,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-23 17:53:13,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-23 17:53:13,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-23 17:53:13,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-23 17:53:13,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-23 17:53:13,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-23 17:53:13,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-23 17:53:13,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-23 17:53:13,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-23 17:53:13,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-23 17:53:13,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-23 17:53:13,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-23 17:53:13,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-23 17:53:13,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-23 17:53:13,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-23 17:53:13,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-23 17:53:13,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-23 17:53:13,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-23 17:53:13,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-23 17:53:13,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-23 17:53:13,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-23 17:53:13,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-23 17:53:13,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-23 17:53:13,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-23 17:53:13,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-23 17:53:13,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-23 17:53:13,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-23 17:53:13,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-23 17:53:13,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-23 17:53:13,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-23 17:53:13,970 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008126693517330957); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010999438818457406); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.008126693517330957); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0030833333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-23 17:53:13,970 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-23 17:53:13,970 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=5.913090358430106E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008126693517330957); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010999438818457406); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.008126693517330957); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0030833333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-23 17:53:14,421 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 589 ms to try 5000 different iterations.  Found a solution that moves 224 regions; Going from a computed imbalance of 5.913090358430106E-4 to a new imbalance of 3.391828418414516E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.024888888888888887); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-23 17:53:14,422 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1995934728:83 , srv2137472808:83 , srv621364257:83 , srv710078644:83 , srv723368041:83 , srv828584090:83 , srv868560850:83 , srv1179984521:84 , srv1266023635:84 , srv1314037533:84 , srv1476768739:84 , srv1493955740:84 , srv1509205829:84 , srv1571736054:84 , srv1582714663:84 , srv1760849343:84 , srv1787353636:84 , srv1958217999:84 , srv197744701:84 , srv1981890804:84 , srv1987778246:84 , srv241081046:84 , srv286016110:84 , srv286662511:84 , srv405330462:84 , srv458272094:84 , srv463047960:84 , srv475370953:84 , srv531551753:84 , srv652092324:84 , srv760453011:84 , srv797514644:84 , srv872282391:84 , srv969654616:84 , srv994746404:84 , srv1026132257:85 , srv1038108793:85 , srv1043965138:85 , srv1070168211:85 , srv1074645899:85 , srv108367670:85 , srv1098517744:85 , srv1154287879:85 , srv1182170981:85 , srv1195179167:85 , srv1225194972:85 , srv1333087563:85 , srv1386036703:85 , srv1425981447:85 , srv1514598295:85 , srv1523512938:85 , srv1566106415:85 , srv1567972856:85 , srv1581967531:85 , srv1592038276:85 , srv1604084870:85 , srv1607448531:85 , srv1614599808:85 , srv1618075018:85 , srv1627542057:85 , srv1805117798:85 , srv1921601338:85 , srv1959130881:85 , srv1964298712:85 , srv1996400331:85 , srv2037860749:85 , srv2051603702:85 , srv2102780599:85 , srv2126774585:85 , srv2143399234:85 , srv222749964:85 , srv273479339:85 , srv281440323:85 , srv28640591:85 , srv374583850:85 , srv389874984:85 , srv423403712:85 , srv602167672:85 , srv659288383:85 , srv757564823:85 , srv758799271:85 , srv799428265:85 , srv852116196:85 , srv871273419:85 , srv960402953:85 , srv1584672690:86 , srv15997351:86 , srv1653134492:86 , srv1663677215:86 , srv1721513684:86 , srv1743734514:86 , srv1943906676:86 , srv2000274323:86 , srv2030302952:86 , srv236992540:86 , srv273112334:86 , srv750310608:86 , srv75338010:86 , srv981725030:86 , srv31462775:613 }
2023-07-23 17:53:14,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-23 17:53:14,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv273479339=64, srv760453011=88, srv1043965138=2, srv710078644=82, srv1996400331=51, srv2051603702=55, srv1154287879=7, srv1582714663=26, srv1567972856=23, srv1584672690=27, srv1592038276=28, srv286662511=68, srv1566106415=22, srv2037860749=54, srv960402953=96, srv1614599808=32, srv1038108793=1, srv423403712=73, srv1509205829=19, srv981725030=98, srv1070168211=3, srv1493955740=18, srv1098517744=6, srv28640591=67, srv1604084870=30, srv1959130881=45, srv2102780599=56, srv222749964=60, srv1333087563=14, srv75338010=85, srv1995934728=50, srv852116196=92, srv1964298712=46, srv1179984521=8, srv389874984=71, srv2030302952=53, srv872282391=95, srv286016110=66, srv1663677215=36, srv1743734514=38, srv2000274323=52, srv758799271=87, srv1514598295=20, srv1787353636=40, srv1195179167=10, srv1386036703=15, srv659288383=81, srv652092324=80, srv1805117798=41, srv241081046=62, srv1266023635=12, srv2126774585=57, srv1921601338=42, srv281440323=65, srv1425981447=16, srv602167672=78, srv31462775=69, srv1618075018=33, srv236992540=61, srv463047960=75, srv1987778246=49, srv1943906676=43, srv1581967531=25, srv2137472808=58, srv750310608=84, srv969654616=97, srv1074645899=4, srv621364257=79, srv405330462=72, srv108367670=5, srv1571736054=24, srv1314037533=13, srv1958217999=44, srv1182170981=9, srv1026132257=0, srv1476768739=17, srv1523512938=21, srv458272094=74, srv475370953=76, srv871273419=94, srv797514644=89, srv1653134492=35, srv1627542057=34, srv197744701=47, srv799428265=90, srv723368041=83, srv757564823=86, srv2143399234=59, srv531551753=77, srv1981890804=48, srv1225194972=11, srv994746404=99, srv828584090=91, srv15997351=29, srv868560850=93, srv1760849343=39, srv273112334=63, srv1607448531=31, srv1721513684=37, srv374583850=70} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-23 17:53:14,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-23 17:53:14,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-23 17:53:14,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-23 17:53:14,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-23 17:53:14,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-23 17:53:14,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-23 17:53:14,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-23 17:53:14,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-23 17:53:14,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-23 17:53:14,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-23 17:53:14,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-23 17:53:14,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-23 17:53:14,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-23 17:53:14,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-23 17:53:14,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-23 17:53:14,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-23 17:53:14,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-23 17:53:14,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-23 17:53:14,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-23 17:53:14,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-23 17:53:14,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-23 17:53:14,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-23 17:53:14,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-23 17:53:14,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-23 17:53:14,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-23 17:53:14,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-23 17:53:14,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-23 17:53:14,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-23 17:53:14,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-23 17:53:14,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-23 17:53:14,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-23 17:53:14,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-23 17:53:14,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-23 17:53:14,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-23 17:53:14,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-23 17:53:14,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-23 17:53:14,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-23 17:53:14,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-23 17:53:14,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-23 17:53:14,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-23 17:53:14,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-23 17:53:14,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-23 17:53:14,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-23 17:53:14,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-23 17:53:14,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-23 17:53:14,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-23 17:53:14,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-23 17:53:14,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-23 17:53:14,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-23 17:53:14,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-23 17:53:14,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-23 17:53:14,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-23 17:53:14,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-23 17:53:14,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-23 17:53:14,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-23 17:53:14,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-23 17:53:14,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-23 17:53:14,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-23 17:53:14,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-23 17:53:14,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-23 17:53:14,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-23 17:53:14,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-23 17:53:14,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-23 17:53:14,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-23 17:53:14,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-23 17:53:14,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-23 17:53:14,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-23 17:53:14,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-23 17:53:14,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-23 17:53:14,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-23 17:53:14,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-23 17:53:14,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-23 17:53:14,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-23 17:53:14,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-23 17:53:14,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-23 17:53:14,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-23 17:53:14,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-23 17:53:14,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-23 17:53:14,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-23 17:53:14,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-23 17:53:14,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-23 17:53:14,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-23 17:53:14,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-23 17:53:14,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-23 17:53:14,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-23 17:53:14,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-23 17:53:14,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-23 17:53:14,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-23 17:53:14,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-23 17:53:14,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-23 17:53:14,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-23 17:53:14,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-23 17:53:14,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-23 17:53:14,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-23 17:53:14,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-23 17:53:14,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-23 17:53:14,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-23 17:53:14,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-23 17:53:14,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-23 17:53:14,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-23 17:53:14,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-23 17:53:14,623 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-23 17:53:14,623 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-23 17:53:14,623 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=3.234980266031734E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-23 17:53:14,897 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 422 ms to try 5000 different iterations.  Found a solution that moves 27 regions; Going from a computed imbalance of 3.234980266031734E-5 to a new imbalance of 5.831551034345205E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0012535023884839248); MoveCostFunction : (multiplier=7.0, imbalance=0.003); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-23 17:53:14,898 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1584672690:83 , srv15997351:83 , srv1721513684:83 , srv197744701:83 , srv2030302952:83 , srv1026132257:84 , srv1038108793:84 , srv1043965138:84 , srv1070168211:84 , srv1074645899:84 , srv108367670:84 , srv1098517744:84 , srv1154287879:84 , srv1179984521:84 , srv1182170981:84 , srv1195179167:84 , srv1225194972:84 , srv1266023635:84 , srv1333087563:84 , srv1386036703:84 , srv1425981447:84 , srv1476768739:84 , srv1493955740:84 , srv1509205829:84 , srv1514598295:84 , srv1523512938:84 , srv1566106415:84 , srv1567972856:84 , srv1571736054:84 , srv1581967531:84 , srv1582714663:84 , srv1592038276:84 , srv1604084870:84 , srv1607448531:84 , srv1614599808:84 , srv1618075018:84 , srv1627542057:84 , srv1653134492:84 , srv1663677215:84 , srv1743734514:84 , srv1760849343:84 , srv1787353636:84 , srv1805117798:84 , srv1943906676:84 , srv1958217999:84 , srv1959130881:84 , srv1964298712:84 , srv1981890804:84 , srv1995934728:84 , srv2000274323:84 , srv2037860749:84 , srv2051603702:84 , srv2102780599:84 , srv2126774585:84 , srv2137472808:84 , srv2143399234:84 , srv222749964:84 , srv236992540:84 , srv241081046:84 , srv273112334:84 , srv273479339:84 , srv281440323:84 , srv286016110:84 , srv28640591:84 , srv286662511:84 , srv374583850:84 , srv389874984:84 , srv405330462:84 , srv423403712:84 , srv458272094:84 , srv463047960:84 , srv475370953:84 , srv531551753:84 , srv602167672:84 , srv621364257:84 , srv652092324:84 , srv659288383:84 , srv710078644:84 , srv723368041:84 , srv750310608:84 , srv75338010:84 , srv757564823:84 , srv758799271:84 , srv760453011:84 , srv799428265:84 , srv828584090:84 , srv852116196:84 , srv868560850:84 , srv871273419:84 , srv872282391:84 , srv960402953:84 , srv981725030:84 , srv994746404:84 , srv1314037533:85 , srv1921601338:85 , srv1987778246:85 , srv1996400331:85 , srv797514644:85 , srv969654616:85 , srv31462775:683 }
2023-07-23 17:53:14,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-23 17:53:14,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv273479339=64, srv760453011=88, srv1043965138=2, srv710078644=82, srv1996400331=51, srv2051603702=55, srv1154287879=7, srv1582714663=26, srv1567972856=23, srv1584672690=27, srv1592038276=28, srv286662511=68, srv1566106415=22, srv2037860749=54, srv960402953=96, srv1614599808=32, srv1038108793=1, srv423403712=73, srv1509205829=19, srv981725030=98, srv1070168211=3, srv1493955740=18, srv1098517744=6, srv28640591=67, srv1604084870=30, srv1959130881=45, srv2102780599=56, srv222749964=60, srv1333087563=14, srv75338010=85, srv1995934728=50, srv852116196=92, srv1964298712=46, srv1179984521=8, srv389874984=71, srv2030302952=53, srv872282391=95, srv286016110=66, srv1663677215=36, srv1743734514=38, srv2000274323=52, srv758799271=87, srv1514598295=20, srv1787353636=40, srv1195179167=10, srv1386036703=15, srv659288383=81, srv652092324=80, srv1805117798=41, srv241081046=62, srv1266023635=12, srv2126774585=57, srv1921601338=42, srv281440323=65, srv1425981447=16, srv602167672=78, srv31462775=69, srv1618075018=33, srv236992540=61, srv463047960=75, srv1987778246=49, srv1943906676=43, srv1581967531=25, srv2137472808=58, srv750310608=84, srv969654616=97, srv1074645899=4, srv621364257=79, srv405330462=72, srv108367670=5, srv1571736054=24, srv1314037533=13, srv1958217999=44, srv1182170981=9, srv1026132257=0, srv1476768739=17, srv1523512938=21, srv458272094=74, srv475370953=76, srv871273419=94, srv797514644=89, srv1653134492=35, srv1627542057=34, srv197744701=47, srv799428265=90, srv723368041=83, srv757564823=86, srv2143399234=59, srv531551753=77, srv1981890804=48, srv1225194972=11, srv994746404=99, srv828584090=91, srv15997351=29, srv868560850=93, srv1760849343=39, srv273112334=63, srv1607448531=31, srv1721513684=37, srv374583850=70} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-23 17:53:14,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-23 17:53:14,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-23 17:53:14,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-23 17:53:14,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-23 17:53:14,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-23 17:53:14,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-23 17:53:14,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-23 17:53:14,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-23 17:53:14,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-23 17:53:14,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-23 17:53:14,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-23 17:53:14,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-23 17:53:14,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-23 17:53:14,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-23 17:53:14,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-23 17:53:14,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-23 17:53:14,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-23 17:53:14,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-23 17:53:14,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-23 17:53:14,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-23 17:53:14,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-23 17:53:14,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-23 17:53:14,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-23 17:53:14,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-23 17:53:14,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-23 17:53:14,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-23 17:53:14,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-23 17:53:14,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-23 17:53:14,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-23 17:53:14,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-23 17:53:14,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-23 17:53:14,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-23 17:53:14,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-23 17:53:14,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-23 17:53:14,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-23 17:53:14,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-23 17:53:14,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-23 17:53:14,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-23 17:53:14,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-23 17:53:14,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-23 17:53:14,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-23 17:53:14,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-23 17:53:14,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-23 17:53:14,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-23 17:53:14,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-23 17:53:14,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-23 17:53:14,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-23 17:53:14,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-23 17:53:14,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-23 17:53:14,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-23 17:53:14,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-23 17:53:14,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-23 17:53:14,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-23 17:53:14,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-23 17:53:14,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-23 17:53:14,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-23 17:53:14,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-23 17:53:14,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-23 17:53:14,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-23 17:53:14,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-23 17:53:14,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-23 17:53:14,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-23 17:53:14,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-23 17:53:14,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-23 17:53:14,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-23 17:53:14,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-23 17:53:14,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-23 17:53:14,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-23 17:53:14,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-23 17:53:14,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-23 17:53:14,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-23 17:53:14,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-23 17:53:14,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-23 17:53:14,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-23 17:53:14,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-23 17:53:14,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-23 17:53:14,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-23 17:53:14,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-23 17:53:14,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-23 17:53:14,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-23 17:53:14,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-23 17:53:14,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-23 17:53:14,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-23 17:53:14,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-23 17:53:14,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-23 17:53:14,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-23 17:53:14,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-23 17:53:14,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-23 17:53:14,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-23 17:53:14,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-23 17:53:14,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-23 17:53:14,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-23 17:53:14,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-23 17:53:14,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-23 17:53:14,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-23 17:53:14,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-23 17:53:14,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-23 17:53:14,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-23 17:53:14,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-23 17:53:14,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-23 17:53:14,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-23 17:53:15,083 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=5.642492993526674E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0012535023884839248); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-23 17:53:15,084 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1584672690:83 , srv15997351:83 , srv1721513684:83 , srv197744701:83 , srv2030302952:83 , srv1026132257:84 , srv1038108793:84 , srv1043965138:84 , srv1070168211:84 , srv1074645899:84 , srv108367670:84 , srv1098517744:84 , srv1154287879:84 , srv1179984521:84 , srv1182170981:84 , srv1195179167:84 , srv1225194972:84 , srv1266023635:84 , srv1333087563:84 , srv1386036703:84 , srv1425981447:84 , srv1476768739:84 , srv1493955740:84 , srv1509205829:84 , srv1514598295:84 , srv1523512938:84 , srv1566106415:84 , srv1567972856:84 , srv1571736054:84 , srv1581967531:84 , srv1582714663:84 , srv1592038276:84 , srv1604084870:84 , srv1607448531:84 , srv1614599808:84 , srv1618075018:84 , srv1627542057:84 , srv1653134492:84 , srv1663677215:84 , srv1743734514:84 , srv1760849343:84 , srv1787353636:84 , srv1805117798:84 , srv1943906676:84 , srv1958217999:84 , srv1959130881:84 , srv1964298712:84 , srv1981890804:84 , srv1995934728:84 , srv2000274323:84 , srv2037860749:84 , srv2051603702:84 , srv2102780599:84 , srv2126774585:84 , srv2137472808:84 , srv2143399234:84 , srv222749964:84 , srv236992540:84 , srv241081046:84 , srv273112334:84 , srv273479339:84 , srv281440323:84 , srv286016110:84 , srv28640591:84 , srv286662511:84 , srv374583850:84 , srv389874984:84 , srv405330462:84 , srv423403712:84 , srv458272094:84 , srv463047960:84 , srv475370953:84 , srv531551753:84 , srv602167672:84 , srv621364257:84 , srv652092324:84 , srv659288383:84 , srv710078644:84 , srv723368041:84 , srv750310608:84 , srv75338010:84 , srv757564823:84 , srv758799271:84 , srv760453011:84 , srv799428265:84 , srv828584090:84 , srv852116196:84 , srv868560850:84 , srv871273419:84 , srv872282391:84 , srv960402953:84 , srv981725030:84 , srv994746404:84 , srv1314037533:85 , srv1921601338:85 , srv1987778246:85 , srv1996400331:85 , srv797514644:85 , srv969654616:85 , srv31462775:683 }
2023-07-23 17:53:15,119 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=291 (was 246) - SystemLoadAverage LEAK? -, ProcessCount=174 (was 174), AvailableMemoryMB=9675 (was 10563)
2023-07-23 17:53:15,129 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=291, ProcessCount=174, AvailableMemoryMB=9674
2023-07-23 17:53:15,130 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-07-23 17:53:15,130 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-07-23 17:53:15,144 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1082458563:84 , srv1084193195:84 , srv1188484162:84 , srv1191951767:84 , srv1194331692:84 , srv1198484181:84 , srv1277854959:84 , srv1322096040:84 , srv1374055550:84 , srv1509508976:84 , srv1512746106:84 , srv1539869880:84 , srv1602780174:84 , srv1800947540:84 , srv1817543378:84 , srv1972693784:84 , srv2008725445:84 , srv2063370215:84 , srv2093457165:84 , srv229941061:84 , srv373517415:84 , srv548043443:84 , srv564488061:84 , srv603513119:84 , srv720402760:84 , srv785375489:84 , srv867658621:84 , srv891429664:84 , srv949863459:84 , srv63159536:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-07-23 17:53:15,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-23 17:53:15,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1198484181=5, srv229941061=19, srv1188484162=2, srv867658621=27, srv373517415=20, srv720402760=25, srv1539869880=11, srv1602780174=12, srv564488061=22, srv1194331692=4, srv891429664=28, srv1800947540=13, srv1374055550=8, srv1084193195=1, srv1509508976=9, srv2008725445=16, srv1277854959=6, srv1512746106=10, srv548043443=21, srv785375489=26, srv63159536=24, srv2063370215=17, srv1322096040=7, srv1082458563=0, srv1191951767=3, srv949863459=29, srv2093457165=18, srv1817543378=14, srv1972693784=15, srv603513119=23} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-23 17:53:15,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-23 17:53:15,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-23 17:53:15,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-23 17:53:15,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-23 17:53:15,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-23 17:53:15,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-23 17:53:15,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-23 17:53:15,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-23 17:53:15,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-23 17:53:15,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-23 17:53:15,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-23 17:53:15,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-23 17:53:15,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-23 17:53:15,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-23 17:53:15,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-23 17:53:15,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-23 17:53:15,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-23 17:53:15,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-23 17:53:15,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-23 17:53:15,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-23 17:53:15,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-23 17:53:15,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-23 17:53:15,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-23 17:53:15,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-23 17:53:15,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-23 17:53:15,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-23 17:53:15,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-23 17:53:15,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-23 17:53:15,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-23 17:53:15,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-23 17:53:15,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-07-23 17:53:15,185 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0659777297534307, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-23 17:53:15,186 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912400936936363, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0659777297534307, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-07-23 17:55:15,165 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6357888 different iterations.  Found a solution that moves 1844 regions; Going from a computed imbalance of 0.9912400936936363 to a new imbalance of 4.303987990979898E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.682962962962963, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-23 17:55:15,171 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1082458563:90 , srv1084193195:90 , srv1188484162:90 , srv1191951767:90 , srv1194331692:90 , srv1198484181:90 , srv1277854959:90 , srv1322096040:90 , srv1374055550:90 , srv1509508976:90 , srv1512746106:90 , srv1539869880:90 , srv1602780174:90 , srv1800947540:90 , srv1817543378:90 , srv1972693784:90 , srv2008725445:90 , srv2063370215:90 , srv2093457165:90 , srv229941061:90 , srv373517415:90 , srv548043443:90 , srv564488061:90 , srv603513119:90 , srv63159536:90 , srv720402760:90 , srv785375489:90 , srv867658621:90 , srv891429664:90 , srv949863459:90 }
2023-07-23 17:55:15,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-23 17:55:15,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1198484181=5, srv229941061=19, srv1188484162=2, srv867658621=27, srv373517415=20, srv720402760=25, srv1539869880=11, srv1602780174=12, srv564488061=22, srv1194331692=4, srv891429664=28, srv1800947540=13, srv1374055550=8, srv1084193195=1, srv1509508976=9, srv2008725445=16, srv1277854959=6, srv1512746106=10, srv548043443=21, srv785375489=26, srv63159536=24, srv2063370215=17, srv1322096040=7, srv1082458563=0, srv1191951767=3, srv949863459=29, srv2093457165=18, srv1817543378=14, srv1972693784=15, srv603513119=23} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-23 17:55:15,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-23 17:55:15,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-23 17:55:15,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-23 17:55:15,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-23 17:55:15,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-23 17:55:15,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-23 17:55:15,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-23 17:55:15,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-23 17:55:15,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-23 17:55:15,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-23 17:55:15,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-23 17:55:15,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-23 17:55:15,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-23 17:55:15,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-23 17:55:15,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-23 17:55:15,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-23 17:55:15,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-23 17:55:15,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-23 17:55:15,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-23 17:55:15,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-23 17:55:15,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-23 17:55:15,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-23 17:55:15,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-23 17:55:15,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-23 17:55:15,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-23 17:55:15,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-23 17:55:15,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-23 17:55:15,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-23 17:55:15,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-23 17:55:15,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-23 17:55:15,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-07-23 17:55:15,196 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-23 17:55:15,196 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1082458563:90 , srv1084193195:90 , srv1188484162:90 , srv1191951767:90 , srv1194331692:90 , srv1198484181:90 , srv1277854959:90 , srv1322096040:90 , srv1374055550:90 , srv1509508976:90 , srv1512746106:90 , srv1539869880:90 , srv1602780174:90 , srv1800947540:90 , srv1817543378:90 , srv1972693784:90 , srv2008725445:90 , srv2063370215:90 , srv2093457165:90 , srv229941061:90 , srv373517415:90 , srv548043443:90 , srv564488061:90 , srv603513119:90 , srv63159536:90 , srv720402760:90 , srv785375489:90 , srv867658621:90 , srv891429664:90 , srv949863459:90 }
2023-07-23 17:55:15,219 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=162 (was 291), ProcessCount=171 (was 174), AvailableMemoryMB=9579 (was 9674)