2023-09-18 19:53:13,786 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-09-18 19:53:14,103 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-09-18 19:53:14,219 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-09-18 19:53:14,290 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-09-18 19:53:14,298 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-09-18 19:53:14,312 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=311, ProcessCount=169, AvailableMemoryMB=10886
2023-09-18 19:53:14,314 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-09-18 19:53:14,314 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-09-18 19:53:14,471 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv100288100:84 , srv1008102785:84 , srv1033706440:84 , srv1043974624:84 , srv1049055338:84 , srv1121677374:84 , srv1131062491:84 , srv1177180627:84 , srv1195931851:84 , srv1254215429:84 , srv1286443325:84 , srv1293257499:84 , srv1308090995:84 , srv132742898:84 , srv1337344809:84 , srv136187377:84 , srv1368614139:84 , srv1408663209:84 , srv1415490107:84 , srv141762476:84 , srv1421696411:84 , srv1426321395:84 , srv1456142997:84 , srv1456538276:84 , srv1464119149:84 , srv1481504148:84 , srv1641155093:84 , srv1656692219:84 , srv1670486804:84 , srv1694965504:84 , srv1705941983:84 , srv1710197699:84 , srv1717376877:84 , srv1752992955:84 , srv1774208500:84 , srv1792443676:84 , srv1793787527:84 , srv1821554824:84 , srv1870590304:84 , srv1872901041:84 , srv1877451206:84 , srv1878281582:84 , srv1885528632:84 , srv1914610682:84 , srv1934130423:84 , srv194082593:84 , srv1952262174:84 , srv1995650387:84 , srv2051320027:84 , srv2055638400:84 , srv2057722664:84 , srv2077877879:84 , srv211068370:84 , srv2134971366:84 , srv238723032:84 , srv240876062:84 , srv243213138:84 , srv2535309:84 , srv276876995:84 , srv279141937:84 , srv305983192:84 , srv332486101:84 , srv339495484:84 , srv346002894:84 , srv420145146:84 , srv434720766:84 , srv447133502:84 , srv462621527:84 , srv464211357:84 , srv50123408:84 , srv512198158:84 , srv528460539:84 , srv546150494:84 , srv579484870:84 , srv583953061:84 , srv625702098:84 , srv628732983:84 , srv653775113:84 , srv656638905:84 , srv658403454:84 , srv661989059:84 , srv668122043:84 , srv678745144:84 , srv718160177:84 , srv720075072:84 , srv768347006:84 , srv780434536:84 , srv792803594:84 , srv867785629:84 , srv899657801:84 , srv908830767:84 , srv909334495:84 , srv937359574:84 , srv94721359:84 , srv964762139:84 , srv978152123:84 , srv980789729:84 , srv981110766:84 , srv982628966:84 , srv250599122:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-09-18 19:53:14,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-18 19:53:14,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1308090995=12, srv194082593=45, srv1049055338=4, srv1195931851=8, srv718160177=84, srv276876995=59, srv899657801=90, srv250599122=57, srv462621527=68, srv50123408=70, srv656638905=79, srv2051320027=48, srv1821554824=37, srv982628966=99, srv1774208500=34, srv2535309=58, srv1885528632=42, srv978152123=96, srv1421696411=20, srv132742898=13, srv2077877879=51, srv2134971366=53, srv909334495=92, srv628732983=77, srv1878281582=41, srv1337344809=14, srv964762139=95, srv1464119149=24, srv980789729=97, srv1293257499=11, srv1717376877=32, srv211068370=52, srv579484870=74, srv1792443676=35, srv1415490107=18, srv528460539=72, srv1995650387=47, srv867785629=89, srv1033706440=2, srv1705941983=30, srv238723032=54, srv100288100=0, srv332486101=62, srv1131062491=6, srv1694965504=29, srv908830767=91, srv1670486804=28, srv136187377=15, srv625702098=76, srv240876062=55, srv1952262174=46, srv720075072=85, srv447133502=67, srv1641155093=26, srv668122043=82, srv305983192=61, srv420145146=65, srv1177180627=7, srv1914610682=43, srv141762476=19, srv1656692219=27, srv1121677374=5, srv1456142997=22, srv512198158=71, srv434720766=66, srv464211357=69, srv2057722664=50, srv1368614139=16, srv1286443325=10, srv2055638400=49, srv1872901041=39, srv1043974624=3, srv1934130423=44, srv1481504148=25, srv1752992955=33, srv279141937=60, srv653775113=78, srv678745144=83, srv661989059=81, srv243213138=56, srv1008102785=1, srv1254215429=9, srv1793787527=36, srv1877451206=40, srv339495484=63, srv658403454=80, srv583953061=75, srv1710197699=31, srv94721359=94, srv1408663209=17, srv346002894=64, srv1456538276=23, srv768347006=86, srv546150494=73, srv792803594=88, srv981110766=98, srv780434536=87, srv1426321395=21, srv937359574=93, srv1870590304=38} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-18 19:53:14,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-18 19:53:14,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-18 19:53:14,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-18 19:53:14,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-18 19:53:14,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-18 19:53:14,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-18 19:53:14,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-18 19:53:14,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-18 19:53:14,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-18 19:53:14,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-18 19:53:14,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-18 19:53:14,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-18 19:53:14,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-18 19:53:14,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-18 19:53:14,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-18 19:53:14,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-18 19:53:14,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-18 19:53:14,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-18 19:53:14,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-18 19:53:14,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-18 19:53:14,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-18 19:53:14,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-18 19:53:14,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-18 19:53:14,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-18 19:53:14,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-18 19:53:14,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-18 19:53:14,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-18 19:53:14,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-18 19:53:14,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-18 19:53:14,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-18 19:53:14,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-18 19:53:14,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-18 19:53:14,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-18 19:53:14,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-18 19:53:14,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-18 19:53:14,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-18 19:53:14,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-18 19:53:14,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-18 19:53:14,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-18 19:53:14,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-18 19:53:14,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-18 19:53:14,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-18 19:53:14,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-18 19:53:14,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-18 19:53:14,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-18 19:53:14,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-18 19:53:14,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-18 19:53:14,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-18 19:53:14,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-18 19:53:14,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-18 19:53:14,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-18 19:53:14,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-18 19:53:14,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-18 19:53:14,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-18 19:53:14,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-18 19:53:14,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-18 19:53:14,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-18 19:53:14,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-18 19:53:14,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-18 19:53:14,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-18 19:53:14,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-18 19:53:14,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-18 19:53:14,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-18 19:53:14,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-18 19:53:14,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-18 19:53:14,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-18 19:53:14,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-18 19:53:14,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-18 19:53:14,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-18 19:53:14,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-18 19:53:14,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-18 19:53:14,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-18 19:53:14,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-18 19:53:14,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-18 19:53:14,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-18 19:53:14,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-18 19:53:14,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-18 19:53:14,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-18 19:53:14,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-18 19:53:14,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-18 19:53:14,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-18 19:53:14,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-18 19:53:14,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-18 19:53:14,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-18 19:53:14,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-18 19:53:14,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-18 19:53:14,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-18 19:53:14,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-18 19:53:14,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-18 19:53:14,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-18 19:53:14,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-18 19:53:14,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-18 19:53:14,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-18 19:53:14,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-18 19:53:14,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-18 19:53:14,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-18 19:53:14,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-18 19:53:14,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-18 19:53:14,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-18 19:53:14,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-18 19:53:14,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-18 19:53:14,967 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-18 19:53:14,968 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-09-18 19:53:14,968 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-09-18 19:53:15,377 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 752 ms to try 5000 different iterations.  Found a solution that moves 4649 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.1832825466156079. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.039383578020957974, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05591198791687753, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5165555555555555, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.039383578020957974, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17883333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24225, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-18 19:53:15,422 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1670486804:82 , srv792803594:82 , srv1043974624:83 , srv1293257499:83 , srv1415490107:83 , srv141762476:83 , srv1421696411:83 , srv1710197699:83 , srv1792443676:83 , srv1952262174:83 , srv2055638400:83 , srv447133502:83 , srv668122043:83 , srv981110766:83 , srv982628966:83 , srv1131062491:84 , srv1177180627:84 , srv1885528632:84 , srv1995650387:84 , srv339495484:84 , srv583953061:84 , srv656638905:84 , srv100288100:85 , srv1121677374:85 , srv1254215429:85 , srv1308090995:85 , srv136187377:85 , srv1368614139:85 , srv1464119149:85 , srv1641155093:85 , srv1717376877:85 , srv1870590304:85 , srv305983192:85 , srv50123408:85 , srv625702098:85 , srv908830767:85 , srv1008102785:86 , srv1033706440:86 , srv1195931851:86 , srv1337344809:86 , srv1456142997:86 , srv1456538276:86 , srv1878281582:86 , srv194082593:86 , srv2077877879:86 , srv240876062:86 , srv243213138:86 , srv332486101:86 , srv346002894:86 , srv420145146:86 , srv462621527:86 , srv528460539:86 , srv653775113:86 , srv658403454:86 , srv720075072:86 , srv1426321395:87 , srv1481504148:87 , srv1705941983:87 , srv1752992955:87 , srv1774208500:87 , srv1934130423:87 , srv2051320027:87 , srv2057722664:87 , srv276876995:87 , srv512198158:87 , srv579484870:87 , srv628732983:87 , srv678745144:87 , srv978152123:87 , srv132742898:88 , srv1408663209:88 , srv1821554824:88 , srv2134971366:88 , srv238723032:88 , srv2535309:88 , srv718160177:88 , srv768347006:88 , srv780434536:88 , srv909334495:88 , srv1286443325:89 , srv1872901041:89 , srv1877451206:89 , srv1914610682:89 , srv211068370:89 , srv661989059:89 , srv964762139:89 , srv980789729:89 , srv1049055338:90 , srv1656692219:90 , srv867785629:90 , srv899657801:90 , srv1694965504:91 , srv279141937:91 , srv434720766:91 , srv464211357:91 , srv546150494:92 , srv1793787527:93 , srv937359574:93 , srv94721359:93 , srv250599122:440 }
2023-09-18 19:53:15,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-18 19:53:15,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1308090995=12, srv194082593=45, srv1049055338=4, srv1195931851=8, srv718160177=84, srv276876995=59, srv899657801=90, srv250599122=57, srv462621527=68, srv50123408=70, srv656638905=79, srv2051320027=48, srv1821554824=37, srv982628966=99, srv1774208500=34, srv2535309=58, srv1885528632=42, srv978152123=96, srv1421696411=20, srv132742898=13, srv2077877879=51, srv2134971366=53, srv909334495=92, srv628732983=77, srv1878281582=41, srv1337344809=14, srv964762139=95, srv1464119149=24, srv980789729=97, srv1293257499=11, srv1717376877=32, srv211068370=52, srv579484870=74, srv1792443676=35, srv1415490107=18, srv528460539=72, srv1995650387=47, srv867785629=89, srv1033706440=2, srv1705941983=30, srv238723032=54, srv100288100=0, srv332486101=62, srv1131062491=6, srv1694965504=29, srv908830767=91, srv1670486804=28, srv136187377=15, srv625702098=76, srv240876062=55, srv1952262174=46, srv720075072=85, srv447133502=67, srv1641155093=26, srv668122043=82, srv305983192=61, srv420145146=65, srv1177180627=7, srv1914610682=43, srv141762476=19, srv1656692219=27, srv1121677374=5, srv1456142997=22, srv512198158=71, srv434720766=66, srv464211357=69, srv2057722664=50, srv1368614139=16, srv1286443325=10, srv2055638400=49, srv1872901041=39, srv1043974624=3, srv1934130423=44, srv1481504148=25, srv1752992955=33, srv279141937=60, srv653775113=78, srv678745144=83, srv661989059=81, srv243213138=56, srv1008102785=1, srv1254215429=9, srv1793787527=36, srv1877451206=40, srv339495484=63, srv658403454=80, srv583953061=75, srv1710197699=31, srv94721359=94, srv1408663209=17, srv346002894=64, srv1456538276=23, srv768347006=86, srv546150494=73, srv792803594=88, srv981110766=98, srv780434536=87, srv1426321395=21, srv937359574=93, srv1870590304=38} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-18 19:53:15,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-18 19:53:15,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-18 19:53:15,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-18 19:53:15,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-18 19:53:15,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-18 19:53:15,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-18 19:53:15,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-18 19:53:15,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-18 19:53:15,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-18 19:53:15,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-18 19:53:15,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-18 19:53:15,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-18 19:53:15,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-18 19:53:15,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-18 19:53:15,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-18 19:53:15,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-18 19:53:15,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-18 19:53:15,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-18 19:53:15,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-18 19:53:15,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-18 19:53:15,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-18 19:53:15,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-18 19:53:15,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-18 19:53:15,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-18 19:53:15,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-18 19:53:15,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-18 19:53:15,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-18 19:53:15,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-18 19:53:15,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-18 19:53:15,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-18 19:53:15,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-18 19:53:15,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-18 19:53:15,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-18 19:53:15,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-18 19:53:15,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-18 19:53:15,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-18 19:53:15,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-18 19:53:15,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-18 19:53:15,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-18 19:53:15,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-18 19:53:15,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-18 19:53:15,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-18 19:53:15,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-18 19:53:15,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-18 19:53:15,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-18 19:53:15,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-18 19:53:15,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-18 19:53:15,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-18 19:53:15,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-18 19:53:15,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-18 19:53:15,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-18 19:53:15,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-18 19:53:15,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-18 19:53:15,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-18 19:53:15,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-18 19:53:15,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-18 19:53:15,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-18 19:53:15,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-18 19:53:15,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-18 19:53:15,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-18 19:53:15,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-18 19:53:15,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-18 19:53:15,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-18 19:53:15,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-18 19:53:15,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-18 19:53:15,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-18 19:53:15,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-18 19:53:15,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-18 19:53:15,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-18 19:53:15,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-18 19:53:15,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-18 19:53:15,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-18 19:53:15,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-18 19:53:15,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-18 19:53:15,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-18 19:53:15,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-18 19:53:15,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-18 19:53:15,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-18 19:53:15,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-18 19:53:15,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-18 19:53:15,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-18 19:53:15,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-18 19:53:15,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-18 19:53:15,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-18 19:53:15,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-18 19:53:15,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-18 19:53:15,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-18 19:53:15,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-18 19:53:15,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-18 19:53:15,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-18 19:53:15,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-18 19:53:15,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-18 19:53:15,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-18 19:53:15,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-18 19:53:15,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-18 19:53:15,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-18 19:53:15,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-18 19:53:15,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-18 19:53:15,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-18 19:53:15,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-18 19:53:15,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-18 19:53:15,662 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.039383578020957974, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05591198791687753, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.039383578020957974, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17883333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24225, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-18 19:53:15,662 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-09-18 19:53:15,663 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.1832499936218388, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.039383578020957974, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05591198791687753, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.039383578020957974, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17883333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24225, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-09-18 19:53:16,021 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 519 ms to try 5000 different iterations.  Found a solution that moves 2626 regions; Going from a computed imbalance of 0.1832499936218388 to a new imbalance of 0.014235545987147243. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021054031168814526); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03420411432252125, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2917777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021054031168814526); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011083333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04425, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-18 19:53:16,037 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1793787527:78 , srv937359574:79 , srv1694965504:80 , srv546150494:80 , srv94721359:80 , srv434720766:81 , srv661989059:81 , srv899657801:81 , srv1286443325:82 , srv1656692219:82 , srv1872901041:82 , srv211068370:82 , srv279141937:82 , srv464211357:82 , srv1049055338:83 , srv1426321395:83 , srv1877451206:83 , srv2535309:83 , srv276876995:83 , srv512198158:83 , srv718160177:83 , srv964762139:83 , srv1008102785:84 , srv1195931851:84 , srv132742898:84 , srv1481504148:84 , srv1914610682:84 , srv2051320027:84 , srv2057722664:84 , srv2134971366:84 , srv238723032:84 , srv579484870:84 , srv658403454:84 , srv678745144:84 , srv720075072:84 , srv768347006:84 , srv780434536:84 , srv909334495:84 , srv980789729:84 , srv1337344809:85 , srv1641155093:85 , srv1774208500:85 , srv1934130423:85 , srv243213138:85 , srv50123408:85 , srv528460539:85 , srv625702098:85 , srv867785629:85 , srv1121677374:86 , srv1308090995:86 , srv1368614139:86 , srv1456142997:86 , srv1705941983:86 , srv1752992955:86 , srv1821554824:86 , srv2077877879:86 , srv240876062:86 , srv305983192:86 , srv628732983:86 , srv908830767:86 , srv978152123:86 , srv1033706440:87 , srv1408663209:87 , srv1464119149:87 , srv1717376877:87 , srv1792443676:87 , srv1870590304:87 , srv1878281582:87 , srv194082593:87 , srv332486101:87 , srv346002894:87 , srv653775113:87 , srv1131062491:88 , srv1254215429:88 , srv1421696411:88 , srv1456538276:88 , srv1952262174:88 , srv447133502:88 , srv792803594:88 , srv100288100:89 , srv1177180627:89 , srv1293257499:89 , srv1415490107:89 , srv2055638400:89 , srv339495484:89 , srv462621527:89 , srv583953061:89 , srv656638905:89 , srv982628966:89 , srv1043974624:90 , srv136187377:90 , srv1670486804:90 , srv1885528632:90 , srv1995650387:90 , srv420145146:90 , srv668122043:90 , srv141762476:92 , srv1710197699:92 , srv981110766:95 , srv250599122:521 }
2023-09-18 19:53:16,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-18 19:53:16,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1308090995=12, srv194082593=45, srv1049055338=4, srv1195931851=8, srv718160177=84, srv276876995=59, srv899657801=90, srv250599122=57, srv462621527=68, srv50123408=70, srv656638905=79, srv2051320027=48, srv1821554824=37, srv982628966=99, srv1774208500=34, srv2535309=58, srv1885528632=42, srv978152123=96, srv1421696411=20, srv132742898=13, srv2077877879=51, srv2134971366=53, srv909334495=92, srv628732983=77, srv1878281582=41, srv1337344809=14, srv964762139=95, srv1464119149=24, srv980789729=97, srv1293257499=11, srv1717376877=32, srv211068370=52, srv579484870=74, srv1792443676=35, srv1415490107=18, srv528460539=72, srv1995650387=47, srv867785629=89, srv1033706440=2, srv1705941983=30, srv238723032=54, srv100288100=0, srv332486101=62, srv1131062491=6, srv1694965504=29, srv908830767=91, srv1670486804=28, srv136187377=15, srv625702098=76, srv240876062=55, srv1952262174=46, srv720075072=85, srv447133502=67, srv1641155093=26, srv668122043=82, srv305983192=61, srv420145146=65, srv1177180627=7, srv1914610682=43, srv141762476=19, srv1656692219=27, srv1121677374=5, srv1456142997=22, srv512198158=71, srv434720766=66, srv464211357=69, srv2057722664=50, srv1368614139=16, srv1286443325=10, srv2055638400=49, srv1872901041=39, srv1043974624=3, srv1934130423=44, srv1481504148=25, srv1752992955=33, srv279141937=60, srv653775113=78, srv678745144=83, srv661989059=81, srv243213138=56, srv1008102785=1, srv1254215429=9, srv1793787527=36, srv1877451206=40, srv339495484=63, srv658403454=80, srv583953061=75, srv1710197699=31, srv94721359=94, srv1408663209=17, srv346002894=64, srv1456538276=23, srv768347006=86, srv546150494=73, srv792803594=88, srv981110766=98, srv780434536=87, srv1426321395=21, srv937359574=93, srv1870590304=38} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-18 19:53:16,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-18 19:53:16,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-18 19:53:16,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-18 19:53:16,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-18 19:53:16,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-18 19:53:16,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-18 19:53:16,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-18 19:53:16,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-18 19:53:16,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-18 19:53:16,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-18 19:53:16,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-18 19:53:16,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-18 19:53:16,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-18 19:53:16,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-18 19:53:16,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-18 19:53:16,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-18 19:53:16,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-18 19:53:16,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-18 19:53:16,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-18 19:53:16,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-18 19:53:16,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-18 19:53:16,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-18 19:53:16,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-18 19:53:16,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-18 19:53:16,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-18 19:53:16,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-18 19:53:16,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-18 19:53:16,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-18 19:53:16,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-18 19:53:16,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-18 19:53:16,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-18 19:53:16,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-18 19:53:16,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-18 19:53:16,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-18 19:53:16,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-18 19:53:16,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-18 19:53:16,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-18 19:53:16,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-18 19:53:16,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-18 19:53:16,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-18 19:53:16,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-18 19:53:16,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-18 19:53:16,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-18 19:53:16,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-18 19:53:16,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-18 19:53:16,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-18 19:53:16,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-18 19:53:16,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-18 19:53:16,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-18 19:53:16,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-18 19:53:16,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-18 19:53:16,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-18 19:53:16,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-18 19:53:16,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-18 19:53:16,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-18 19:53:16,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-18 19:53:16,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-18 19:53:16,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-18 19:53:16,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-18 19:53:16,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-18 19:53:16,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-18 19:53:16,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-18 19:53:16,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-18 19:53:16,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-18 19:53:16,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-18 19:53:16,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-18 19:53:16,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-18 19:53:16,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-18 19:53:16,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-18 19:53:16,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-18 19:53:16,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-18 19:53:16,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-18 19:53:16,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-18 19:53:16,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-18 19:53:16,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-18 19:53:16,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-18 19:53:16,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-18 19:53:16,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-18 19:53:16,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-18 19:53:16,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-18 19:53:16,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-18 19:53:16,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-18 19:53:16,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-18 19:53:16,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-18 19:53:16,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-18 19:53:16,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-18 19:53:16,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-18 19:53:16,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-18 19:53:16,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-18 19:53:16,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-18 19:53:16,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-18 19:53:16,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-18 19:53:16,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-18 19:53:16,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-18 19:53:16,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-18 19:53:16,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-18 19:53:16,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-18 19:53:16,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-18 19:53:16,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-18 19:53:16,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-18 19:53:16,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-18 19:53:16,360 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021054031168814526); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03420411432252125, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021054031168814526); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011083333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04425, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-18 19:53:16,361 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-09-18 19:53:16,361 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.014217158342140226, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021054031168814526); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03420411432252125, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021054031168814526); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011083333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04425, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-09-18 19:53:16,781 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 659 ms to try 5000 different iterations.  Found a solution that moves 958 regions; Going from a computed imbalance of 0.014217158342140226 to a new imbalance of 7.291743032732662E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005107645338397696); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00670025210172808); MoveCostFunction : (multiplier=7.0, imbalance=0.10644444444444444, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005107645338397696); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00325); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-18 19:53:16,783 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv981110766:79 , srv420145146:81 , srv136187377:82 , srv1408663209:82 , srv1710197699:82 , srv141762476:83 , srv1885528632:83 , srv867785629:83 , srv100288100:84 , srv1033706440:84 , srv1043974624:84 , srv1177180627:84 , srv1254215429:84 , srv1456538276:84 , srv1821554824:84 , srv332486101:84 , srv339495484:84 , srv346002894:84 , srv462621527:84 , srv464211357:84 , srv583953061:84 , srv656638905:84 , srv1049055338:85 , srv1131062491:85 , srv1293257499:85 , srv132742898:85 , srv1670486804:85 , srv1705941983:85 , srv1717376877:85 , srv1752992955:85 , srv1774208500:85 , srv1870590304:85 , srv1878281582:85 , srv1914610682:85 , srv1934130423:85 , srv194082593:85 , srv1995650387:85 , srv2055638400:85 , srv2134971366:85 , srv279141937:85 , srv434720766:85 , srv546150494:85 , srv628732983:85 , srv668122043:85 , srv768347006:85 , srv94721359:85 , srv964762139:85 , srv978152123:85 , srv982628966:85 , srv1308090995:86 , srv1337344809:86 , srv1368614139:86 , srv1415490107:86 , srv1421696411:86 , srv1456142997:86 , srv1464119149:86 , srv1656692219:86 , srv1694965504:86 , srv1793787527:86 , srv1877451206:86 , srv1952262174:86 , srv2051320027:86 , srv2057722664:86 , srv2077877879:86 , srv238723032:86 , srv243213138:86 , srv579484870:86 , srv653775113:86 , srv718160177:86 , srv780434536:86 , srv899657801:86 , srv909334495:86 , srv937359574:86 , srv1008102785:87 , srv1121677374:87 , srv1195931851:87 , srv1286443325:87 , srv1426321395:87 , srv1481504148:87 , srv1792443676:87 , srv1872901041:87 , srv211068370:87 , srv240876062:87 , srv2535309:87 , srv276876995:87 , srv305983192:87 , srv447133502:87 , srv50123408:87 , srv528460539:87 , srv625702098:87 , srv661989059:87 , srv678745144:87 , srv792803594:87 , srv908830767:87 , srv1641155093:88 , srv512198158:88 , srv720075072:88 , srv980789729:88 , srv658403454:89 , srv250599122:542 }
2023-09-18 19:53:16,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-18 19:53:16,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1308090995=12, srv194082593=45, srv1049055338=4, srv1195931851=8, srv718160177=84, srv276876995=59, srv899657801=90, srv250599122=57, srv462621527=68, srv50123408=70, srv656638905=79, srv2051320027=48, srv1821554824=37, srv982628966=99, srv1774208500=34, srv2535309=58, srv1885528632=42, srv978152123=96, srv1421696411=20, srv132742898=13, srv2077877879=51, srv2134971366=53, srv909334495=92, srv628732983=77, srv1878281582=41, srv1337344809=14, srv964762139=95, srv1464119149=24, srv980789729=97, srv1293257499=11, srv1717376877=32, srv211068370=52, srv579484870=74, srv1792443676=35, srv1415490107=18, srv528460539=72, srv1995650387=47, srv867785629=89, srv1033706440=2, srv1705941983=30, srv238723032=54, srv100288100=0, srv332486101=62, srv1131062491=6, srv1694965504=29, srv908830767=91, srv1670486804=28, srv136187377=15, srv625702098=76, srv240876062=55, srv1952262174=46, srv720075072=85, srv447133502=67, srv1641155093=26, srv668122043=82, srv305983192=61, srv420145146=65, srv1177180627=7, srv1914610682=43, srv141762476=19, srv1656692219=27, srv1121677374=5, srv1456142997=22, srv512198158=71, srv434720766=66, srv464211357=69, srv2057722664=50, srv1368614139=16, srv1286443325=10, srv2055638400=49, srv1872901041=39, srv1043974624=3, srv1934130423=44, srv1481504148=25, srv1752992955=33, srv279141937=60, srv653775113=78, srv678745144=83, srv661989059=81, srv243213138=56, srv1008102785=1, srv1254215429=9, srv1793787527=36, srv1877451206=40, srv339495484=63, srv658403454=80, srv583953061=75, srv1710197699=31, srv94721359=94, srv1408663209=17, srv346002894=64, srv1456538276=23, srv768347006=86, srv546150494=73, srv792803594=88, srv981110766=98, srv780434536=87, srv1426321395=21, srv937359574=93, srv1870590304=38} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-18 19:53:16,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-18 19:53:16,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-18 19:53:16,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-18 19:53:16,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-18 19:53:16,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-18 19:53:16,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-18 19:53:16,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-18 19:53:16,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-18 19:53:16,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-18 19:53:16,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-18 19:53:16,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-18 19:53:16,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-18 19:53:16,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-18 19:53:16,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-18 19:53:16,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-18 19:53:16,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-18 19:53:16,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-18 19:53:16,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-18 19:53:16,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-18 19:53:16,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-18 19:53:16,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-18 19:53:16,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-18 19:53:16,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-18 19:53:16,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-18 19:53:16,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-18 19:53:16,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-18 19:53:16,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-18 19:53:16,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-18 19:53:16,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-18 19:53:16,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-18 19:53:16,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-18 19:53:16,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-18 19:53:16,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-18 19:53:16,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-18 19:53:16,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-18 19:53:16,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-18 19:53:16,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-18 19:53:16,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-18 19:53:16,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-18 19:53:16,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-18 19:53:16,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-18 19:53:16,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-18 19:53:16,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-18 19:53:16,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-18 19:53:16,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-18 19:53:16,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-18 19:53:16,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-18 19:53:16,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-18 19:53:16,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-18 19:53:16,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-18 19:53:16,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-18 19:53:16,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-18 19:53:16,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-18 19:53:16,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-18 19:53:16,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-18 19:53:16,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-18 19:53:16,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-18 19:53:16,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-18 19:53:16,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-18 19:53:16,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-18 19:53:16,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-18 19:53:16,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-18 19:53:16,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-18 19:53:16,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-18 19:53:16,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-18 19:53:16,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-18 19:53:16,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-18 19:53:16,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-18 19:53:16,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-18 19:53:16,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-18 19:53:16,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-18 19:53:16,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-18 19:53:16,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-18 19:53:16,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-18 19:53:16,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-18 19:53:16,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-18 19:53:16,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-18 19:53:16,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-18 19:53:16,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-18 19:53:16,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-18 19:53:16,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-18 19:53:16,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-18 19:53:16,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-18 19:53:16,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-18 19:53:16,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-18 19:53:16,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-18 19:53:16,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-18 19:53:16,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-18 19:53:16,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-18 19:53:16,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-18 19:53:16,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-18 19:53:16,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-18 19:53:16,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-18 19:53:16,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-18 19:53:16,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-18 19:53:16,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-18 19:53:16,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-18 19:53:16,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-18 19:53:16,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-18 19:53:16,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-18 19:53:16,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-18 19:53:16,924 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005107645338397696); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00670025210172808); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005107645338397696); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00325); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-18 19:53:16,924 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-09-18 19:53:16,925 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=7.224662438990383E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005107645338397696); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00670025210172808); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005107645338397696); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00325); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-09-18 19:53:17,209 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 379 ms to try 5000 different iterations.  Found a solution that moves 242 regions; Going from a computed imbalance of 7.224662438990383E-4 to a new imbalance of 2.5473229710874683E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.5313429231318235E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.02688888888888889, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.5313429231318235E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-18 19:53:17,210 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv980789729:81 , srv1995650387:83 , srv240876062:83 , srv462621527:83 , srv653775113:83 , srv658403454:83 , srv720075072:83 , srv937359574:83 , srv100288100:84 , srv1049055338:84 , srv1121677374:84 , srv1286443325:84 , srv1415490107:84 , srv141762476:84 , srv1456142997:84 , srv1456538276:84 , srv1464119149:84 , srv1481504148:84 , srv1641155093:84 , srv1656692219:84 , srv1705941983:84 , srv1752992955:84 , srv1774208500:84 , srv1821554824:84 , srv1872901041:84 , srv1877451206:84 , srv1878281582:84 , srv1934130423:84 , srv194082593:84 , srv2077877879:84 , srv211068370:84 , srv238723032:84 , srv2535309:84 , srv279141937:84 , srv305983192:84 , srv512198158:84 , srv528460539:84 , srv546150494:84 , srv628732983:84 , srv668122043:84 , srv678745144:84 , srv867785629:84 , srv908830767:84 , srv94721359:84 , srv978152123:84 , srv1008102785:85 , srv1033706440:85 , srv1043974624:85 , srv1131062491:85 , srv1177180627:85 , srv1195931851:85 , srv1254215429:85 , srv1293257499:85 , srv1308090995:85 , srv132742898:85 , srv1337344809:85 , srv136187377:85 , srv1368614139:85 , srv1408663209:85 , srv1421696411:85 , srv1426321395:85 , srv1670486804:85 , srv1694965504:85 , srv1710197699:85 , srv1717376877:85 , srv1792443676:85 , srv1793787527:85 , srv1870590304:85 , srv1885528632:85 , srv1914610682:85 , srv1952262174:85 , srv2051320027:85 , srv2055638400:85 , srv2057722664:85 , srv2134971366:85 , srv243213138:85 , srv276876995:85 , srv332486101:85 , srv339495484:85 , srv346002894:85 , srv420145146:85 , srv434720766:85 , srv447133502:85 , srv464211357:85 , srv50123408:85 , srv579484870:85 , srv583953061:85 , srv625702098:85 , srv661989059:85 , srv718160177:85 , srv768347006:85 , srv780434536:85 , srv792803594:85 , srv899657801:85 , srv909334495:85 , srv964762139:85 , srv981110766:85 , srv982628966:85 , srv656638905:86 , srv250599122:639 }
2023-09-18 19:53:17,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-18 19:53:17,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1308090995=12, srv194082593=45, srv1049055338=4, srv1195931851=8, srv718160177=84, srv276876995=59, srv899657801=90, srv250599122=57, srv462621527=68, srv50123408=70, srv656638905=79, srv2051320027=48, srv1821554824=37, srv982628966=99, srv1774208500=34, srv2535309=58, srv1885528632=42, srv978152123=96, srv1421696411=20, srv132742898=13, srv2077877879=51, srv2134971366=53, srv909334495=92, srv628732983=77, srv1878281582=41, srv1337344809=14, srv964762139=95, srv1464119149=24, srv980789729=97, srv1293257499=11, srv1717376877=32, srv211068370=52, srv579484870=74, srv1792443676=35, srv1415490107=18, srv528460539=72, srv1995650387=47, srv867785629=89, srv1033706440=2, srv1705941983=30, srv238723032=54, srv100288100=0, srv332486101=62, srv1131062491=6, srv1694965504=29, srv908830767=91, srv1670486804=28, srv136187377=15, srv625702098=76, srv240876062=55, srv1952262174=46, srv720075072=85, srv447133502=67, srv1641155093=26, srv668122043=82, srv305983192=61, srv420145146=65, srv1177180627=7, srv1914610682=43, srv141762476=19, srv1656692219=27, srv1121677374=5, srv1456142997=22, srv512198158=71, srv434720766=66, srv464211357=69, srv2057722664=50, srv1368614139=16, srv1286443325=10, srv2055638400=49, srv1872901041=39, srv1043974624=3, srv1934130423=44, srv1481504148=25, srv1752992955=33, srv279141937=60, srv653775113=78, srv678745144=83, srv661989059=81, srv243213138=56, srv1008102785=1, srv1254215429=9, srv1793787527=36, srv1877451206=40, srv339495484=63, srv658403454=80, srv583953061=75, srv1710197699=31, srv94721359=94, srv1408663209=17, srv346002894=64, srv1456538276=23, srv768347006=86, srv546150494=73, srv792803594=88, srv981110766=98, srv780434536=87, srv1426321395=21, srv937359574=93, srv1870590304=38} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-18 19:53:17,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-18 19:53:17,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-18 19:53:17,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-18 19:53:17,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-18 19:53:17,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-18 19:53:17,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-18 19:53:17,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-18 19:53:17,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-18 19:53:17,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-18 19:53:17,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-18 19:53:17,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-18 19:53:17,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-18 19:53:17,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-18 19:53:17,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-18 19:53:17,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-18 19:53:17,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-18 19:53:17,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-18 19:53:17,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-18 19:53:17,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-18 19:53:17,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-18 19:53:17,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-18 19:53:17,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-18 19:53:17,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-18 19:53:17,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-18 19:53:17,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-18 19:53:17,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-18 19:53:17,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-18 19:53:17,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-18 19:53:17,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-18 19:53:17,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-18 19:53:17,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-18 19:53:17,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-18 19:53:17,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-18 19:53:17,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-18 19:53:17,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-18 19:53:17,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-18 19:53:17,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-18 19:53:17,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-18 19:53:17,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-18 19:53:17,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-18 19:53:17,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-18 19:53:17,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-18 19:53:17,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-18 19:53:17,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-18 19:53:17,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-18 19:53:17,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-18 19:53:17,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-18 19:53:17,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-18 19:53:17,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-18 19:53:17,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-18 19:53:17,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-18 19:53:17,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-18 19:53:17,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-18 19:53:17,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-18 19:53:17,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-18 19:53:17,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-18 19:53:17,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-18 19:53:17,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-18 19:53:17,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-18 19:53:17,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-18 19:53:17,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-18 19:53:17,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-18 19:53:17,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-18 19:53:17,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-18 19:53:17,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-18 19:53:17,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-18 19:53:17,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-18 19:53:17,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-18 19:53:17,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-18 19:53:17,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-18 19:53:17,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-18 19:53:17,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-18 19:53:17,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-18 19:53:17,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-18 19:53:17,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-18 19:53:17,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-18 19:53:17,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-18 19:53:17,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-18 19:53:17,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-18 19:53:17,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-18 19:53:17,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-18 19:53:17,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-18 19:53:17,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-18 19:53:17,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-18 19:53:17,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-18 19:53:17,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-18 19:53:17,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-18 19:53:17,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-18 19:53:17,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-18 19:53:17,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-18 19:53:17,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-18 19:53:17,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-18 19:53:17,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-18 19:53:17,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-18 19:53:17,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-18 19:53:17,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-18 19:53:17,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-18 19:53:17,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-18 19:53:17,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-18 19:53:17,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-18 19:53:17,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-18 19:53:17,336 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.5313429231318235E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.5313429231318235E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-18 19:53:17,336 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-09-18 19:53:17,337 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.377870949316785E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.5313429231318235E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.5313429231318235E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-09-18 19:53:17,586 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 345 ms to try 5000 different iterations.  Found a solution that moves 13 regions; Going from a computed imbalance of 2.377870949316785E-5 to a new imbalance of 7.16426724190874E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0014444444444444444); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-18 19:53:17,586 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1914610682:83 , srv447133502:83 , srv656638905:83 , srv780434536:83 , srv909334495:83 , srv100288100:84 , srv1008102785:84 , srv1033706440:84 , srv1043974624:84 , srv1049055338:84 , srv1121677374:84 , srv1131062491:84 , srv1177180627:84 , srv1195931851:84 , srv1254215429:84 , srv1286443325:84 , srv1293257499:84 , srv1308090995:84 , srv132742898:84 , srv1337344809:84 , srv136187377:84 , srv1368614139:84 , srv1408663209:84 , srv1415490107:84 , srv141762476:84 , srv1421696411:84 , srv1426321395:84 , srv1456142997:84 , srv1456538276:84 , srv1464119149:84 , srv1481504148:84 , srv1641155093:84 , srv1656692219:84 , srv1670486804:84 , srv1694965504:84 , srv1705941983:84 , srv1710197699:84 , srv1717376877:84 , srv1752992955:84 , srv1792443676:84 , srv1793787527:84 , srv1821554824:84 , srv1870590304:84 , srv1872901041:84 , srv1877451206:84 , srv1878281582:84 , srv1885528632:84 , srv194082593:84 , srv1952262174:84 , srv1995650387:84 , srv2051320027:84 , srv2055638400:84 , srv2057722664:84 , srv2077877879:84 , srv211068370:84 , srv2134971366:84 , srv238723032:84 , srv240876062:84 , srv243213138:84 , srv2535309:84 , srv276876995:84 , srv279141937:84 , srv305983192:84 , srv332486101:84 , srv339495484:84 , srv346002894:84 , srv420145146:84 , srv434720766:84 , srv462621527:84 , srv464211357:84 , srv50123408:84 , srv512198158:84 , srv528460539:84 , srv579484870:84 , srv583953061:84 , srv625702098:84 , srv628732983:84 , srv653775113:84 , srv658403454:84 , srv661989059:84 , srv668122043:84 , srv678745144:84 , srv718160177:84 , srv768347006:84 , srv792803594:84 , srv867785629:84 , srv899657801:84 , srv908830767:84 , srv94721359:84 , srv964762139:84 , srv978152123:84 , srv980789729:84 , srv981110766:84 , srv982628966:84 , srv1774208500:85 , srv1934130423:85 , srv546150494:85 , srv720075072:85 , srv937359574:85 , srv250599122:684 }
2023-09-18 19:53:17,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-18 19:53:17,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1308090995=12, srv194082593=45, srv1049055338=4, srv1195931851=8, srv718160177=84, srv276876995=59, srv899657801=90, srv250599122=57, srv462621527=68, srv50123408=70, srv656638905=79, srv2051320027=48, srv1821554824=37, srv982628966=99, srv1774208500=34, srv2535309=58, srv1885528632=42, srv978152123=96, srv1421696411=20, srv132742898=13, srv2077877879=51, srv2134971366=53, srv909334495=92, srv628732983=77, srv1878281582=41, srv1337344809=14, srv964762139=95, srv1464119149=24, srv980789729=97, srv1293257499=11, srv1717376877=32, srv211068370=52, srv579484870=74, srv1792443676=35, srv1415490107=18, srv528460539=72, srv1995650387=47, srv867785629=89, srv1033706440=2, srv1705941983=30, srv238723032=54, srv100288100=0, srv332486101=62, srv1131062491=6, srv1694965504=29, srv908830767=91, srv1670486804=28, srv136187377=15, srv625702098=76, srv240876062=55, srv1952262174=46, srv720075072=85, srv447133502=67, srv1641155093=26, srv668122043=82, srv305983192=61, srv420145146=65, srv1177180627=7, srv1914610682=43, srv141762476=19, srv1656692219=27, srv1121677374=5, srv1456142997=22, srv512198158=71, srv434720766=66, srv464211357=69, srv2057722664=50, srv1368614139=16, srv1286443325=10, srv2055638400=49, srv1872901041=39, srv1043974624=3, srv1934130423=44, srv1481504148=25, srv1752992955=33, srv279141937=60, srv653775113=78, srv678745144=83, srv661989059=81, srv243213138=56, srv1008102785=1, srv1254215429=9, srv1793787527=36, srv1877451206=40, srv339495484=63, srv658403454=80, srv583953061=75, srv1710197699=31, srv94721359=94, srv1408663209=17, srv346002894=64, srv1456538276=23, srv768347006=86, srv546150494=73, srv792803594=88, srv981110766=98, srv780434536=87, srv1426321395=21, srv937359574=93, srv1870590304=38} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-18 19:53:17,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-18 19:53:17,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-18 19:53:17,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-18 19:53:17,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-18 19:53:17,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-18 19:53:17,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-18 19:53:17,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-18 19:53:17,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-18 19:53:17,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-18 19:53:17,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-18 19:53:17,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-18 19:53:17,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-18 19:53:17,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-18 19:53:17,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-18 19:53:17,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-18 19:53:17,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-18 19:53:17,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-18 19:53:17,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-18 19:53:17,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-18 19:53:17,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-18 19:53:17,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-18 19:53:17,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-18 19:53:17,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-18 19:53:17,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-18 19:53:17,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-18 19:53:17,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-18 19:53:17,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-18 19:53:17,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-18 19:53:17,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-18 19:53:17,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-18 19:53:17,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-18 19:53:17,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-18 19:53:17,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-18 19:53:17,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-18 19:53:17,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-18 19:53:17,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-18 19:53:17,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-18 19:53:17,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-18 19:53:17,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-18 19:53:17,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-18 19:53:17,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-18 19:53:17,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-18 19:53:17,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-18 19:53:17,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-18 19:53:17,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-18 19:53:17,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-18 19:53:17,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-18 19:53:17,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-18 19:53:17,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-18 19:53:17,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-18 19:53:17,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-18 19:53:17,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-18 19:53:17,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-18 19:53:17,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-18 19:53:17,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-18 19:53:17,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-18 19:53:17,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-18 19:53:17,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-18 19:53:17,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-18 19:53:17,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-18 19:53:17,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-18 19:53:17,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-18 19:53:17,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-18 19:53:17,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-18 19:53:17,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-18 19:53:17,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-18 19:53:17,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-18 19:53:17,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-18 19:53:17,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-18 19:53:17,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-18 19:53:17,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-18 19:53:17,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-18 19:53:17,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-18 19:53:17,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-18 19:53:17,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-18 19:53:17,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-18 19:53:17,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-18 19:53:17,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-18 19:53:17,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-18 19:53:17,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-18 19:53:17,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-18 19:53:17,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-18 19:53:17,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-18 19:53:17,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-18 19:53:17,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-18 19:53:17,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-18 19:53:17,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-18 19:53:17,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-18 19:53:17,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-18 19:53:17,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-18 19:53:17,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-18 19:53:17,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-18 19:53:17,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-18 19:53:17,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-18 19:53:17,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-18 19:53:17,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-18 19:53:17,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-18 19:53:17,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-18 19:53:17,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-18 19:53:17,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-18 19:53:17,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-18 19:53:17,714 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.073239296329447E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-18 19:53:17,715 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1914610682:83 , srv447133502:83 , srv656638905:83 , srv780434536:83 , srv909334495:83 , srv100288100:84 , srv1008102785:84 , srv1033706440:84 , srv1043974624:84 , srv1049055338:84 , srv1121677374:84 , srv1131062491:84 , srv1177180627:84 , srv1195931851:84 , srv1254215429:84 , srv1286443325:84 , srv1293257499:84 , srv1308090995:84 , srv132742898:84 , srv1337344809:84 , srv136187377:84 , srv1368614139:84 , srv1408663209:84 , srv1415490107:84 , srv141762476:84 , srv1421696411:84 , srv1426321395:84 , srv1456142997:84 , srv1456538276:84 , srv1464119149:84 , srv1481504148:84 , srv1641155093:84 , srv1656692219:84 , srv1670486804:84 , srv1694965504:84 , srv1705941983:84 , srv1710197699:84 , srv1717376877:84 , srv1752992955:84 , srv1792443676:84 , srv1793787527:84 , srv1821554824:84 , srv1870590304:84 , srv1872901041:84 , srv1877451206:84 , srv1878281582:84 , srv1885528632:84 , srv194082593:84 , srv1952262174:84 , srv1995650387:84 , srv2051320027:84 , srv2055638400:84 , srv2057722664:84 , srv2077877879:84 , srv211068370:84 , srv2134971366:84 , srv238723032:84 , srv240876062:84 , srv243213138:84 , srv2535309:84 , srv276876995:84 , srv279141937:84 , srv305983192:84 , srv332486101:84 , srv339495484:84 , srv346002894:84 , srv420145146:84 , srv434720766:84 , srv462621527:84 , srv464211357:84 , srv50123408:84 , srv512198158:84 , srv528460539:84 , srv579484870:84 , srv583953061:84 , srv625702098:84 , srv628732983:84 , srv653775113:84 , srv658403454:84 , srv661989059:84 , srv668122043:84 , srv678745144:84 , srv718160177:84 , srv768347006:84 , srv792803594:84 , srv867785629:84 , srv899657801:84 , srv908830767:84 , srv94721359:84 , srv964762139:84 , srv978152123:84 , srv980789729:84 , srv981110766:84 , srv982628966:84 , srv1774208500:85 , srv1934130423:85 , srv546150494:85 , srv720075072:85 , srv937359574:85 , srv250599122:684 }
2023-09-18 19:53:17,738 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=310 (was 311), ProcessCount=169 (was 169), AvailableMemoryMB=10245 (was 10886)
2023-09-18 19:53:17,746 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=310, ProcessCount=169, AvailableMemoryMB=10244
2023-09-18 19:53:17,747 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-09-18 19:53:17,747 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-09-18 19:53:17,755 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1039372482:84 , srv1070552757:84 , srv1204196881:84 , srv1292909563:84 , srv1398949126:84 , srv1523872401:84 , srv1547224791:84 , srv1595142477:84 , srv159541816:84 , srv1704345350:84 , srv1712657168:84 , srv1900039627:84 , srv23611506:84 , srv246577572:84 , srv281241247:84 , srv290257489:84 , srv292487580:84 , srv29365158:84 , srv310317762:84 , srv347388936:84 , srv400397990:84 , srv464989381:84 , srv531285283:84 , srv547959299:84 , srv595448853:84 , srv671415839:84 , srv722428737:84 , srv851585796:84 , srv922056424:84 , srv447819261:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-09-18 19:53:17,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-18 19:53:17,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1547224791=6, srv246577572=13, srv1595142477=7, srv1712657168=10, srv310317762=18, srv1292909563=3, srv531285283=23, srv281241247=14, srv464989381=22, srv547959299=24, srv290257489=15, srv1039372482=0, srv447819261=21, srv671415839=26, srv851585796=28, srv1204196881=2, srv23611506=12, srv1398949126=4, srv347388936=19, srv1704345350=9, srv1900039627=11, srv292487580=16, srv400397990=20, srv1070552757=1, srv29365158=17, srv595448853=25, srv159541816=8, srv1523872401=5, srv722428737=27, srv922056424=29} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-18 19:53:17,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-18 19:53:17,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-18 19:53:17,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-18 19:53:17,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-18 19:53:17,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-18 19:53:17,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-18 19:53:17,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-18 19:53:17,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-18 19:53:17,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-18 19:53:17,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-18 19:53:17,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-18 19:53:17,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-18 19:53:17,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-18 19:53:17,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-18 19:53:17,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-18 19:53:17,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-18 19:53:17,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-18 19:53:17,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-18 19:53:17,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-18 19:53:17,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-18 19:53:17,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-18 19:53:17,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-18 19:53:17,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-18 19:53:17,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-18 19:53:17,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-18 19:53:17,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-18 19:53:17,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-18 19:53:17,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-18 19:53:17,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-18 19:53:17,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-18 19:53:17,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-09-18 19:53:17,780 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1029607682528249, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-18 19:53:17,781 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912517469283066, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1029607682528249, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-09-18 19:55:17,768 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5612794 different iterations.  Found a solution that moves 1860 regions; Going from a computed imbalance of 0.9912517469283066 to a new imbalance of 4.341332789166274E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6888888888888889, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-18 19:55:17,774 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1039372482:90 , srv1070552757:90 , srv1204196881:90 , srv1292909563:90 , srv1398949126:90 , srv1523872401:90 , srv1547224791:90 , srv1595142477:90 , srv159541816:90 , srv1704345350:90 , srv1712657168:90 , srv1900039627:90 , srv23611506:90 , srv246577572:90 , srv281241247:90 , srv290257489:90 , srv292487580:90 , srv29365158:90 , srv310317762:90 , srv347388936:90 , srv400397990:90 , srv447819261:90 , srv464989381:90 , srv531285283:90 , srv547959299:90 , srv595448853:90 , srv671415839:90 , srv722428737:90 , srv851585796:90 , srv922056424:90 }
2023-09-18 19:55:17,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-18 19:55:17,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1547224791=6, srv246577572=13, srv1595142477=7, srv1712657168=10, srv310317762=18, srv1292909563=3, srv531285283=23, srv281241247=14, srv464989381=22, srv547959299=24, srv290257489=15, srv1039372482=0, srv447819261=21, srv671415839=26, srv851585796=28, srv1204196881=2, srv23611506=12, srv1398949126=4, srv347388936=19, srv1704345350=9, srv1900039627=11, srv292487580=16, srv400397990=20, srv1070552757=1, srv29365158=17, srv595448853=25, srv159541816=8, srv1523872401=5, srv722428737=27, srv922056424=29} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-18 19:55:17,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-18 19:55:17,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-18 19:55:17,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-18 19:55:17,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-18 19:55:17,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-18 19:55:17,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-18 19:55:17,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-18 19:55:17,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-18 19:55:17,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-18 19:55:17,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-18 19:55:17,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-18 19:55:17,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-18 19:55:17,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-18 19:55:17,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-18 19:55:17,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-18 19:55:17,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-18 19:55:17,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-18 19:55:17,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-18 19:55:17,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-18 19:55:17,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-18 19:55:17,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-18 19:55:17,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-18 19:55:17,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-18 19:55:17,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-18 19:55:17,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-18 19:55:17,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-18 19:55:17,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-18 19:55:17,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-18 19:55:17,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-18 19:55:17,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-18 19:55:17,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-09-18 19:55:17,791 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-18 19:55:17,791 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1039372482:90 , srv1070552757:90 , srv1204196881:90 , srv1292909563:90 , srv1398949126:90 , srv1523872401:90 , srv1547224791:90 , srv1595142477:90 , srv159541816:90 , srv1704345350:90 , srv1712657168:90 , srv1900039627:90 , srv23611506:90 , srv246577572:90 , srv281241247:90 , srv290257489:90 , srv292487580:90 , srv29365158:90 , srv310317762:90 , srv347388936:90 , srv400397990:90 , srv447819261:90 , srv464989381:90 , srv531285283:90 , srv547959299:90 , srv595448853:90 , srv671415839:90 , srv722428737:90 , srv851585796:90 , srv922056424:90 }
2023-09-18 19:55:17,803 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=138 (was 310), ProcessCount=169 (was 169), AvailableMemoryMB=9348 (was 10244)