2023-09-23 05:53:13,206 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-09-23 05:53:13,548 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-09-23 05:53:13,665 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-09-23 05:53:13,729 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-09-23 05:53:13,736 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-09-23 05:53:13,750 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=325, ProcessCount=170, AvailableMemoryMB=3292
2023-09-23 05:53:13,752 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-09-23 05:53:13,753 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-09-23 05:53:13,906 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv103980463:84 , srv1043885898:84 , srv1051569696:84 , srv1066984456:84 , srv1102405850:84 , srv1182699340:84 , srv1189223987:84 , srv1207641133:84 , srv1210463759:84 , srv1238962710:84 , srv1283045000:84 , srv1283503989:84 , srv1290700168:84 , srv1292734034:84 , srv1299223990:84 , srv1329219708:84 , srv1330294095:84 , srv1332856639:84 , srv1347302351:84 , srv1370635142:84 , srv140369526:84 , srv1435547785:84 , srv1461091807:84 , srv1465288054:84 , srv1489442649:84 , srv1498246698:84 , srv1502754745:84 , srv1534140615:84 , srv1556861653:84 , srv1582969735:84 , srv1634301176:84 , srv1644892301:84 , srv1689183322:84 , srv1789600656:84 , srv1805077735:84 , srv1855466108:84 , srv1865556270:84 , srv1934581448:84 , srv1936483286:84 , srv1943537649:84 , srv1956387196:84 , srv1970554901:84 , srv2012540629:84 , srv2050366584:84 , srv207744683:84 , srv2082079241:84 , srv2088174107:84 , srv2119056713:84 , srv2145930479:84 , srv219861549:84 , srv22965083:84 , srv24274648:84 , srv243821391:84 , srv257426239:84 , srv269628412:84 , srv274160077:84 , srv277914226:84 , srv303448810:84 , srv313431126:84 , srv325905368:84 , srv364209793:84 , srv37034632:84 , srv400971394:84 , srv411991455:84 , srv421069593:84 , srv436575832:84 , srv446681300:84 , srv494155908:84 , srv511007088:84 , srv519603119:84 , srv620060166:84 , srv625681232:84 , srv634777278:84 , srv663437787:84 , srv672208348:84 , srv673540838:84 , srv685342702:84 , srv691329089:84 , srv691433453:84 , srv69428530:84 , srv702652385:84 , srv729952072:84 , srv736999174:84 , srv744031524:84 , srv756704231:84 , srv782097105:84 , srv791457750:84 , srv793336630:84 , srv804907896:84 , srv82735223:84 , srv83251448:84 , srv842491755:84 , srv84440079:84 , srv854258989:84 , srv894350563:84 , srv895497627:84 , srv953465602:84 , srv964543162:84 , srv992702870:84 , srv62635313:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-09-23 05:53:13,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-23 05:53:13,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1043885898=1, srv663437787=74, srv744031524=84, srv1182699340=5, srv804907896=89, srv1283503989=11, srv1066984456=3, srv274160077=55, srv782097105=86, srv1865556270=36, srv634777278=73, srv793336630=88, srv673540838=76, srv82735223=90, srv1210463759=8, srv2082079241=45, srv1347302351=18, srv992702870=99, srv953465602=97, srv37034632=61, srv103980463=0, srv494155908=67, srv364209793=60, srv24274648=51, srv691433453=79, srv219861549=49, srv83251448=91, srv854258989=94, srv2088174107=46, srv421069593=64, srv1805077735=34, srv1283045000=10, srv1943537649=39, srv140369526=20, srv1498246698=25, srv436575832=65, srv69428530=80, srv842491755=92, srv756704231=85, srv325905368=59, srv2145930479=48, srv702652385=81, srv1502754745=26, srv257426239=53, srv1582969735=29, srv1332856639=17, srv1370635142=19, srv207744683=44, srv1489442649=24, srv620060166=70, srv691329089=78, srv729952072=82, srv411991455=63, srv1051569696=2, srv1644892301=31, srv736999174=83, srv1435547785=21, srv964543162=98, srv1189223987=6, srv1534140615=27, srv446681300=66, srv894350563=95, srv1956387196=40, srv685342702=77, srv791457750=87, srv303448810=57, srv277914226=56, srv1634301176=30, srv313431126=58, srv895497627=96, srv1936483286=38, srv511007088=68, srv62635313=72, srv1465288054=23, srv1329219708=15, srv1290700168=12, srv1292734034=13, srv625681232=71, srv1461091807=22, srv2012540629=42, srv1207641133=7, srv1689183322=32, srv243821391=52, srv400971394=62, srv1556861653=28, srv2119056713=47, srv2050366584=43, srv1102405850=4, srv1934581448=37, srv672208348=75, srv84440079=93, srv1238962710=9, srv269628412=54, srv1299223990=14, srv22965083=50, srv519603119=69, srv1330294095=16, srv1970554901=41, srv1789600656=33, srv1855466108=35} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-23 05:53:14,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-23 05:53:14,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-23 05:53:14,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-23 05:53:14,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-23 05:53:14,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-23 05:53:14,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-23 05:53:14,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-23 05:53:14,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-23 05:53:14,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-23 05:53:14,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-23 05:53:14,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-23 05:53:14,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-23 05:53:14,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-23 05:53:14,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-23 05:53:14,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-23 05:53:14,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-23 05:53:14,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-23 05:53:14,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-23 05:53:14,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-23 05:53:14,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-23 05:53:14,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-23 05:53:14,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-23 05:53:14,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-23 05:53:14,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-23 05:53:14,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-23 05:53:14,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-23 05:53:14,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-23 05:53:14,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-23 05:53:14,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-23 05:53:14,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-23 05:53:14,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-23 05:53:14,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-23 05:53:14,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-23 05:53:14,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-23 05:53:14,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-23 05:53:14,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-23 05:53:14,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-23 05:53:14,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-23 05:53:14,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-23 05:53:14,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-23 05:53:14,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-23 05:53:14,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-23 05:53:14,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-23 05:53:14,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-23 05:53:14,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-23 05:53:14,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-23 05:53:14,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-23 05:53:14,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-23 05:53:14,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-23 05:53:14,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-23 05:53:14,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-23 05:53:14,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-23 05:53:14,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-23 05:53:14,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-23 05:53:14,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-23 05:53:14,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-23 05:53:14,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-23 05:53:14,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-23 05:53:14,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-23 05:53:14,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-23 05:53:14,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-23 05:53:14,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-23 05:53:14,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-23 05:53:14,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-23 05:53:14,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-23 05:53:14,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-23 05:53:14,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-23 05:53:14,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-23 05:53:14,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-23 05:53:14,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-23 05:53:14,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-23 05:53:14,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-23 05:53:14,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-23 05:53:14,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-23 05:53:14,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-23 05:53:14,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-23 05:53:14,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-23 05:53:14,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-23 05:53:14,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-23 05:53:14,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-23 05:53:14,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-23 05:53:14,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-23 05:53:14,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-23 05:53:14,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-23 05:53:14,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-23 05:53:14,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-23 05:53:14,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-23 05:53:14,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-23 05:53:14,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-23 05:53:14,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-23 05:53:14,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-23 05:53:14,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-23 05:53:14,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-23 05:53:14,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-23 05:53:14,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-23 05:53:14,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-23 05:53:14,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-23 05:53:14,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-23 05:53:14,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-23 05:53:14,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-23 05:53:14,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-23 05:53:14,259 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-23 05:53:14,260 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-09-23 05:53:14,260 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-09-23 05:53:14,661 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 592 ms to try 5000 different iterations.  Found a solution that moves 4650 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18532172352401935. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03771335366311602, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05570887933545756, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5166666666666667, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03771335366311602, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.18083333333333335, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.245, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-23 05:53:14,682 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv2119056713:81 , srv691433453:81 , srv1207641133:82 , srv1238962710:82 , srv1534140615:82 , srv736999174:82 , srv1502754745:83 , srv37034632:83 , srv625681232:83 , srv744031524:83 , srv83251448:83 , srv964543162:83 , srv1182699340:84 , srv1689183322:84 , srv1936483286:84 , srv24274648:84 , srv274160077:84 , srv303448810:84 , srv494155908:84 , srv672208348:84 , srv854258989:84 , srv1066984456:85 , srv1210463759:85 , srv1283045000:85 , srv1370635142:85 , srv1956387196:85 , srv22965083:85 , srv663437787:85 , srv702652385:85 , srv842491755:85 , srv1043885898:86 , srv1102405850:86 , srv1332856639:86 , srv1461091807:86 , srv1465288054:86 , srv1498246698:86 , srv1582969735:86 , srv2050366584:86 , srv207744683:86 , srv219861549:86 , srv257426239:86 , srv313431126:86 , srv325905368:86 , srv446681300:86 , srv756704231:86 , srv895497627:86 , srv953465602:86 , srv1051569696:87 , srv1189223987:87 , srv1283503989:87 , srv1290700168:87 , srv1292734034:87 , srv1299223990:87 , srv1329219708:87 , srv1435547785:87 , srv1855466108:87 , srv1934581448:87 , srv1970554901:87 , srv2012540629:87 , srv2082079241:87 , srv2088174107:87 , srv269628412:87 , srv421069593:87 , srv691329089:87 , srv782097105:87 , srv791457750:87 , srv804907896:87 , srv82735223:87 , srv992702870:87 , srv140369526:88 , srv1789600656:88 , srv2145930479:88 , srv436575832:88 , srv634777278:88 , srv673540838:88 , srv685342702:88 , srv793336630:88 , srv1347302351:89 , srv1556861653:89 , srv1644892301:89 , srv1943537649:89 , srv277914226:89 , srv400971394:89 , srv411991455:89 , srv519603119:89 , srv729952072:89 , srv894350563:89 , srv103980463:90 , srv1634301176:90 , srv1805077735:90 , srv1865556270:90 , srv243821391:90 , srv84440079:90 , srv1330294095:91 , srv69428530:91 , srv620060166:92 , srv1489442649:93 , srv364209793:94 , srv511007088:95 , srv62635313:425 }
2023-09-23 05:53:14,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-23 05:53:14,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1043885898=1, srv663437787=74, srv744031524=84, srv1182699340=5, srv804907896=89, srv1283503989=11, srv1066984456=3, srv274160077=55, srv782097105=86, srv1865556270=36, srv634777278=73, srv793336630=88, srv673540838=76, srv82735223=90, srv1210463759=8, srv2082079241=45, srv1347302351=18, srv992702870=99, srv953465602=97, srv37034632=61, srv103980463=0, srv494155908=67, srv364209793=60, srv24274648=51, srv691433453=79, srv219861549=49, srv83251448=91, srv854258989=94, srv2088174107=46, srv421069593=64, srv1805077735=34, srv1283045000=10, srv1943537649=39, srv140369526=20, srv1498246698=25, srv436575832=65, srv69428530=80, srv842491755=92, srv756704231=85, srv325905368=59, srv2145930479=48, srv702652385=81, srv1502754745=26, srv257426239=53, srv1582969735=29, srv1332856639=17, srv1370635142=19, srv207744683=44, srv1489442649=24, srv620060166=70, srv691329089=78, srv729952072=82, srv411991455=63, srv1051569696=2, srv1644892301=31, srv736999174=83, srv1435547785=21, srv964543162=98, srv1189223987=6, srv1534140615=27, srv446681300=66, srv894350563=95, srv1956387196=40, srv685342702=77, srv791457750=87, srv303448810=57, srv277914226=56, srv1634301176=30, srv313431126=58, srv895497627=96, srv1936483286=38, srv511007088=68, srv62635313=72, srv1465288054=23, srv1329219708=15, srv1290700168=12, srv1292734034=13, srv625681232=71, srv1461091807=22, srv2012540629=42, srv1207641133=7, srv1689183322=32, srv243821391=52, srv400971394=62, srv1556861653=28, srv2119056713=47, srv2050366584=43, srv1102405850=4, srv1934581448=37, srv672208348=75, srv84440079=93, srv1238962710=9, srv269628412=54, srv1299223990=14, srv22965083=50, srv519603119=69, srv1330294095=16, srv1970554901=41, srv1789600656=33, srv1855466108=35} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-23 05:53:14,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-23 05:53:14,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-23 05:53:14,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-23 05:53:14,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-23 05:53:14,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-23 05:53:14,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-23 05:53:14,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-23 05:53:14,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-23 05:53:14,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-23 05:53:14,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-23 05:53:14,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-23 05:53:14,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-23 05:53:14,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-23 05:53:14,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-23 05:53:14,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-23 05:53:14,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-23 05:53:14,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-23 05:53:14,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-23 05:53:14,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-23 05:53:14,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-23 05:53:14,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-23 05:53:14,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-23 05:53:14,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-23 05:53:14,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-23 05:53:14,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-23 05:53:14,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-23 05:53:14,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-23 05:53:14,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-23 05:53:14,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-23 05:53:14,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-23 05:53:14,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-23 05:53:14,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-23 05:53:14,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-23 05:53:14,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-23 05:53:14,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-23 05:53:14,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-23 05:53:14,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-23 05:53:14,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-23 05:53:14,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-23 05:53:14,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-23 05:53:14,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-23 05:53:14,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-23 05:53:14,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-23 05:53:14,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-23 05:53:14,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-23 05:53:14,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-23 05:53:14,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-23 05:53:14,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-23 05:53:14,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-23 05:53:14,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-23 05:53:14,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-23 05:53:14,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-23 05:53:14,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-23 05:53:14,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-23 05:53:14,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-23 05:53:14,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-23 05:53:14,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-23 05:53:14,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-23 05:53:14,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-23 05:53:14,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-23 05:53:14,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-23 05:53:14,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-23 05:53:14,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-23 05:53:14,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-23 05:53:14,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-23 05:53:14,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-23 05:53:14,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-23 05:53:14,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-23 05:53:14,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-23 05:53:14,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-23 05:53:14,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-23 05:53:14,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-23 05:53:14,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-23 05:53:14,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-23 05:53:14,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-23 05:53:14,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-23 05:53:14,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-23 05:53:14,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-23 05:53:14,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-23 05:53:14,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-23 05:53:14,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-23 05:53:14,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-23 05:53:14,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-23 05:53:14,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-23 05:53:14,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-23 05:53:14,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-23 05:53:14,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-23 05:53:14,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-23 05:53:14,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-23 05:53:14,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-23 05:53:14,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-23 05:53:14,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-23 05:53:14,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-23 05:53:14,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-23 05:53:14,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-23 05:53:14,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-23 05:53:14,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-23 05:53:14,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-23 05:53:14,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-23 05:53:14,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-23 05:53:14,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-23 05:53:14,845 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03771335366311602, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05570887933545756, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03771335366311602, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.18083333333333335, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.245, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-23 05:53:14,845 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-09-23 05:53:14,845 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18528916352810063, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03771335366311602, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05570887933545756, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03771335366311602, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.18083333333333335, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.245, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-09-23 05:53:15,201 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 464 ms to try 5000 different iterations.  Found a solution that moves 2666 regions; Going from a computed imbalance of 0.18528916352810063 to a new imbalance of 0.016050055590179253. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021269709652387003); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03367834914151624, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2962222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021269709652387003); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013083333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04441666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-23 05:53:15,215 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1489442649:78 , srv511007088:78 , srv103980463:80 , srv1330294095:80 , srv1943537649:81 , srv519603119:81 , srv69428530:81 , srv1644892301:82 , srv364209793:82 , srv620060166:82 , srv793336630:82 , srv1299223990:83 , srv1347302351:83 , srv1789600656:83 , srv1805077735:83 , srv400971394:83 , srv436575832:83 , srv446681300:83 , srv673540838:83 , srv685342702:83 , srv729952072:83 , srv84440079:83 , srv894350563:83 , srv1043885898:84 , srv1435547785:84 , srv1556861653:84 , srv1634301176:84 , srv1865556270:84 , srv243821391:84 , srv277914226:84 , srv421069593:84 , srv82735223:84 , srv992702870:84 , srv1290700168:85 , srv1292734034:85 , srv140369526:85 , srv1461091807:85 , srv1465288054:85 , srv1498246698:85 , srv1970554901:85 , srv2012540629:85 , srv207744683:85 , srv2088174107:85 , srv269628412:85 , srv313431126:85 , srv411991455:85 , srv691329089:85 , srv782097105:85 , srv1051569696:86 , srv1066984456:86 , srv1102405850:86 , srv1283045000:86 , srv1283503989:86 , srv1855466108:86 , srv2050366584:86 , srv219861549:86 , srv257426239:86 , srv325905368:86 , srv494155908:86 , srv634777278:86 , srv702652385:86 , srv756704231:86 , srv791457750:86 , srv895497627:86 , srv953465602:86 , srv1332856639:87 , srv1370635142:87 , srv2082079241:87 , srv2145930479:87 , srv22965083:87 , srv625681232:87 , srv804907896:87 , srv842491755:87 , srv854258989:87 , srv964543162:87 , srv1182699340:88 , srv1329219708:88 , srv1934581448:88 , srv1936483286:88 , srv1956387196:88 , srv303448810:88 , srv672208348:88 , srv83251448:88 , srv1189223987:89 , srv1210463759:89 , srv1502754745:89 , srv1534140615:89 , srv1582969735:89 , srv1689183322:89 , srv24274648:89 , srv274160077:89 , srv37034632:89 , srv663437787:89 , srv691433453:89 , srv736999174:89 , srv744031524:89 , srv1238962710:90 , srv2119056713:90 , srv1207641133:91 , srv62635313:538 }
2023-09-23 05:53:15,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-23 05:53:15,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1043885898=1, srv663437787=74, srv744031524=84, srv1182699340=5, srv804907896=89, srv1283503989=11, srv1066984456=3, srv274160077=55, srv782097105=86, srv1865556270=36, srv634777278=73, srv793336630=88, srv673540838=76, srv82735223=90, srv1210463759=8, srv2082079241=45, srv1347302351=18, srv992702870=99, srv953465602=97, srv37034632=61, srv103980463=0, srv494155908=67, srv364209793=60, srv24274648=51, srv691433453=79, srv219861549=49, srv83251448=91, srv854258989=94, srv2088174107=46, srv421069593=64, srv1805077735=34, srv1283045000=10, srv1943537649=39, srv140369526=20, srv1498246698=25, srv436575832=65, srv69428530=80, srv842491755=92, srv756704231=85, srv325905368=59, srv2145930479=48, srv702652385=81, srv1502754745=26, srv257426239=53, srv1582969735=29, srv1332856639=17, srv1370635142=19, srv207744683=44, srv1489442649=24, srv620060166=70, srv691329089=78, srv729952072=82, srv411991455=63, srv1051569696=2, srv1644892301=31, srv736999174=83, srv1435547785=21, srv964543162=98, srv1189223987=6, srv1534140615=27, srv446681300=66, srv894350563=95, srv1956387196=40, srv685342702=77, srv791457750=87, srv303448810=57, srv277914226=56, srv1634301176=30, srv313431126=58, srv895497627=96, srv1936483286=38, srv511007088=68, srv62635313=72, srv1465288054=23, srv1329219708=15, srv1290700168=12, srv1292734034=13, srv625681232=71, srv1461091807=22, srv2012540629=42, srv1207641133=7, srv1689183322=32, srv243821391=52, srv400971394=62, srv1556861653=28, srv2119056713=47, srv2050366584=43, srv1102405850=4, srv1934581448=37, srv672208348=75, srv84440079=93, srv1238962710=9, srv269628412=54, srv1299223990=14, srv22965083=50, srv519603119=69, srv1330294095=16, srv1970554901=41, srv1789600656=33, srv1855466108=35} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-23 05:53:15,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-23 05:53:15,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-23 05:53:15,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-23 05:53:15,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-23 05:53:15,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-23 05:53:15,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-23 05:53:15,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-23 05:53:15,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-23 05:53:15,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-23 05:53:15,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-23 05:53:15,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-23 05:53:15,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-23 05:53:15,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-23 05:53:15,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-23 05:53:15,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-23 05:53:15,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-23 05:53:15,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-23 05:53:15,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-23 05:53:15,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-23 05:53:15,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-23 05:53:15,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-23 05:53:15,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-23 05:53:15,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-23 05:53:15,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-23 05:53:15,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-23 05:53:15,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-23 05:53:15,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-23 05:53:15,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-23 05:53:15,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-23 05:53:15,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-23 05:53:15,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-23 05:53:15,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-23 05:53:15,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-23 05:53:15,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-23 05:53:15,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-23 05:53:15,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-23 05:53:15,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-23 05:53:15,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-23 05:53:15,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-23 05:53:15,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-23 05:53:15,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-23 05:53:15,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-23 05:53:15,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-23 05:53:15,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-23 05:53:15,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-23 05:53:15,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-23 05:53:15,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-23 05:53:15,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-23 05:53:15,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-23 05:53:15,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-23 05:53:15,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-23 05:53:15,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-23 05:53:15,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-23 05:53:15,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-23 05:53:15,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-23 05:53:15,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-23 05:53:15,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-23 05:53:15,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-23 05:53:15,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-23 05:53:15,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-23 05:53:15,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-23 05:53:15,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-23 05:53:15,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-23 05:53:15,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-23 05:53:15,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-23 05:53:15,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-23 05:53:15,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-23 05:53:15,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-23 05:53:15,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-23 05:53:15,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-23 05:53:15,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-23 05:53:15,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-23 05:53:15,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-23 05:53:15,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-23 05:53:15,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-23 05:53:15,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-23 05:53:15,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-23 05:53:15,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-23 05:53:15,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-23 05:53:15,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-23 05:53:15,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-23 05:53:15,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-23 05:53:15,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-23 05:53:15,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-23 05:53:15,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-23 05:53:15,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-23 05:53:15,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-23 05:53:15,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-23 05:53:15,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-23 05:53:15,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-23 05:53:15,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-23 05:53:15,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-23 05:53:15,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-23 05:53:15,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-23 05:53:15,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-23 05:53:15,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-23 05:53:15,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-23 05:53:15,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-23 05:53:15,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-23 05:53:15,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-23 05:53:15,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-23 05:53:15,427 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021269709652387003); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03367834914151624, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021269709652387003); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013083333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04441666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-23 05:53:15,427 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-09-23 05:53:15,427 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.016031387859185838, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021269709652387003); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03367834914151624, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021269709652387003); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013083333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04441666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-09-23 05:53:15,853 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 567 ms to try 5000 different iterations.  Found a solution that moves 943 regions; Going from a computed imbalance of 0.016031387859185838 to a new imbalance of 7.091879404890258E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006207534371868385); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00943998706461097); MoveCostFunction : (multiplier=7.0, imbalance=0.10477777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006207534371868385); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0045); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-23 05:53:15,856 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv364209793:81 , srv1189223987:82 , srv1865556270:82 , srv1934581448:82 , srv1329219708:83 , srv1582969735:83 , srv2145930479:83 , srv243821391:83 , srv634777278:83 , srv804907896:83 , srv1182699340:84 , srv1210463759:84 , srv1283503989:84 , srv140369526:84 , srv1634301176:84 , srv1855466108:84 , srv1956387196:84 , srv2082079241:84 , srv274160077:84 , srv411991455:84 , srv620060166:84 , srv663437787:84 , srv894350563:84 , srv1051569696:85 , srv1102405850:85 , srv1207641133:85 , srv1238962710:85 , srv1332856639:85 , srv1347302351:85 , srv1502754745:85 , srv1556861653:85 , srv1689183322:85 , srv1805077735:85 , srv2050366584:85 , srv219861549:85 , srv24274648:85 , srv277914226:85 , srv303448810:85 , srv325905368:85 , srv37034632:85 , srv400971394:85 , srv511007088:85 , srv672208348:85 , srv691329089:85 , srv69428530:85 , srv756704231:85 , srv782097105:85 , srv791457750:85 , srv84440079:85 , srv895497627:85 , srv1066984456:86 , srv1283045000:86 , srv1290700168:86 , srv1292734034:86 , srv1330294095:86 , srv1370635142:86 , srv1435547785:86 , srv1461091807:86 , srv1489442649:86 , srv1498246698:86 , srv1644892301:86 , srv1936483286:86 , srv1970554901:86 , srv2012540629:86 , srv2088174107:86 , srv2119056713:86 , srv22965083:86 , srv257426239:86 , srv269628412:86 , srv421069593:86 , srv436575832:86 , srv673540838:86 , srv702652385:86 , srv736999174:86 , srv744031524:86 , srv82735223:86 , srv83251448:86 , srv854258989:86 , srv953465602:86 , srv992702870:86 , srv1299223990:87 , srv1465288054:87 , srv1534140615:87 , srv1789600656:87 , srv1943537649:87 , srv207744683:87 , srv313431126:87 , srv519603119:87 , srv625681232:87 , srv685342702:87 , srv691433453:87 , srv729952072:87 , srv793336630:87 , srv842491755:87 , srv964543162:87 , srv103980463:88 , srv1043885898:88 , srv494155908:88 , srv446681300:89 , srv62635313:550 }
2023-09-23 05:53:15,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-23 05:53:15,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1043885898=1, srv663437787=74, srv744031524=84, srv1182699340=5, srv804907896=89, srv1283503989=11, srv1066984456=3, srv274160077=55, srv782097105=86, srv1865556270=36, srv634777278=73, srv793336630=88, srv673540838=76, srv82735223=90, srv1210463759=8, srv2082079241=45, srv1347302351=18, srv992702870=99, srv953465602=97, srv37034632=61, srv103980463=0, srv494155908=67, srv364209793=60, srv24274648=51, srv691433453=79, srv219861549=49, srv83251448=91, srv854258989=94, srv2088174107=46, srv421069593=64, srv1805077735=34, srv1283045000=10, srv1943537649=39, srv140369526=20, srv1498246698=25, srv436575832=65, srv69428530=80, srv842491755=92, srv756704231=85, srv325905368=59, srv2145930479=48, srv702652385=81, srv1502754745=26, srv257426239=53, srv1582969735=29, srv1332856639=17, srv1370635142=19, srv207744683=44, srv1489442649=24, srv620060166=70, srv691329089=78, srv729952072=82, srv411991455=63, srv1051569696=2, srv1644892301=31, srv736999174=83, srv1435547785=21, srv964543162=98, srv1189223987=6, srv1534140615=27, srv446681300=66, srv894350563=95, srv1956387196=40, srv685342702=77, srv791457750=87, srv303448810=57, srv277914226=56, srv1634301176=30, srv313431126=58, srv895497627=96, srv1936483286=38, srv511007088=68, srv62635313=72, srv1465288054=23, srv1329219708=15, srv1290700168=12, srv1292734034=13, srv625681232=71, srv1461091807=22, srv2012540629=42, srv1207641133=7, srv1689183322=32, srv243821391=52, srv400971394=62, srv1556861653=28, srv2119056713=47, srv2050366584=43, srv1102405850=4, srv1934581448=37, srv672208348=75, srv84440079=93, srv1238962710=9, srv269628412=54, srv1299223990=14, srv22965083=50, srv519603119=69, srv1330294095=16, srv1970554901=41, srv1789600656=33, srv1855466108=35} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-23 05:53:15,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-23 05:53:15,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-23 05:53:15,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-23 05:53:15,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-23 05:53:15,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-23 05:53:15,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-23 05:53:15,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-23 05:53:15,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-23 05:53:15,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-23 05:53:15,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-23 05:53:15,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-23 05:53:15,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-23 05:53:15,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-23 05:53:15,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-23 05:53:15,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-23 05:53:15,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-23 05:53:15,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-23 05:53:15,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-23 05:53:15,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-23 05:53:15,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-23 05:53:15,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-23 05:53:15,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-23 05:53:15,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-23 05:53:15,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-23 05:53:15,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-23 05:53:15,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-23 05:53:15,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-23 05:53:15,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-23 05:53:15,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-23 05:53:15,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-23 05:53:15,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-23 05:53:15,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-23 05:53:15,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-23 05:53:15,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-23 05:53:15,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-23 05:53:15,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-23 05:53:15,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-23 05:53:15,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-23 05:53:15,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-23 05:53:15,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-23 05:53:15,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-23 05:53:15,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-23 05:53:15,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-23 05:53:15,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-23 05:53:15,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-23 05:53:15,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-23 05:53:15,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-23 05:53:15,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-23 05:53:15,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-23 05:53:15,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-23 05:53:15,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-23 05:53:15,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-23 05:53:15,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-23 05:53:15,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-23 05:53:15,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-23 05:53:15,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-23 05:53:15,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-23 05:53:15,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-23 05:53:15,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-23 05:53:15,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-23 05:53:15,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-23 05:53:15,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-23 05:53:15,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-23 05:53:15,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-23 05:53:15,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-23 05:53:15,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-23 05:53:15,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-23 05:53:15,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-23 05:53:15,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-23 05:53:15,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-23 05:53:15,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-23 05:53:15,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-23 05:53:15,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-23 05:53:15,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-23 05:53:15,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-23 05:53:15,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-23 05:53:15,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-23 05:53:15,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-23 05:53:15,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-23 05:53:15,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-23 05:53:15,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-23 05:53:15,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-23 05:53:15,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-23 05:53:15,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-23 05:53:15,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-23 05:53:15,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-23 05:53:15,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-23 05:53:15,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-23 05:53:15,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-23 05:53:15,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-23 05:53:15,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-23 05:53:15,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-23 05:53:15,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-23 05:53:15,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-23 05:53:15,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-23 05:53:15,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-23 05:53:15,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-23 05:53:15,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-23 05:53:15,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-23 05:53:15,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-23 05:53:15,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-23 05:53:16,010 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006207534371868385); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00943998706461097); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006207534371868385); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0045); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-23 05:53:16,011 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-09-23 05:53:16,011 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=7.025849133596971E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006207534371868385); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00943998706461097); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006207534371868385); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0045); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-09-23 05:53:16,424 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 534 ms to try 5000 different iterations.  Found a solution that moves 247 regions; Going from a computed imbalance of 7.025849133596971E-4 to a new imbalance of 3.675208557552501E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.694119368783758E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0021711298242630987); MoveCostFunction : (multiplier=7.0, imbalance=0.027444444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.694119368783758E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-23 05:53:16,425 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv103980463:83 , srv1689183322:83 , srv207744683:83 , srv511007088:83 , srv842491755:83 , srv1043885898:84 , srv1102405850:84 , srv1207641133:84 , srv1210463759:84 , srv1238962710:84 , srv1290700168:84 , srv1292734034:84 , srv1330294095:84 , srv1332856639:84 , srv1370635142:84 , srv1465288054:84 , srv1489442649:84 , srv1534140615:84 , srv1582969735:84 , srv1634301176:84 , srv1789600656:84 , srv1805077735:84 , srv1936483286:84 , srv1956387196:84 , srv1970554901:84 , srv2012540629:84 , srv2082079241:84 , srv2145930479:84 , srv22965083:84 , srv24274648:84 , srv257426239:84 , srv269628412:84 , srv277914226:84 , srv411991455:84 , srv494155908:84 , srv519603119:84 , srv620060166:84 , srv663437787:84 , srv672208348:84 , srv685342702:84 , srv729952072:84 , srv744031524:84 , srv791457750:84 , srv793336630:84 , srv953465602:84 , srv1051569696:85 , srv1066984456:85 , srv1189223987:85 , srv1283045000:85 , srv1283503989:85 , srv1299223990:85 , srv1329219708:85 , srv140369526:85 , srv1435547785:85 , srv1461091807:85 , srv1498246698:85 , srv1502754745:85 , srv1556861653:85 , srv1644892301:85 , srv1855466108:85 , srv1934581448:85 , srv1943537649:85 , srv2050366584:85 , srv2088174107:85 , srv2119056713:85 , srv219861549:85 , srv243821391:85 , srv274160077:85 , srv303448810:85 , srv313431126:85 , srv325905368:85 , srv364209793:85 , srv37034632:85 , srv421069593:85 , srv436575832:85 , srv446681300:85 , srv625681232:85 , srv634777278:85 , srv673540838:85 , srv691329089:85 , srv691433453:85 , srv69428530:85 , srv702652385:85 , srv736999174:85 , srv756704231:85 , srv782097105:85 , srv83251448:85 , srv84440079:85 , srv854258989:85 , srv894350563:85 , srv895497627:85 , srv964543162:85 , srv992702870:85 , srv1182699340:86 , srv1347302351:86 , srv1865556270:86 , srv400971394:86 , srv804907896:86 , srv82735223:86 , srv62635313:629 }
2023-09-23 05:53:16,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-23 05:53:16,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1043885898=1, srv663437787=74, srv744031524=84, srv1182699340=5, srv804907896=89, srv1283503989=11, srv1066984456=3, srv274160077=55, srv782097105=86, srv1865556270=36, srv634777278=73, srv793336630=88, srv673540838=76, srv82735223=90, srv1210463759=8, srv2082079241=45, srv1347302351=18, srv992702870=99, srv953465602=97, srv37034632=61, srv103980463=0, srv494155908=67, srv364209793=60, srv24274648=51, srv691433453=79, srv219861549=49, srv83251448=91, srv854258989=94, srv2088174107=46, srv421069593=64, srv1805077735=34, srv1283045000=10, srv1943537649=39, srv140369526=20, srv1498246698=25, srv436575832=65, srv69428530=80, srv842491755=92, srv756704231=85, srv325905368=59, srv2145930479=48, srv702652385=81, srv1502754745=26, srv257426239=53, srv1582969735=29, srv1332856639=17, srv1370635142=19, srv207744683=44, srv1489442649=24, srv620060166=70, srv691329089=78, srv729952072=82, srv411991455=63, srv1051569696=2, srv1644892301=31, srv736999174=83, srv1435547785=21, srv964543162=98, srv1189223987=6, srv1534140615=27, srv446681300=66, srv894350563=95, srv1956387196=40, srv685342702=77, srv791457750=87, srv303448810=57, srv277914226=56, srv1634301176=30, srv313431126=58, srv895497627=96, srv1936483286=38, srv511007088=68, srv62635313=72, srv1465288054=23, srv1329219708=15, srv1290700168=12, srv1292734034=13, srv625681232=71, srv1461091807=22, srv2012540629=42, srv1207641133=7, srv1689183322=32, srv243821391=52, srv400971394=62, srv1556861653=28, srv2119056713=47, srv2050366584=43, srv1102405850=4, srv1934581448=37, srv672208348=75, srv84440079=93, srv1238962710=9, srv269628412=54, srv1299223990=14, srv22965083=50, srv519603119=69, srv1330294095=16, srv1970554901=41, srv1789600656=33, srv1855466108=35} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-23 05:53:16,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-23 05:53:16,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-23 05:53:16,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-23 05:53:16,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-23 05:53:16,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-23 05:53:16,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-23 05:53:16,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-23 05:53:16,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-23 05:53:16,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-23 05:53:16,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-23 05:53:16,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-23 05:53:16,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-23 05:53:16,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-23 05:53:16,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-23 05:53:16,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-23 05:53:16,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-23 05:53:16,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-23 05:53:16,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-23 05:53:16,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-23 05:53:16,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-23 05:53:16,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-23 05:53:16,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-23 05:53:16,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-23 05:53:16,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-23 05:53:16,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-23 05:53:16,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-23 05:53:16,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-23 05:53:16,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-23 05:53:16,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-23 05:53:16,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-23 05:53:16,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-23 05:53:16,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-23 05:53:16,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-23 05:53:16,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-23 05:53:16,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-23 05:53:16,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-23 05:53:16,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-23 05:53:16,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-23 05:53:16,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-23 05:53:16,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-23 05:53:16,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-23 05:53:16,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-23 05:53:16,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-23 05:53:16,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-23 05:53:16,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-23 05:53:16,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-23 05:53:16,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-23 05:53:16,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-23 05:53:16,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-23 05:53:16,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-23 05:53:16,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-23 05:53:16,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-23 05:53:16,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-23 05:53:16,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-23 05:53:16,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-23 05:53:16,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-23 05:53:16,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-23 05:53:16,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-23 05:53:16,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-23 05:53:16,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-23 05:53:16,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-23 05:53:16,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-23 05:53:16,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-23 05:53:16,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-23 05:53:16,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-23 05:53:16,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-23 05:53:16,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-23 05:53:16,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-23 05:53:16,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-23 05:53:16,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-23 05:53:16,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-23 05:53:16,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-23 05:53:16,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-23 05:53:16,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-23 05:53:16,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-23 05:53:16,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-23 05:53:16,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-23 05:53:16,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-23 05:53:16,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-23 05:53:16,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-23 05:53:16,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-23 05:53:16,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-23 05:53:16,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-23 05:53:16,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-23 05:53:16,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-23 05:53:16,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-23 05:53:16,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-23 05:53:16,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-23 05:53:16,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-23 05:53:16,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-23 05:53:16,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-23 05:53:16,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-23 05:53:16,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-23 05:53:16,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-23 05:53:16,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-23 05:53:16,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-23 05:53:16,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-23 05:53:16,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-23 05:53:16,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-23 05:53:16,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-23 05:53:16,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-23 05:53:16,549 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.694119368783758E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0021711298242630987); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.694119368783758E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-23 05:53:16,549 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-09-23 05:53:16,550 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=3.5022554609518444E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.694119368783758E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0021711298242630987); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.694119368783758E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-09-23 05:53:16,780 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 325 ms to try 5000 different iterations.  Found a solution that moves 39 regions; Going from a computed imbalance of 3.5022554609518444E-5 to a new imbalance of 8.252773953778466E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.004333333333333333); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-23 05:53:16,780 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1051569696:83 , srv1189223987:83 , srv1329219708:83 , srv1347302351:83 , srv1556861653:83 , srv2088174107:83 , srv313431126:83 , srv400971394:83 , srv446681300:83 , srv729952072:83 , srv804907896:83 , srv82735223:83 , srv84440079:83 , srv1043885898:84 , srv1066984456:84 , srv1182699340:84 , srv1207641133:84 , srv1210463759:84 , srv1283045000:84 , srv1283503989:84 , srv1290700168:84 , srv1292734034:84 , srv1299223990:84 , srv1332856639:84 , srv1370635142:84 , srv140369526:84 , srv1435547785:84 , srv1461091807:84 , srv1465288054:84 , srv1498246698:84 , srv1502754745:84 , srv1534140615:84 , srv1582969735:84 , srv1634301176:84 , srv1644892301:84 , srv1789600656:84 , srv1805077735:84 , srv1855466108:84 , srv1865556270:84 , srv1934581448:84 , srv1936483286:84 , srv1943537649:84 , srv1970554901:84 , srv2012540629:84 , srv2050366584:84 , srv2082079241:84 , srv2119056713:84 , srv2145930479:84 , srv219861549:84 , srv22965083:84 , srv24274648:84 , srv243821391:84 , srv257426239:84 , srv269628412:84 , srv274160077:84 , srv277914226:84 , srv303448810:84 , srv325905368:84 , srv364209793:84 , srv37034632:84 , srv411991455:84 , srv421069593:84 , srv436575832:84 , srv494155908:84 , srv620060166:84 , srv625681232:84 , srv634777278:84 , srv663437787:84 , srv673540838:84 , srv685342702:84 , srv691329089:84 , srv691433453:84 , srv69428530:84 , srv702652385:84 , srv736999174:84 , srv744031524:84 , srv756704231:84 , srv782097105:84 , srv791457750:84 , srv83251448:84 , srv842491755:84 , srv854258989:84 , srv895497627:84 , srv953465602:84 , srv964543162:84 , srv992702870:84 , srv103980463:85 , srv1102405850:85 , srv1238962710:85 , srv1330294095:85 , srv1489442649:85 , srv1689183322:85 , srv1956387196:85 , srv207744683:85 , srv511007088:85 , srv519603119:85 , srv672208348:85 , srv793336630:85 , srv894350563:85 , srv62635313:684 }
2023-09-23 05:53:16,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-23 05:53:16,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1043885898=1, srv663437787=74, srv744031524=84, srv1182699340=5, srv804907896=89, srv1283503989=11, srv1066984456=3, srv274160077=55, srv782097105=86, srv1865556270=36, srv634777278=73, srv793336630=88, srv673540838=76, srv82735223=90, srv1210463759=8, srv2082079241=45, srv1347302351=18, srv992702870=99, srv953465602=97, srv37034632=61, srv103980463=0, srv494155908=67, srv364209793=60, srv24274648=51, srv691433453=79, srv219861549=49, srv83251448=91, srv854258989=94, srv2088174107=46, srv421069593=64, srv1805077735=34, srv1283045000=10, srv1943537649=39, srv140369526=20, srv1498246698=25, srv436575832=65, srv69428530=80, srv842491755=92, srv756704231=85, srv325905368=59, srv2145930479=48, srv702652385=81, srv1502754745=26, srv257426239=53, srv1582969735=29, srv1332856639=17, srv1370635142=19, srv207744683=44, srv1489442649=24, srv620060166=70, srv691329089=78, srv729952072=82, srv411991455=63, srv1051569696=2, srv1644892301=31, srv736999174=83, srv1435547785=21, srv964543162=98, srv1189223987=6, srv1534140615=27, srv446681300=66, srv894350563=95, srv1956387196=40, srv685342702=77, srv791457750=87, srv303448810=57, srv277914226=56, srv1634301176=30, srv313431126=58, srv895497627=96, srv1936483286=38, srv511007088=68, srv62635313=72, srv1465288054=23, srv1329219708=15, srv1290700168=12, srv1292734034=13, srv625681232=71, srv1461091807=22, srv2012540629=42, srv1207641133=7, srv1689183322=32, srv243821391=52, srv400971394=62, srv1556861653=28, srv2119056713=47, srv2050366584=43, srv1102405850=4, srv1934581448=37, srv672208348=75, srv84440079=93, srv1238962710=9, srv269628412=54, srv1299223990=14, srv22965083=50, srv519603119=69, srv1330294095=16, srv1970554901=41, srv1789600656=33, srv1855466108=35} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-23 05:53:16,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-23 05:53:16,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-23 05:53:16,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-23 05:53:16,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-23 05:53:16,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-23 05:53:16,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-23 05:53:16,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-23 05:53:16,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-23 05:53:16,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-23 05:53:16,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-23 05:53:16,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-23 05:53:16,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-23 05:53:16,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-23 05:53:16,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-23 05:53:16,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-23 05:53:16,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-23 05:53:16,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-23 05:53:16,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-23 05:53:16,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-23 05:53:16,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-23 05:53:16,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-23 05:53:16,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-23 05:53:16,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-23 05:53:16,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-23 05:53:16,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-23 05:53:16,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-23 05:53:16,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-23 05:53:16,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-23 05:53:16,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-23 05:53:16,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-23 05:53:16,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-23 05:53:16,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-23 05:53:16,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-23 05:53:16,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-23 05:53:16,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-23 05:53:16,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-23 05:53:16,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-23 05:53:16,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-23 05:53:16,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-23 05:53:16,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-23 05:53:16,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-23 05:53:16,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-23 05:53:16,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-23 05:53:16,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-23 05:53:16,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-23 05:53:16,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-23 05:53:16,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-23 05:53:16,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-23 05:53:16,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-23 05:53:16,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-23 05:53:16,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-23 05:53:16,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-23 05:53:16,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-23 05:53:16,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-23 05:53:16,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-23 05:53:16,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-23 05:53:16,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-23 05:53:16,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-23 05:53:16,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-23 05:53:16,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-23 05:53:16,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-23 05:53:16,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-23 05:53:16,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-23 05:53:16,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-23 05:53:16,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-23 05:53:16,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-23 05:53:16,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-23 05:53:16,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-23 05:53:16,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-23 05:53:16,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-23 05:53:16,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-23 05:53:16,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-23 05:53:16,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-23 05:53:16,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-23 05:53:16,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-23 05:53:16,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-23 05:53:16,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-23 05:53:16,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-23 05:53:16,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-23 05:53:16,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-23 05:53:16,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-23 05:53:16,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-23 05:53:16,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-23 05:53:16,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-23 05:53:16,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-23 05:53:16,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-23 05:53:16,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-23 05:53:16,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-23 05:53:16,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-23 05:53:16,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-23 05:53:16,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-23 05:53:16,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-23 05:53:16,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-23 05:53:16,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-23 05:53:16,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-23 05:53:16,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-23 05:53:16,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-23 05:53:16,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-23 05:53:16,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-23 05:53:16,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-23 05:53:16,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-23 05:53:16,906 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.979690117040589E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-23 05:53:16,907 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1051569696:83 , srv1189223987:83 , srv1329219708:83 , srv1347302351:83 , srv1556861653:83 , srv2088174107:83 , srv313431126:83 , srv400971394:83 , srv446681300:83 , srv729952072:83 , srv804907896:83 , srv82735223:83 , srv84440079:83 , srv1043885898:84 , srv1066984456:84 , srv1182699340:84 , srv1207641133:84 , srv1210463759:84 , srv1283045000:84 , srv1283503989:84 , srv1290700168:84 , srv1292734034:84 , srv1299223990:84 , srv1332856639:84 , srv1370635142:84 , srv140369526:84 , srv1435547785:84 , srv1461091807:84 , srv1465288054:84 , srv1498246698:84 , srv1502754745:84 , srv1534140615:84 , srv1582969735:84 , srv1634301176:84 , srv1644892301:84 , srv1789600656:84 , srv1805077735:84 , srv1855466108:84 , srv1865556270:84 , srv1934581448:84 , srv1936483286:84 , srv1943537649:84 , srv1970554901:84 , srv2012540629:84 , srv2050366584:84 , srv2082079241:84 , srv2119056713:84 , srv2145930479:84 , srv219861549:84 , srv22965083:84 , srv24274648:84 , srv243821391:84 , srv257426239:84 , srv269628412:84 , srv274160077:84 , srv277914226:84 , srv303448810:84 , srv325905368:84 , srv364209793:84 , srv37034632:84 , srv411991455:84 , srv421069593:84 , srv436575832:84 , srv494155908:84 , srv620060166:84 , srv625681232:84 , srv634777278:84 , srv663437787:84 , srv673540838:84 , srv685342702:84 , srv691329089:84 , srv691433453:84 , srv69428530:84 , srv702652385:84 , srv736999174:84 , srv744031524:84 , srv756704231:84 , srv782097105:84 , srv791457750:84 , srv83251448:84 , srv842491755:84 , srv854258989:84 , srv895497627:84 , srv953465602:84 , srv964543162:84 , srv992702870:84 , srv103980463:85 , srv1102405850:85 , srv1238962710:85 , srv1330294095:85 , srv1489442649:85 , srv1689183322:85 , srv1956387196:85 , srv207744683:85 , srv511007088:85 , srv519603119:85 , srv672208348:85 , srv793336630:85 , srv894350563:85 , srv62635313:684 }
2023-09-23 05:53:16,931 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=325 (was 325), ProcessCount=170 (was 170), AvailableMemoryMB=2677 (was 3292)
2023-09-23 05:53:16,938 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=325, ProcessCount=170, AvailableMemoryMB=2677
2023-09-23 05:53:16,939 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-09-23 05:53:16,939 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-09-23 05:53:16,947 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv104290019:84 , srv1051643874:84 , srv107798792:84 , srv113055643:84 , srv1254710437:84 , srv132019720:84 , srv1425020035:84 , srv1477629756:84 , srv1523174717:84 , srv1575889857:84 , srv1624522780:84 , srv1683708903:84 , srv1756819623:84 , srv1787813152:84 , srv1798639279:84 , srv1925029139:84 , srv1953319406:84 , srv2045998575:84 , srv2140522044:84 , srv244140829:84 , srv361232687:84 , srv423133022:84 , srv610107458:84 , srv611326268:84 , srv639543146:84 , srv712474212:84 , srv742569180:84 , srv854005015:84 , srv989866297:84 , srv1298754054:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-09-23 05:53:16,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-23 05:53:16,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv854005015=28, srv1953319406=17, srv107798792=2, srv2045998575=18, srv1798639279=15, srv2140522044=19, srv610107458=23, srv989866297=29, srv1477629756=8, srv1523174717=9, srv1298754054=5, srv113055643=3, srv1575889857=10, srv1624522780=11, srv423133022=22, srv244140829=20, srv742569180=27, srv1787813152=14, srv611326268=24, srv1683708903=12, srv104290019=0, srv1254710437=4, srv361232687=21, srv1925029139=16, srv132019720=6, srv639543146=25, srv1425020035=7, srv1756819623=13, srv712474212=26, srv1051643874=1} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-23 05:53:16,956 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-23 05:53:16,956 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-23 05:53:16,956 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-23 05:53:16,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-23 05:53:16,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-23 05:53:16,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-23 05:53:16,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-23 05:53:16,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-23 05:53:16,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-23 05:53:16,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-23 05:53:16,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-23 05:53:16,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-23 05:53:16,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-23 05:53:16,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-23 05:53:16,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-23 05:53:16,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-23 05:53:16,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-23 05:53:16,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-23 05:53:16,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-23 05:53:16,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-23 05:53:16,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-23 05:53:16,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-23 05:53:16,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-23 05:53:16,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-23 05:53:16,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-23 05:53:16,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-23 05:53:16,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-23 05:53:16,958 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-23 05:53:16,958 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-23 05:53:16,958 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-23 05:53:16,958 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-09-23 05:53:16,974 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0763901083382776, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-23 05:53:16,974 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912433746001288, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0763901083382776, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-09-23 05:55:16,961 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5721082 different iterations.  Found a solution that moves 1854 regions; Going from a computed imbalance of 0.9912433746001288 to a new imbalance of 4.3273284898463826E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6866666666666666, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-23 05:55:16,969 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv104290019:90 , srv1051643874:90 , srv107798792:90 , srv113055643:90 , srv1254710437:90 , srv1298754054:90 , srv132019720:90 , srv1425020035:90 , srv1477629756:90 , srv1523174717:90 , srv1575889857:90 , srv1624522780:90 , srv1683708903:90 , srv1756819623:90 , srv1787813152:90 , srv1798639279:90 , srv1925029139:90 , srv1953319406:90 , srv2045998575:90 , srv2140522044:90 , srv244140829:90 , srv361232687:90 , srv423133022:90 , srv610107458:90 , srv611326268:90 , srv639543146:90 , srv712474212:90 , srv742569180:90 , srv854005015:90 , srv989866297:90 }
2023-09-23 05:55:16,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-23 05:55:16,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv854005015=28, srv1953319406=17, srv107798792=2, srv2045998575=18, srv1798639279=15, srv2140522044=19, srv610107458=23, srv989866297=29, srv1477629756=8, srv1523174717=9, srv1298754054=5, srv113055643=3, srv1575889857=10, srv1624522780=11, srv423133022=22, srv244140829=20, srv742569180=27, srv1787813152=14, srv611326268=24, srv1683708903=12, srv104290019=0, srv1254710437=4, srv361232687=21, srv1925029139=16, srv132019720=6, srv639543146=25, srv1425020035=7, srv1756819623=13, srv712474212=26, srv1051643874=1} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-23 05:55:16,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-23 05:55:16,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-23 05:55:16,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-23 05:55:16,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-23 05:55:16,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-23 05:55:16,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-23 05:55:16,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-23 05:55:16,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-23 05:55:16,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-23 05:55:16,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-23 05:55:16,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-23 05:55:16,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-23 05:55:16,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-23 05:55:16,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-23 05:55:16,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-23 05:55:16,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-23 05:55:16,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-23 05:55:16,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-23 05:55:16,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-23 05:55:16,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-23 05:55:16,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-23 05:55:16,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-23 05:55:16,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-23 05:55:16,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-23 05:55:16,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-23 05:55:16,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-23 05:55:16,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-23 05:55:16,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-23 05:55:16,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-23 05:55:16,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-23 05:55:16,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-09-23 05:55:16,990 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-23 05:55:16,990 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv104290019:90 , srv1051643874:90 , srv107798792:90 , srv113055643:90 , srv1254710437:90 , srv1298754054:90 , srv132019720:90 , srv1425020035:90 , srv1477629756:90 , srv1523174717:90 , srv1575889857:90 , srv1624522780:90 , srv1683708903:90 , srv1756819623:90 , srv1787813152:90 , srv1798639279:90 , srv1925029139:90 , srv1953319406:90 , srv2045998575:90 , srv2140522044:90 , srv244140829:90 , srv361232687:90 , srv423133022:90 , srv610107458:90 , srv611326268:90 , srv639543146:90 , srv712474212:90 , srv742569180:90 , srv854005015:90 , srv989866297:90 }
2023-09-23 05:55:17,003 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=142 (was 325), ProcessCount=173 (was 170) - ProcessCount LEAK? -, AvailableMemoryMB=1739 (was 2677)