2023-10-27 18:55:28,062 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-10-27 18:55:28,354 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-10-27 18:55:28,464 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-10-27 18:55:28,525 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-27 18:55:28,533 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-10-27 18:55:28,550 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=152, ProcessCount=170, AvailableMemoryMB=8859
2023-10-27 18:55:28,552 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-27 18:55:28,552 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-10-27 18:55:28,670 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1002919351:84 , srv1053348812:84 , srv105512447:84 , srv1067266680:84 , srv1094369220:84 , srv1106363130:84 , srv1136435526:84 , srv1171864572:84 , srv118316938:84 , srv1211012497:84 , srv1214620019:84 , srv1219838294:84 , srv1221723469:84 , srv1273191394:84 , srv1316430335:84 , srv1330001745:84 , srv1405311590:84 , srv1428318940:84 , srv1474385716:84 , srv1478007467:84 , srv1478406977:84 , srv148532401:84 , srv1487724530:84 , srv1511274117:84 , srv1527388733:84 , srv154268857:84 , srv1581987965:84 , srv1588345017:84 , srv158878096:84 , srv1607779389:84 , srv1620258329:84 , srv1647172301:84 , srv1660668809:84 , srv1663708183:84 , srv1721182260:84 , srv1733530898:84 , srv1748562818:84 , srv178929092:84 , srv1802635759:84 , srv1806012336:84 , srv1823778149:84 , srv182382296:84 , srv183709629:84 , srv186262275:84 , srv1895343896:84 , srv1915628661:84 , srv1924994258:84 , srv1925644763:84 , srv1937740423:84 , srv1964267105:84 , srv1975307545:84 , srv1977477630:84 , srv2020400464:84 , srv2062705432:84 , srv208772790:84 , srv2135412102:84 , srv218224150:84 , srv226628277:84 , srv239446187:84 , srv256837150:84 , srv263108549:84 , srv302642965:84 , srv302987818:84 , srv307857141:84 , srv314820420:84 , srv334101999:84 , srv37685439:84 , srv396011973:84 , srv429479300:84 , srv430007811:84 , srv449092953:84 , srv449713069:84 , srv474222605:84 , srv49447775:84 , srv507148718:84 , srv515567525:84 , srv609236480:84 , srv610466836:84 , srv613075691:84 , srv668664979:84 , srv722780781:84 , srv732190347:84 , srv738486984:84 , srv74191628:84 , srv761076957:84 , srv800111398:84 , srv800379911:84 , srv815991155:84 , srv816678927:84 , srv837263250:84 , srv866272768:84 , srv885213840:84 , srv88825287:84 , srv894924086:84 , srv899598244:84 , srv915938641:84 , srv929466439:84 , srv950739746:84 , srv988613703:84 , srv1532412948:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-10-27 18:55:28,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-27 18:55:28,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1620258329=31, srv183709629=43, srv507148718=75, srv1975307545=51, srv1721182260=35, srv1647172301=32, srv1915628661=46, srv1924994258=47, srv2135412102=56, srv1588345017=28, srv761076957=85, srv1474385716=18, srv1607779389=30, srv1964267105=50, srv449092953=71, srv1221723469=12, srv226628277=58, srv738486984=83, srv610466836=78, srv118316938=8, srv1527388733=24, srv722780781=81, srv1806012336=40, srv837263250=90, srv613075691=79, srv950739746=98, srv178929092=38, srv1405311590=16, srv1219838294=11, srv1581987965=27, srv186262275=44, srv1428318940=17, srv1316430335=14, srv885213840=92, srv154268857=26, srv429479300=69, srv800111398=86, srv1802635759=39, srv668664979=80, srv88825287=93, srv1748562818=37, srv307857141=64, srv1478406977=20, srv49447775=74, srv899598244=95, srv158878096=29, srv2062705432=54, srv1171864572=7, srv2020400464=53, srv314820420=65, srv1478007467=19, srv218224150=57, srv430007811=70, srv1094369220=4, srv263108549=61, srv1211012497=9, srv208772790=55, srv894924086=94, srv1532412948=25, srv474222605=73, srv396011973=68, srv929466439=97, srv988613703=99, srv1106363130=5, srv866272768=91, srv449713069=72, srv1511274117=23, srv1660668809=33, srv815991155=88, srv74191628=84, srv1002919351=0, srv1330001745=15, srv816678927=89, srv1937740423=49, srv1895343896=45, srv1663708183=34, srv1733530898=36, srv1214620019=10, srv334101999=66, srv1823778149=41, srv37685439=67, srv302987818=63, srv1136435526=6, srv800379911=87, srv1053348812=1, srv302642965=62, srv1925644763=48, srv1487724530=22, srv182382296=42, srv239446187=59, srv1977477630=52, srv256837150=60, srv732190347=82, srv1067266680=3, srv105512447=2, srv515567525=76, srv148532401=21, srv915938641=96, srv609236480=77, srv1273191394=13} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-27 18:55:28,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-27 18:55:28,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-27 18:55:28,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-27 18:55:28,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-27 18:55:28,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-27 18:55:28,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-27 18:55:28,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-27 18:55:28,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-27 18:55:28,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-27 18:55:28,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-27 18:55:28,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-27 18:55:28,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-27 18:55:28,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-27 18:55:28,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-27 18:55:28,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-27 18:55:28,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-27 18:55:28,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-27 18:55:28,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-27 18:55:28,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-27 18:55:28,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-27 18:55:28,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-27 18:55:28,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-27 18:55:28,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-27 18:55:28,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-27 18:55:28,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-27 18:55:28,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-27 18:55:28,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-27 18:55:28,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-27 18:55:28,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-27 18:55:28,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-27 18:55:28,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-27 18:55:28,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-27 18:55:28,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-27 18:55:28,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-27 18:55:28,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-27 18:55:28,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-27 18:55:28,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-27 18:55:28,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-27 18:55:28,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-27 18:55:28,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-27 18:55:28,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-27 18:55:28,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-27 18:55:28,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-27 18:55:28,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-27 18:55:28,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-27 18:55:28,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-27 18:55:28,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-27 18:55:28,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-27 18:55:28,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-27 18:55:28,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-27 18:55:28,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-27 18:55:28,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-27 18:55:28,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-27 18:55:28,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-27 18:55:28,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-27 18:55:28,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-27 18:55:28,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-27 18:55:28,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-27 18:55:28,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-27 18:55:28,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-27 18:55:28,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-27 18:55:28,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-27 18:55:28,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-27 18:55:28,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-27 18:55:28,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-27 18:55:28,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-27 18:55:28,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-27 18:55:28,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-27 18:55:28,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-27 18:55:28,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-27 18:55:28,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-27 18:55:28,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-27 18:55:28,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-27 18:55:28,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-27 18:55:28,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-27 18:55:28,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-27 18:55:28,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-27 18:55:28,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-27 18:55:28,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-27 18:55:28,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-27 18:55:28,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-27 18:55:28,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-27 18:55:28,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-27 18:55:28,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-27 18:55:28,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-27 18:55:28,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-27 18:55:28,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-27 18:55:28,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-27 18:55:28,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-27 18:55:28,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-27 18:55:28,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-27 18:55:28,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-27 18:55:28,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-27 18:55:28,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-27 18:55:28,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-27 18:55:28,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-27 18:55:28,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-27 18:55:28,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-27 18:55:28,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-27 18:55:28,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-27 18:55:28,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-27 18:55:28,962 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-27 18:55:28,962 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-27 18:55:28,962 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-27 18:55:29,399 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 611 ms to try 5000 different iterations.  Found a solution that moves 4694 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18026345351357356. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03825244804935104, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05468202133050792, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5215555555555556, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03825244804935104, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.1755, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24216666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-27 18:55:29,409 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv449713069:81 , srv1136435526:83 , srv1171864572:83 , srv118316938:83 , srv1316430335:83 , srv1975307545:83 , srv226628277:83 , srv239446187:83 , srv515567525:83 , srv761076957:83 , srv88825287:83 , srv1053348812:84 , srv1527388733:84 , srv158878096:84 , srv1802635759:84 , srv302642965:84 , srv430007811:84 , srv507148718:84 , srv722780781:84 , srv74191628:84 , srv800111398:84 , srv899598244:84 , srv988613703:84 , srv1094369220:85 , srv1106363130:85 , srv1478406977:85 , srv1511274117:85 , srv186262275:85 , srv2062705432:85 , srv609236480:85 , srv815991155:85 , srv816678927:85 , srv866272768:85 , srv885213840:85 , srv105512447:86 , srv1067266680:86 , srv1211012497:86 , srv1214620019:86 , srv1221723469:86 , srv1487724530:86 , srv1660668809:86 , srv1806012336:86 , srv182382296:86 , srv1924994258:86 , srv263108549:86 , srv610466836:86 , srv668664979:86 , srv1219838294:87 , srv1474385716:87 , srv1478007467:87 , srv1588345017:87 , srv1607779389:87 , srv1748562818:87 , srv178929092:87 , srv1915628661:87 , srv1977477630:87 , srv208772790:87 , srv218224150:87 , srv334101999:87 , srv37685439:87 , srv396011973:87 , srv449092953:87 , srv613075691:87 , srv732190347:87 , srv915938641:87 , srv929466439:87 , srv1002919351:88 , srv1330001745:88 , srv1581987965:88 , srv1663708183:88 , srv1895343896:88 , srv1925644763:88 , srv2020400464:88 , srv307857141:88 , srv49447775:88 , srv738486984:88 , srv800379911:88 , srv837263250:88 , srv1405311590:89 , srv1428318940:89 , srv148532401:89 , srv154268857:89 , srv1647172301:89 , srv1721182260:89 , srv1733530898:89 , srv1964267105:89 , srv2135412102:89 , srv314820420:89 , srv429479300:89 , srv950739746:89 , srv1620258329:90 , srv474222605:90 , srv1937740423:91 , srv256837150:91 , srv302987818:91 , srv894924086:91 , srv1273191394:92 , srv183709629:92 , srv1823778149:93 , srv1532412948:430 }
2023-10-27 18:55:29,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-27 18:55:29,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1620258329=31, srv183709629=43, srv507148718=75, srv1975307545=51, srv1721182260=35, srv1647172301=32, srv1915628661=46, srv1924994258=47, srv2135412102=56, srv1588345017=28, srv761076957=85, srv1474385716=18, srv1607779389=30, srv1964267105=50, srv449092953=71, srv1221723469=12, srv226628277=58, srv738486984=83, srv610466836=78, srv118316938=8, srv1527388733=24, srv722780781=81, srv1806012336=40, srv837263250=90, srv613075691=79, srv950739746=98, srv178929092=38, srv1405311590=16, srv1219838294=11, srv1581987965=27, srv186262275=44, srv1428318940=17, srv1316430335=14, srv885213840=92, srv154268857=26, srv429479300=69, srv800111398=86, srv1802635759=39, srv668664979=80, srv88825287=93, srv1748562818=37, srv307857141=64, srv1478406977=20, srv49447775=74, srv899598244=95, srv158878096=29, srv2062705432=54, srv1171864572=7, srv2020400464=53, srv314820420=65, srv1478007467=19, srv218224150=57, srv430007811=70, srv1094369220=4, srv263108549=61, srv1211012497=9, srv208772790=55, srv894924086=94, srv1532412948=25, srv474222605=73, srv396011973=68, srv929466439=97, srv988613703=99, srv1106363130=5, srv866272768=91, srv449713069=72, srv1511274117=23, srv1660668809=33, srv815991155=88, srv74191628=84, srv1002919351=0, srv1330001745=15, srv816678927=89, srv1937740423=49, srv1895343896=45, srv1663708183=34, srv1733530898=36, srv1214620019=10, srv334101999=66, srv1823778149=41, srv37685439=67, srv302987818=63, srv1136435526=6, srv800379911=87, srv1053348812=1, srv302642965=62, srv1925644763=48, srv1487724530=22, srv182382296=42, srv239446187=59, srv1977477630=52, srv256837150=60, srv732190347=82, srv1067266680=3, srv105512447=2, srv515567525=76, srv148532401=21, srv915938641=96, srv609236480=77, srv1273191394=13} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-27 18:55:29,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-27 18:55:29,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-27 18:55:29,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-27 18:55:29,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-27 18:55:29,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-27 18:55:29,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-27 18:55:29,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-27 18:55:29,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-27 18:55:29,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-27 18:55:29,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-27 18:55:29,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-27 18:55:29,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-27 18:55:29,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-27 18:55:29,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-27 18:55:29,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-27 18:55:29,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-27 18:55:29,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-27 18:55:29,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-27 18:55:29,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-27 18:55:29,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-27 18:55:29,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-27 18:55:29,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-27 18:55:29,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-27 18:55:29,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-27 18:55:29,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-27 18:55:29,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-27 18:55:29,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-27 18:55:29,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-27 18:55:29,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-27 18:55:29,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-27 18:55:29,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-27 18:55:29,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-27 18:55:29,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-27 18:55:29,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-27 18:55:29,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-27 18:55:29,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-27 18:55:29,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-27 18:55:29,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-27 18:55:29,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-27 18:55:29,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-27 18:55:29,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-27 18:55:29,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-27 18:55:29,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-27 18:55:29,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-27 18:55:29,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-27 18:55:29,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-27 18:55:29,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-27 18:55:29,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-27 18:55:29,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-27 18:55:29,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-27 18:55:29,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-27 18:55:29,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-27 18:55:29,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-27 18:55:29,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-27 18:55:29,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-27 18:55:29,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-27 18:55:29,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-27 18:55:29,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-27 18:55:29,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-27 18:55:29,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-27 18:55:29,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-27 18:55:29,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-27 18:55:29,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-27 18:55:29,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-27 18:55:29,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-27 18:55:29,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-27 18:55:29,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-27 18:55:29,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-27 18:55:29,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-27 18:55:29,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-27 18:55:29,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-27 18:55:29,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-27 18:55:29,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-27 18:55:29,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-27 18:55:29,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-27 18:55:29,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-27 18:55:29,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-27 18:55:29,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-27 18:55:29,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-27 18:55:29,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-27 18:55:29,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-27 18:55:29,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-27 18:55:29,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-27 18:55:29,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-27 18:55:29,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-27 18:55:29,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-27 18:55:29,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-27 18:55:29,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-27 18:55:29,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-27 18:55:29,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-27 18:55:29,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-27 18:55:29,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-27 18:55:29,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-27 18:55:29,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-27 18:55:29,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-27 18:55:29,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-27 18:55:29,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-27 18:55:29,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-27 18:55:29,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-27 18:55:29,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-27 18:55:29,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-27 18:55:29,605 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03825244804935104, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05468202133050792, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03825244804935104, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.1755, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24216666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-27 18:55:29,605 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-27 18:55:29,605 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18023058542306983, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03825244804935104, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05468202133050792, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03825244804935104, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.1755, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24216666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-27 18:55:29,881 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 429 ms to try 5000 different iterations.  Found a solution that moves 2681 regions; Going from a computed imbalance of 0.18023058542306983 to a new imbalance of 0.015009489789709889. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02093404389480803); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.032848323331321067, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29788888888888887, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02093404389480803); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.044583333333333336, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-27 18:55:29,892 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1823778149:78 , srv183709629:80 , srv302987818:80 , srv474222605:80 , srv1647172301:81 , srv1428318940:82 , srv1937740423:82 , srv894924086:82 , srv950739746:82 , srv1273191394:83 , srv1474385716:83 , srv1478007467:83 , srv148532401:83 , srv154268857:83 , srv1581987965:83 , srv1620258329:83 , srv1733530898:83 , srv208772790:83 , srv2135412102:83 , srv256837150:83 , srv314820420:83 , srv37685439:83 , srv429479300:83 , srv613075691:83 , srv738486984:83 , srv1002919351:84 , srv105512447:84 , srv1405311590:84 , srv1663708183:84 , srv1895343896:84 , srv1964267105:84 , srv1977477630:84 , srv396011973:84 , srv837263250:84 , srv866272768:84 , srv1067266680:85 , srv1211012497:85 , srv1221723469:85 , srv1330001745:85 , srv1588345017:85 , srv1660668809:85 , srv1721182260:85 , srv1806012336:85 , srv1915628661:85 , srv2020400464:85 , srv263108549:85 , srv307857141:85 , srv49447775:85 , srv74191628:85 , srv915938641:85 , srv929466439:85 , srv1219838294:86 , srv1748562818:86 , srv178929092:86 , srv182382296:86 , srv1924994258:86 , srv218224150:86 , srv668664979:86 , srv732190347:86 , srv800379911:86 , srv885213840:86 , srv899598244:86 , srv1106363130:87 , srv1214620019:87 , srv1607779389:87 , srv186262275:87 , srv334101999:87 , srv800111398:87 , srv816678927:87 , srv988613703:87 , srv1053348812:88 , srv1094369220:88 , srv1136435526:88 , srv1171864572:88 , srv1478406977:88 , srv158878096:88 , srv1802635759:88 , srv1925644763:88 , srv1975307545:88 , srv2062705432:88 , srv302642965:88 , srv430007811:88 , srv449092953:88 , srv507148718:88 , srv609236480:88 , srv610466836:88 , srv1316430335:89 , srv1487724530:89 , srv1511274117:89 , srv1527388733:89 , srv239446187:89 , srv515567525:89 , srv722780781:89 , srv815991155:89 , srv88825287:89 , srv226628277:90 , srv449713069:90 , srv761076957:90 , srv118316938:94 , srv1532412948:530 }
2023-10-27 18:55:29,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-27 18:55:29,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1620258329=31, srv183709629=43, srv507148718=75, srv1975307545=51, srv1721182260=35, srv1647172301=32, srv1915628661=46, srv1924994258=47, srv2135412102=56, srv1588345017=28, srv761076957=85, srv1474385716=18, srv1607779389=30, srv1964267105=50, srv449092953=71, srv1221723469=12, srv226628277=58, srv738486984=83, srv610466836=78, srv118316938=8, srv1527388733=24, srv722780781=81, srv1806012336=40, srv837263250=90, srv613075691=79, srv950739746=98, srv178929092=38, srv1405311590=16, srv1219838294=11, srv1581987965=27, srv186262275=44, srv1428318940=17, srv1316430335=14, srv885213840=92, srv154268857=26, srv429479300=69, srv800111398=86, srv1802635759=39, srv668664979=80, srv88825287=93, srv1748562818=37, srv307857141=64, srv1478406977=20, srv49447775=74, srv899598244=95, srv158878096=29, srv2062705432=54, srv1171864572=7, srv2020400464=53, srv314820420=65, srv1478007467=19, srv218224150=57, srv430007811=70, srv1094369220=4, srv263108549=61, srv1211012497=9, srv208772790=55, srv894924086=94, srv1532412948=25, srv474222605=73, srv396011973=68, srv929466439=97, srv988613703=99, srv1106363130=5, srv866272768=91, srv449713069=72, srv1511274117=23, srv1660668809=33, srv815991155=88, srv74191628=84, srv1002919351=0, srv1330001745=15, srv816678927=89, srv1937740423=49, srv1895343896=45, srv1663708183=34, srv1733530898=36, srv1214620019=10, srv334101999=66, srv1823778149=41, srv37685439=67, srv302987818=63, srv1136435526=6, srv800379911=87, srv1053348812=1, srv302642965=62, srv1925644763=48, srv1487724530=22, srv182382296=42, srv239446187=59, srv1977477630=52, srv256837150=60, srv732190347=82, srv1067266680=3, srv105512447=2, srv515567525=76, srv148532401=21, srv915938641=96, srv609236480=77, srv1273191394=13} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-27 18:55:29,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-27 18:55:29,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-27 18:55:29,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-27 18:55:29,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-27 18:55:29,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-27 18:55:29,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-27 18:55:29,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-27 18:55:29,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-27 18:55:29,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-27 18:55:29,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-27 18:55:29,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-27 18:55:29,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-27 18:55:29,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-27 18:55:29,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-27 18:55:29,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-27 18:55:29,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-27 18:55:29,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-27 18:55:29,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-27 18:55:29,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-27 18:55:29,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-27 18:55:29,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-27 18:55:29,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-27 18:55:29,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-27 18:55:29,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-27 18:55:29,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-27 18:55:29,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-27 18:55:29,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-27 18:55:29,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-27 18:55:29,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-27 18:55:29,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-27 18:55:29,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-27 18:55:29,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-27 18:55:29,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-27 18:55:29,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-27 18:55:29,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-27 18:55:29,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-27 18:55:29,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-27 18:55:29,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-27 18:55:29,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-27 18:55:29,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-27 18:55:29,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-27 18:55:29,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-27 18:55:29,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-27 18:55:29,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-27 18:55:29,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-27 18:55:29,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-27 18:55:29,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-27 18:55:29,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-27 18:55:29,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-27 18:55:29,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-27 18:55:29,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-27 18:55:29,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-27 18:55:29,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-27 18:55:29,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-27 18:55:29,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-27 18:55:29,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-27 18:55:29,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-27 18:55:29,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-27 18:55:29,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-27 18:55:29,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-27 18:55:29,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-27 18:55:29,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-27 18:55:29,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-27 18:55:29,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-27 18:55:29,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-27 18:55:29,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-27 18:55:29,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-27 18:55:29,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-27 18:55:29,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-27 18:55:29,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-27 18:55:29,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-27 18:55:29,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-27 18:55:29,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-27 18:55:29,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-27 18:55:29,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-27 18:55:29,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-27 18:55:29,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-27 18:55:29,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-27 18:55:29,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-27 18:55:29,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-27 18:55:29,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-27 18:55:29,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-27 18:55:29,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-27 18:55:29,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-27 18:55:29,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-27 18:55:29,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-27 18:55:29,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-27 18:55:29,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-27 18:55:29,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-27 18:55:29,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-27 18:55:29,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-27 18:55:29,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-27 18:55:29,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-27 18:55:29,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-27 18:55:29,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-27 18:55:29,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-27 18:55:29,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-27 18:55:29,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-27 18:55:29,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-27 18:55:29,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-27 18:55:29,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-27 18:55:30,107 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02093404389480803); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.032848323331321067, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02093404389480803); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.044583333333333336, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-27 18:55:30,107 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-27 18:55:30,107 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.014990717026471574, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02093404389480803); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.032848323331321067, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02093404389480803); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.044583333333333336, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-27 18:55:30,360 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 413 ms to try 5000 different iterations.  Found a solution that moves 981 regions; Going from a computed imbalance of 0.014990717026471574 to a new imbalance of 0.0010437201248651193. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0043336354897677235); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0073702773119008885); MoveCostFunction : (multiplier=7.0, imbalance=0.109, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0043336354897677235); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=6.666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00425); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-27 18:55:30,364 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv118316938:82 , srv1273191394:82 , srv1487724530:82 , srv1925644763:82 , srv1607779389:83 , srv449092953:83 , srv800379911:83 , srv1053348812:84 , srv1219838294:84 , srv1330001745:84 , srv1478406977:84 , srv1620258329:84 , srv1748562818:84 , srv178929092:84 , srv1937740423:84 , srv2062705432:84 , srv226628277:84 , srv256837150:84 , srv334101999:84 , srv732190347:84 , srv815991155:84 , srv1002919351:85 , srv1094369220:85 , srv1214620019:85 , srv1316430335:85 , srv1405311590:85 , srv1511274117:85 , srv158878096:85 , srv1721182260:85 , srv1733530898:85 , srv182382296:85 , srv183709629:85 , srv186262275:85 , srv1895343896:85 , srv1915628661:85 , srv1924994258:85 , srv1964267105:85 , srv2020400464:85 , srv2135412102:85 , srv218224150:85 , srv239446187:85 , srv307857141:85 , srv314820420:85 , srv49447775:85 , srv609236480:85 , srv610466836:85 , srv722780781:85 , srv761076957:85 , srv88825287:85 , srv894924086:85 , srv929466439:85 , srv1106363130:86 , srv1171864572:86 , srv1211012497:86 , srv148532401:86 , srv1527388733:86 , srv1588345017:86 , srv1660668809:86 , srv1663708183:86 , srv1802635759:86 , srv1806012336:86 , srv1823778149:86 , srv1975307545:86 , srv263108549:86 , srv302987818:86 , srv429479300:86 , srv430007811:86 , srv507148718:86 , srv515567525:86 , srv668664979:86 , srv738486984:86 , srv800111398:86 , srv816678927:86 , srv837263250:86 , srv915938641:86 , srv950739746:86 , srv1067266680:87 , srv1136435526:87 , srv1221723469:87 , srv1428318940:87 , srv1474385716:87 , srv1581987965:87 , srv1647172301:87 , srv1977477630:87 , srv302642965:87 , srv37685439:87 , srv396011973:87 , srv449713069:87 , srv474222605:87 , srv613075691:87 , srv885213840:87 , srv899598244:87 , srv988613703:87 , srv105512447:88 , srv1478007467:88 , srv154268857:88 , srv208772790:88 , srv74191628:90 , srv866272768:90 , srv1532412948:536 }
2023-10-27 18:55:30,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-27 18:55:30,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1620258329=31, srv183709629=43, srv507148718=75, srv1975307545=51, srv1721182260=35, srv1647172301=32, srv1915628661=46, srv1924994258=47, srv2135412102=56, srv1588345017=28, srv761076957=85, srv1474385716=18, srv1607779389=30, srv1964267105=50, srv449092953=71, srv1221723469=12, srv226628277=58, srv738486984=83, srv610466836=78, srv118316938=8, srv1527388733=24, srv722780781=81, srv1806012336=40, srv837263250=90, srv613075691=79, srv950739746=98, srv178929092=38, srv1405311590=16, srv1219838294=11, srv1581987965=27, srv186262275=44, srv1428318940=17, srv1316430335=14, srv885213840=92, srv154268857=26, srv429479300=69, srv800111398=86, srv1802635759=39, srv668664979=80, srv88825287=93, srv1748562818=37, srv307857141=64, srv1478406977=20, srv49447775=74, srv899598244=95, srv158878096=29, srv2062705432=54, srv1171864572=7, srv2020400464=53, srv314820420=65, srv1478007467=19, srv218224150=57, srv430007811=70, srv1094369220=4, srv263108549=61, srv1211012497=9, srv208772790=55, srv894924086=94, srv1532412948=25, srv474222605=73, srv396011973=68, srv929466439=97, srv988613703=99, srv1106363130=5, srv866272768=91, srv449713069=72, srv1511274117=23, srv1660668809=33, srv815991155=88, srv74191628=84, srv1002919351=0, srv1330001745=15, srv816678927=89, srv1937740423=49, srv1895343896=45, srv1663708183=34, srv1733530898=36, srv1214620019=10, srv334101999=66, srv1823778149=41, srv37685439=67, srv302987818=63, srv1136435526=6, srv800379911=87, srv1053348812=1, srv302642965=62, srv1925644763=48, srv1487724530=22, srv182382296=42, srv239446187=59, srv1977477630=52, srv256837150=60, srv732190347=82, srv1067266680=3, srv105512447=2, srv515567525=76, srv148532401=21, srv915938641=96, srv609236480=77, srv1273191394=13} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-27 18:55:30,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-27 18:55:30,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-27 18:55:30,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-27 18:55:30,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-27 18:55:30,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-27 18:55:30,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-27 18:55:30,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-27 18:55:30,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-27 18:55:30,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-27 18:55:30,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-27 18:55:30,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-27 18:55:30,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-27 18:55:30,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-27 18:55:30,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-27 18:55:30,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-27 18:55:30,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-27 18:55:30,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-27 18:55:30,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-27 18:55:30,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-27 18:55:30,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-27 18:55:30,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-27 18:55:30,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-27 18:55:30,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-27 18:55:30,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-27 18:55:30,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-27 18:55:30,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-27 18:55:30,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-27 18:55:30,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-27 18:55:30,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-27 18:55:30,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-27 18:55:30,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-27 18:55:30,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-27 18:55:30,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-27 18:55:30,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-27 18:55:30,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-27 18:55:30,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-27 18:55:30,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-27 18:55:30,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-27 18:55:30,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-27 18:55:30,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-27 18:55:30,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-27 18:55:30,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-27 18:55:30,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-27 18:55:30,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-27 18:55:30,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-27 18:55:30,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-27 18:55:30,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-27 18:55:30,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-27 18:55:30,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-27 18:55:30,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-27 18:55:30,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-27 18:55:30,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-27 18:55:30,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-27 18:55:30,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-27 18:55:30,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-27 18:55:30,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-27 18:55:30,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-27 18:55:30,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-27 18:55:30,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-27 18:55:30,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-27 18:55:30,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-27 18:55:30,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-27 18:55:30,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-27 18:55:30,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-27 18:55:30,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-27 18:55:30,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-27 18:55:30,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-27 18:55:30,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-27 18:55:30,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-27 18:55:30,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-27 18:55:30,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-27 18:55:30,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-27 18:55:30,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-27 18:55:30,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-27 18:55:30,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-27 18:55:30,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-27 18:55:30,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-27 18:55:30,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-27 18:55:30,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-27 18:55:30,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-27 18:55:30,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-27 18:55:30,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-27 18:55:30,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-27 18:55:30,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-27 18:55:30,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-27 18:55:30,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-27 18:55:30,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-27 18:55:30,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-27 18:55:30,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-27 18:55:30,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-27 18:55:30,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-27 18:55:30,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-27 18:55:30,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-27 18:55:30,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-27 18:55:30,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-27 18:55:30,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-27 18:55:30,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-27 18:55:30,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-27 18:55:30,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-27 18:55:30,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-27 18:55:30,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-27 18:55:30,522 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0043336354897677235); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0073702773119008885); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0043336354897677235); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=6.666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00425); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-27 18:55:30,522 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-27 18:55:30,523 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.0010368510160487126, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0043336354897677235); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0073702773119008885); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0043336354897677235); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=6.666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00425); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-27 18:55:30,879 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 458 ms to try 5000 different iterations.  Found a solution that moves 240 regions; Going from a computed imbalance of 0.0010368510160487126 to a new imbalance of 3.0194573771197657E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.470732932414788E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0024158102511315956); MoveCostFunction : (multiplier=7.0, imbalance=0.02666666666666667, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.470732932414788E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-27 18:55:30,880 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv154268857:82 , srv1106363130:83 , srv1428318940:83 , srv1721182260:83 , srv1964267105:83 , srv302642965:83 , srv429479300:83 , srv609236480:83 , srv610466836:83 , srv74191628:83 , srv761076957:83 , srv866272768:83 , srv105512447:84 , srv1067266680:84 , srv1094369220:84 , srv1136435526:84 , srv118316938:84 , srv1211012497:84 , srv1214620019:84 , srv1221723469:84 , srv1478007467:84 , srv148532401:84 , srv1511274117:84 , srv1527388733:84 , srv1581987965:84 , srv158878096:84 , srv1663708183:84 , srv178929092:84 , srv1802635759:84 , srv1895343896:84 , srv1925644763:84 , srv2020400464:84 , srv218224150:84 , srv256837150:84 , srv263108549:84 , srv307857141:84 , srv334101999:84 , srv396011973:84 , srv430007811:84 , srv449092953:84 , srv449713069:84 , srv474222605:84 , srv49447775:84 , srv507148718:84 , srv515567525:84 , srv668664979:84 , srv722780781:84 , srv815991155:84 , srv816678927:84 , srv837263250:84 , srv885213840:84 , srv894924086:84 , srv915938641:84 , srv988613703:84 , srv1002919351:85 , srv1171864572:85 , srv1219838294:85 , srv1273191394:85 , srv1316430335:85 , srv1405311590:85 , srv1474385716:85 , srv1478406977:85 , srv1487724530:85 , srv1588345017:85 , srv1620258329:85 , srv1647172301:85 , srv1660668809:85 , srv1733530898:85 , srv1748562818:85 , srv1823778149:85 , srv186262275:85 , srv1915628661:85 , srv1924994258:85 , srv1937740423:85 , srv1975307545:85 , srv1977477630:85 , srv2062705432:85 , srv208772790:85 , srv2135412102:85 , srv226628277:85 , srv239446187:85 , srv302987818:85 , srv314820420:85 , srv37685439:85 , srv613075691:85 , srv732190347:85 , srv738486984:85 , srv800111398:85 , srv800379911:85 , srv88825287:85 , srv899598244:85 , srv929466439:85 , srv950739746:85 , srv1053348812:86 , srv1330001745:86 , srv1607779389:86 , srv1806012336:86 , srv182382296:86 , srv183709629:86 , srv1532412948:646 }
2023-10-27 18:55:30,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-27 18:55:30,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1620258329=31, srv183709629=43, srv507148718=75, srv1975307545=51, srv1721182260=35, srv1647172301=32, srv1915628661=46, srv1924994258=47, srv2135412102=56, srv1588345017=28, srv761076957=85, srv1474385716=18, srv1607779389=30, srv1964267105=50, srv449092953=71, srv1221723469=12, srv226628277=58, srv738486984=83, srv610466836=78, srv118316938=8, srv1527388733=24, srv722780781=81, srv1806012336=40, srv837263250=90, srv613075691=79, srv950739746=98, srv178929092=38, srv1405311590=16, srv1219838294=11, srv1581987965=27, srv186262275=44, srv1428318940=17, srv1316430335=14, srv885213840=92, srv154268857=26, srv429479300=69, srv800111398=86, srv1802635759=39, srv668664979=80, srv88825287=93, srv1748562818=37, srv307857141=64, srv1478406977=20, srv49447775=74, srv899598244=95, srv158878096=29, srv2062705432=54, srv1171864572=7, srv2020400464=53, srv314820420=65, srv1478007467=19, srv218224150=57, srv430007811=70, srv1094369220=4, srv263108549=61, srv1211012497=9, srv208772790=55, srv894924086=94, srv1532412948=25, srv474222605=73, srv396011973=68, srv929466439=97, srv988613703=99, srv1106363130=5, srv866272768=91, srv449713069=72, srv1511274117=23, srv1660668809=33, srv815991155=88, srv74191628=84, srv1002919351=0, srv1330001745=15, srv816678927=89, srv1937740423=49, srv1895343896=45, srv1663708183=34, srv1733530898=36, srv1214620019=10, srv334101999=66, srv1823778149=41, srv37685439=67, srv302987818=63, srv1136435526=6, srv800379911=87, srv1053348812=1, srv302642965=62, srv1925644763=48, srv1487724530=22, srv182382296=42, srv239446187=59, srv1977477630=52, srv256837150=60, srv732190347=82, srv1067266680=3, srv105512447=2, srv515567525=76, srv148532401=21, srv915938641=96, srv609236480=77, srv1273191394=13} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-27 18:55:30,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-27 18:55:30,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-27 18:55:30,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-27 18:55:30,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-27 18:55:30,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-27 18:55:30,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-27 18:55:30,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-27 18:55:30,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-27 18:55:30,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-27 18:55:30,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-27 18:55:30,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-27 18:55:30,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-27 18:55:30,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-27 18:55:30,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-27 18:55:30,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-27 18:55:30,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-27 18:55:30,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-27 18:55:30,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-27 18:55:30,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-27 18:55:30,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-27 18:55:30,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-27 18:55:30,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-27 18:55:30,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-27 18:55:30,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-27 18:55:30,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-27 18:55:30,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-27 18:55:30,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-27 18:55:30,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-27 18:55:30,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-27 18:55:30,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-27 18:55:30,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-27 18:55:30,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-27 18:55:30,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-27 18:55:30,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-27 18:55:30,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-27 18:55:30,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-27 18:55:30,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-27 18:55:30,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-27 18:55:30,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-27 18:55:30,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-27 18:55:30,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-27 18:55:30,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-27 18:55:30,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-27 18:55:30,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-27 18:55:30,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-27 18:55:30,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-27 18:55:30,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-27 18:55:30,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-27 18:55:30,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-27 18:55:30,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-27 18:55:30,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-27 18:55:30,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-27 18:55:30,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-27 18:55:30,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-27 18:55:30,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-27 18:55:30,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-27 18:55:30,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-27 18:55:30,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-27 18:55:30,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-27 18:55:30,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-27 18:55:30,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-27 18:55:30,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-27 18:55:30,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-27 18:55:30,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-27 18:55:30,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-27 18:55:30,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-27 18:55:30,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-27 18:55:30,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-27 18:55:30,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-27 18:55:30,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-27 18:55:30,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-27 18:55:30,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-27 18:55:30,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-27 18:55:30,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-27 18:55:30,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-27 18:55:30,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-27 18:55:30,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-27 18:55:30,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-27 18:55:30,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-27 18:55:30,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-27 18:55:30,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-27 18:55:30,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-27 18:55:30,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-27 18:55:30,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-27 18:55:30,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-27 18:55:30,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-27 18:55:30,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-27 18:55:30,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-27 18:55:30,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-27 18:55:30,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-27 18:55:30,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-27 18:55:30,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-27 18:55:30,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-27 18:55:30,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-27 18:55:30,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-27 18:55:30,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-27 18:55:30,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-27 18:55:30,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-27 18:55:30,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-27 18:55:30,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-27 18:55:30,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-27 18:55:31,018 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.470732932414788E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0024158102511315956); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.470732932414788E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-27 18:55:31,018 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-27 18:55:31,018 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.8514057852810712E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.470732932414788E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0024158102511315956); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.470732932414788E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-27 18:55:31,262 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 349 ms to try 5000 different iterations.  Found a solution that moves 39 regions; Going from a computed imbalance of 2.8514057852810712E-5 to a new imbalance of 8.252773953778466E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.004333333333333333); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-27 18:55:31,263 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv118316938:83 , srv1330001745:83 , srv1405311590:83 , srv1511274117:83 , srv1527388733:83 , srv1588345017:83 , srv1607779389:83 , srv1806012336:83 , srv182382296:83 , srv183709629:83 , srv1977477630:83 , srv208772790:83 , srv1002919351:84 , srv1053348812:84 , srv105512447:84 , srv1067266680:84 , srv1094369220:84 , srv1136435526:84 , srv1171864572:84 , srv1214620019:84 , srv1219838294:84 , srv1221723469:84 , srv1273191394:84 , srv1316430335:84 , srv1474385716:84 , srv1478007467:84 , srv1478406977:84 , srv148532401:84 , srv1487724530:84 , srv154268857:84 , srv1581987965:84 , srv1620258329:84 , srv1647172301:84 , srv1660668809:84 , srv1663708183:84 , srv1721182260:84 , srv1733530898:84 , srv1748562818:84 , srv1802635759:84 , srv1823778149:84 , srv186262275:84 , srv1915628661:84 , srv1924994258:84 , srv1925644763:84 , srv1937740423:84 , srv1975307545:84 , srv2020400464:84 , srv2062705432:84 , srv2135412102:84 , srv218224150:84 , srv226628277:84 , srv239446187:84 , srv256837150:84 , srv302642965:84 , srv302987818:84 , srv307857141:84 , srv314820420:84 , srv334101999:84 , srv37685439:84 , srv396011973:84 , srv430007811:84 , srv449092953:84 , srv449713069:84 , srv49447775:84 , srv507148718:84 , srv515567525:84 , srv610466836:84 , srv613075691:84 , srv668664979:84 , srv722780781:84 , srv732190347:84 , srv738486984:84 , srv74191628:84 , srv800111398:84 , srv800379911:84 , srv815991155:84 , srv816678927:84 , srv837263250:84 , srv866272768:84 , srv885213840:84 , srv88825287:84 , srv894924086:84 , srv899598244:84 , srv915938641:84 , srv929466439:84 , srv950739746:84 , srv988613703:84 , srv1106363130:85 , srv1211012497:85 , srv1428318940:85 , srv158878096:85 , srv178929092:85 , srv1895343896:85 , srv1964267105:85 , srv263108549:85 , srv429479300:85 , srv474222605:85 , srv609236480:85 , srv761076957:85 , srv1532412948:684 }
2023-10-27 18:55:31,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-27 18:55:31,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1620258329=31, srv183709629=43, srv507148718=75, srv1975307545=51, srv1721182260=35, srv1647172301=32, srv1915628661=46, srv1924994258=47, srv2135412102=56, srv1588345017=28, srv761076957=85, srv1474385716=18, srv1607779389=30, srv1964267105=50, srv449092953=71, srv1221723469=12, srv226628277=58, srv738486984=83, srv610466836=78, srv118316938=8, srv1527388733=24, srv722780781=81, srv1806012336=40, srv837263250=90, srv613075691=79, srv950739746=98, srv178929092=38, srv1405311590=16, srv1219838294=11, srv1581987965=27, srv186262275=44, srv1428318940=17, srv1316430335=14, srv885213840=92, srv154268857=26, srv429479300=69, srv800111398=86, srv1802635759=39, srv668664979=80, srv88825287=93, srv1748562818=37, srv307857141=64, srv1478406977=20, srv49447775=74, srv899598244=95, srv158878096=29, srv2062705432=54, srv1171864572=7, srv2020400464=53, srv314820420=65, srv1478007467=19, srv218224150=57, srv430007811=70, srv1094369220=4, srv263108549=61, srv1211012497=9, srv208772790=55, srv894924086=94, srv1532412948=25, srv474222605=73, srv396011973=68, srv929466439=97, srv988613703=99, srv1106363130=5, srv866272768=91, srv449713069=72, srv1511274117=23, srv1660668809=33, srv815991155=88, srv74191628=84, srv1002919351=0, srv1330001745=15, srv816678927=89, srv1937740423=49, srv1895343896=45, srv1663708183=34, srv1733530898=36, srv1214620019=10, srv334101999=66, srv1823778149=41, srv37685439=67, srv302987818=63, srv1136435526=6, srv800379911=87, srv1053348812=1, srv302642965=62, srv1925644763=48, srv1487724530=22, srv182382296=42, srv239446187=59, srv1977477630=52, srv256837150=60, srv732190347=82, srv1067266680=3, srv105512447=2, srv515567525=76, srv148532401=21, srv915938641=96, srv609236480=77, srv1273191394=13} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-27 18:55:31,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-27 18:55:31,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-27 18:55:31,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-27 18:55:31,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-27 18:55:31,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-27 18:55:31,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-27 18:55:31,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-27 18:55:31,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-27 18:55:31,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-27 18:55:31,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-27 18:55:31,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-27 18:55:31,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-27 18:55:31,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-27 18:55:31,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-27 18:55:31,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-27 18:55:31,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-27 18:55:31,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-27 18:55:31,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-27 18:55:31,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-27 18:55:31,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-27 18:55:31,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-27 18:55:31,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-27 18:55:31,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-27 18:55:31,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-27 18:55:31,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-27 18:55:31,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-27 18:55:31,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-27 18:55:31,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-27 18:55:31,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-27 18:55:31,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-27 18:55:31,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-27 18:55:31,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-27 18:55:31,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-27 18:55:31,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-27 18:55:31,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-27 18:55:31,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-27 18:55:31,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-27 18:55:31,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-27 18:55:31,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-27 18:55:31,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-27 18:55:31,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-27 18:55:31,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-27 18:55:31,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-27 18:55:31,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-27 18:55:31,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-27 18:55:31,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-27 18:55:31,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-27 18:55:31,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-27 18:55:31,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-27 18:55:31,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-27 18:55:31,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-27 18:55:31,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-27 18:55:31,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-27 18:55:31,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-27 18:55:31,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-27 18:55:31,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-27 18:55:31,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-27 18:55:31,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-27 18:55:31,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-27 18:55:31,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-27 18:55:31,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-27 18:55:31,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-27 18:55:31,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-27 18:55:31,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-27 18:55:31,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-27 18:55:31,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-27 18:55:31,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-27 18:55:31,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-27 18:55:31,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-27 18:55:31,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-27 18:55:31,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-27 18:55:31,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-27 18:55:31,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-27 18:55:31,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-27 18:55:31,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-27 18:55:31,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-27 18:55:31,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-27 18:55:31,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-27 18:55:31,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-27 18:55:31,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-27 18:55:31,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-27 18:55:31,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-27 18:55:31,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-27 18:55:31,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-27 18:55:31,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-27 18:55:31,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-27 18:55:31,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-27 18:55:31,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-27 18:55:31,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-27 18:55:31,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-27 18:55:31,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-27 18:55:31,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-27 18:55:31,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-27 18:55:31,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-27 18:55:31,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-27 18:55:31,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-27 18:55:31,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-27 18:55:31,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-27 18:55:31,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-27 18:55:31,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-27 18:55:31,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-27 18:55:31,408 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.979690117040589E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-27 18:55:31,408 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv118316938:83 , srv1330001745:83 , srv1405311590:83 , srv1511274117:83 , srv1527388733:83 , srv1588345017:83 , srv1607779389:83 , srv1806012336:83 , srv182382296:83 , srv183709629:83 , srv1977477630:83 , srv208772790:83 , srv1002919351:84 , srv1053348812:84 , srv105512447:84 , srv1067266680:84 , srv1094369220:84 , srv1136435526:84 , srv1171864572:84 , srv1214620019:84 , srv1219838294:84 , srv1221723469:84 , srv1273191394:84 , srv1316430335:84 , srv1474385716:84 , srv1478007467:84 , srv1478406977:84 , srv148532401:84 , srv1487724530:84 , srv154268857:84 , srv1581987965:84 , srv1620258329:84 , srv1647172301:84 , srv1660668809:84 , srv1663708183:84 , srv1721182260:84 , srv1733530898:84 , srv1748562818:84 , srv1802635759:84 , srv1823778149:84 , srv186262275:84 , srv1915628661:84 , srv1924994258:84 , srv1925644763:84 , srv1937740423:84 , srv1975307545:84 , srv2020400464:84 , srv2062705432:84 , srv2135412102:84 , srv218224150:84 , srv226628277:84 , srv239446187:84 , srv256837150:84 , srv302642965:84 , srv302987818:84 , srv307857141:84 , srv314820420:84 , srv334101999:84 , srv37685439:84 , srv396011973:84 , srv430007811:84 , srv449092953:84 , srv449713069:84 , srv49447775:84 , srv507148718:84 , srv515567525:84 , srv610466836:84 , srv613075691:84 , srv668664979:84 , srv722780781:84 , srv732190347:84 , srv738486984:84 , srv74191628:84 , srv800111398:84 , srv800379911:84 , srv815991155:84 , srv816678927:84 , srv837263250:84 , srv866272768:84 , srv885213840:84 , srv88825287:84 , srv894924086:84 , srv899598244:84 , srv915938641:84 , srv929466439:84 , srv950739746:84 , srv988613703:84 , srv1106363130:85 , srv1211012497:85 , srv1428318940:85 , srv158878096:85 , srv178929092:85 , srv1895343896:85 , srv1964267105:85 , srv263108549:85 , srv429479300:85 , srv474222605:85 , srv609236480:85 , srv761076957:85 , srv1532412948:684 }
2023-10-27 18:55:31,434 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=152 (was 152), ProcessCount=170 (was 170), AvailableMemoryMB=8343 (was 8859)
2023-10-27 18:55:31,441 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=152, ProcessCount=170, AvailableMemoryMB=8342
2023-10-27 18:55:31,441 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-27 18:55:31,441 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-10-27 18:55:31,454 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv10808585:84 , srv1098945651:84 , srv1162378179:84 , srv1220782474:84 , srv1335380269:84 , srv1534153942:84 , srv1546657411:84 , srv1692914782:84 , srv1773229854:84 , srv1784837879:84 , srv1805772053:84 , srv1830171919:84 , srv1855131167:84 , srv1916296140:84 , srv200586862:84 , srv264095281:84 , srv332487501:84 , srv353629971:84 , srv389058203:84 , srv431569571:84 , srv496598359:84 , srv50238921:84 , srv582503288:84 , srv622830875:84 , srv668073336:84 , srv715993040:84 , srv832681895:84 , srv867105795:84 , srv88423735:84 , srv372194030:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-10-27 18:55:31,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-27 18:55:31,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv332487501=16, srv582503288=23, srv1692914782=7, srv431569571=20, srv10808585=0, srv1546657411=6, srv715993040=26, srv389058203=19, srv50238921=22, srv88423735=29, srv622830875=24, srv832681895=27, srv1830171919=11, srv1805772053=10, srv1534153942=5, srv200586862=14, srv1916296140=13, srv1773229854=8, srv372194030=18, srv1220782474=3, srv1335380269=4, srv353629971=17, srv1098945651=1, srv1784837879=9, srv1855131167=12, srv867105795=28, srv668073336=25, srv496598359=21, srv1162378179=2, srv264095281=15} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-27 18:55:31,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-27 18:55:31,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-27 18:55:31,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-27 18:55:31,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-27 18:55:31,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-27 18:55:31,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-27 18:55:31,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-27 18:55:31,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-27 18:55:31,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-27 18:55:31,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-27 18:55:31,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-27 18:55:31,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-27 18:55:31,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-27 18:55:31,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-27 18:55:31,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-27 18:55:31,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-27 18:55:31,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-27 18:55:31,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-27 18:55:31,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-27 18:55:31,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-27 18:55:31,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-27 18:55:31,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-27 18:55:31,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-27 18:55:31,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-27 18:55:31,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-27 18:55:31,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-27 18:55:31,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-27 18:55:31,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-27 18:55:31,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-27 18:55:31,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-27 18:55:31,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-10-27 18:55:31,498 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1164889904285533, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-27 18:55:31,498 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912560096269405, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1164889904285533, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-10-27 18:57:31,476 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5541105 different iterations.  Found a solution that moves 1860 regions; Going from a computed imbalance of 0.9912560096269405 to a new imbalance of 4.341332789166274E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6888888888888889, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-27 18:57:31,482 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv10808585:90 , srv1098945651:90 , srv1162378179:90 , srv1220782474:90 , srv1335380269:90 , srv1534153942:90 , srv1546657411:90 , srv1692914782:90 , srv1773229854:90 , srv1784837879:90 , srv1805772053:90 , srv1830171919:90 , srv1855131167:90 , srv1916296140:90 , srv200586862:90 , srv264095281:90 , srv332487501:90 , srv353629971:90 , srv372194030:90 , srv389058203:90 , srv431569571:90 , srv496598359:90 , srv50238921:90 , srv582503288:90 , srv622830875:90 , srv668073336:90 , srv715993040:90 , srv832681895:90 , srv867105795:90 , srv88423735:90 }
2023-10-27 18:57:31,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-27 18:57:31,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv332487501=16, srv582503288=23, srv1692914782=7, srv431569571=20, srv10808585=0, srv1546657411=6, srv715993040=26, srv389058203=19, srv50238921=22, srv88423735=29, srv622830875=24, srv832681895=27, srv1830171919=11, srv1805772053=10, srv1534153942=5, srv200586862=14, srv1916296140=13, srv1773229854=8, srv372194030=18, srv1220782474=3, srv1335380269=4, srv353629971=17, srv1098945651=1, srv1784837879=9, srv1855131167=12, srv867105795=28, srv668073336=25, srv496598359=21, srv1162378179=2, srv264095281=15} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-27 18:57:31,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-27 18:57:31,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-27 18:57:31,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-27 18:57:31,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-27 18:57:31,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-27 18:57:31,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-27 18:57:31,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-27 18:57:31,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-27 18:57:31,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-27 18:57:31,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-27 18:57:31,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-27 18:57:31,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-27 18:57:31,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-27 18:57:31,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-27 18:57:31,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-27 18:57:31,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-27 18:57:31,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-27 18:57:31,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-27 18:57:31,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-27 18:57:31,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-27 18:57:31,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-27 18:57:31,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-27 18:57:31,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-27 18:57:31,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-27 18:57:31,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-27 18:57:31,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-27 18:57:31,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-27 18:57:31,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-27 18:57:31,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-27 18:57:31,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-27 18:57:31,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-10-27 18:57:31,499 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-27 18:57:31,499 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv10808585:90 , srv1098945651:90 , srv1162378179:90 , srv1220782474:90 , srv1335380269:90 , srv1534153942:90 , srv1546657411:90 , srv1692914782:90 , srv1773229854:90 , srv1784837879:90 , srv1805772053:90 , srv1830171919:90 , srv1855131167:90 , srv1916296140:90 , srv200586862:90 , srv264095281:90 , srv332487501:90 , srv353629971:90 , srv372194030:90 , srv389058203:90 , srv431569571:90 , srv496598359:90 , srv50238921:90 , srv582503288:90 , srv622830875:90 , srv668073336:90 , srv715993040:90 , srv832681895:90 , srv867105795:90 , srv88423735:90 }
2023-10-27 18:57:31,512 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=169 (was 152) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 170), AvailableMemoryMB=8366 (was 8342) - AvailableMemoryMB LEAK? -