2024-04-17 03:55:25,442 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2024-04-17 03:55:25,690 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2024-04-17 03:55:25,796 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2024-04-17 03:55:25,850 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-04-17 03:55:25,856 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-04-17 03:55:25,869 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=122, ProcessCount=179, AvailableMemoryMB=2471
2024-04-17 03:55:25,871 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-04-17 03:55:25,871 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-04-17 03:55:25,981 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1012067949:84 , srv1016595853:84 , srv1022703745:84 , srv1033344414:84 , srv1077380974:84 , srv1084538334:84 , srv1111100081:84 , srv1111526221:84 , srv1117229690:84 , srv1142936144:84 , srv118791802:84 , srv1193277038:84 , srv1216695141:84 , srv1222437609:84 , srv1269045105:84 , srv1269409679:84 , srv1333375966:84 , srv1342157602:84 , srv1350687113:84 , srv1460978551:84 , srv150461055:84 , srv1544455869:84 , srv1556045272:84 , srv1573542477:84 , srv1578348960:84 , srv1592496251:84 , srv162839981:84 , srv1636058370:84 , srv1654028599:84 , srv1667807173:84 , srv1671719096:84 , srv1682173082:84 , srv1688374455:84 , srv1695374689:84 , srv1711993885:84 , srv1717193144:84 , srv1728924058:84 , srv1765839506:84 , srv1847351242:84 , srv1853053383:84 , srv1862021687:84 , srv1867797967:84 , srv1868903297:84 , srv1888006473:84 , srv1890410104:84 , srv189874114:84 , srv1905192356:84 , srv1947591679:84 , srv1954762314:84 , srv1955472336:84 , srv2002886801:84 , srv201021496:84 , srv2022181996:84 , srv2033492828:84 , srv2036358657:84 , srv2039641050:84 , srv20524680:84 , srv205385523:84 , srv2056979475:84 , srv206004858:84 , srv2062098736:84 , srv2073401217:84 , srv2076157460:84 , srv2084232031:84 , srv2085275388:84 , srv2096570451:84 , srv258072912:84 , srv335851397:84 , srv33610956:84 , srv375184597:84 , srv394625797:84 , srv410866116:84 , srv419113580:84 , srv481404922:84 , srv514654981:84 , srv522111761:84 , srv526649839:84 , srv529025109:84 , srv55427877:84 , srv558836778:84 , srv584579206:84 , srv589176928:84 , srv600309626:84 , srv608683709:84 , srv637237539:84 , srv672655874:84 , srv731147622:84 , srv734941457:84 , srv736310621:84 , srv771745466:84 , srv793130651:84 , srv805168008:84 , srv841201639:84 , srv864612963:84 , srv877691072:84 , srv8882013:84 , srv888625974:84 , srv939380009:84 , srv964297242:84 , srv941871598:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2024-04-17 03:55:25,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-17 03:55:25,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv805168008=91, srv1111100081=6, srv335851397=67, srv771745466=89, srv1717193144=35, srv600309626=82, srv1905192356=46, srv736310621=88, srv1695374689=33, srv1867797967=41, srv419113580=72, srv1022703745=2, srv1269409679=15, srv8882013=95, srv2036358657=54, srv1636058370=27, srv589176928=81, srv1084538334=5, srv841201639=92, srv201021496=51, srv1728924058=36, srv558836778=79, srv1688374455=32, srv2002886801=50, srv793130651=90, srv1193277038=11, srv888625974=96, srv55427877=78, srv964297242=99, srv410866116=71, srv33610956=68, srv1544455869=21, srv481404922=73, srv529025109=77, srv734941457=87, srv1460978551=19, srv118791802=10, srv1111526221=7, srv2062098736=60, srv1711993885=34, srv1333375966=16, srv258072912=66, srv637237539=84, srv864612963=93, srv1117229690=8, srv375184597=69, srv2085275388=64, srv1016595853=1, srv1142936144=9, srv608683709=83, srv1947591679=47, srv206004858=59, srv2084232031=63, srv1853053383=39, srv1077380974=4, srv2056979475=58, srv1578348960=24, srv2073401217=61, srv941871598=98, srv1654028599=28, srv1862021687=40, srv20524680=56, srv1667807173=29, srv2076157460=62, srv1868903297=42, srv731147622=86, srv1955472336=49, srv526649839=76, srv1954762314=48, srv1592496251=25, srv1765839506=37, srv1033344414=3, srv1350687113=18, srv1216695141=12, srv2096570451=65, srv1682173082=31, srv1573542477=23, srv1847351242=38, srv672655874=85, srv1890410104=44, srv514654981=74, srv1556045272=22, srv877691072=94, srv205385523=57, srv2039641050=55, srv1888006473=43, srv2033492828=53, srv584579206=80, srv1222437609=13, srv150461055=20, srv522111761=75, srv162839981=26, srv2022181996=52, srv1269045105=14, srv394625797=70, srv1342157602=17, srv1012067949=0, srv189874114=45, srv939380009=97, srv1671719096=30} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-17 03:55:26,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-17 03:55:26,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-17 03:55:26,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-17 03:55:26,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-17 03:55:26,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-17 03:55:26,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-17 03:55:26,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-17 03:55:26,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-17 03:55:26,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-17 03:55:26,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-17 03:55:26,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-17 03:55:26,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-17 03:55:26,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-17 03:55:26,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-17 03:55:26,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-17 03:55:26,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-17 03:55:26,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-17 03:55:26,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-17 03:55:26,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-17 03:55:26,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-17 03:55:26,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-17 03:55:26,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-17 03:55:26,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-17 03:55:26,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-17 03:55:26,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-17 03:55:26,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-17 03:55:26,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-17 03:55:26,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-17 03:55:26,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-17 03:55:26,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-17 03:55:26,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-17 03:55:26,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-17 03:55:26,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-17 03:55:26,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-17 03:55:26,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-17 03:55:26,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-17 03:55:26,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-17 03:55:26,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-17 03:55:26,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-17 03:55:26,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-17 03:55:26,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-17 03:55:26,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-17 03:55:26,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-17 03:55:26,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-17 03:55:26,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-17 03:55:26,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-17 03:55:26,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-17 03:55:26,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-17 03:55:26,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-17 03:55:26,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-17 03:55:26,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-17 03:55:26,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-17 03:55:26,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-17 03:55:26,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-17 03:55:26,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-17 03:55:26,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-17 03:55:26,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-17 03:55:26,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-17 03:55:26,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-17 03:55:26,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-17 03:55:26,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-17 03:55:26,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-17 03:55:26,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-17 03:55:26,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-17 03:55:26,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-17 03:55:26,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-17 03:55:26,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-17 03:55:26,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-17 03:55:26,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-17 03:55:26,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-17 03:55:26,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-17 03:55:26,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-17 03:55:26,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-17 03:55:26,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-17 03:55:26,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-17 03:55:26,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-17 03:55:26,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-17 03:55:26,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-17 03:55:26,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-17 03:55:26,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-17 03:55:26,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-17 03:55:26,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-17 03:55:26,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-17 03:55:26,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-17 03:55:26,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-17 03:55:26,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-17 03:55:26,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-17 03:55:26,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-17 03:55:26,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-17 03:55:26,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-17 03:55:26,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-17 03:55:26,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-17 03:55:26,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-17 03:55:26,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-17 03:55:26,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-17 03:55:26,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-17 03:55:26,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-17 03:55:26,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-17 03:55:26,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-17 03:55:26,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-17 03:55:26,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-17 03:55:26,225 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-17 03:55:26,226 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-04-17 03:55:26,226 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-04-17 03:55:26,620 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 525 ms to try 5000 different iterations.  Found a solution that moves 4668 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17853498981490123. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03991104962013365, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.057295970912694054, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5186666666666667, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03991104962013365, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17375, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24025, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-17 03:55:26,642 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv589176928:82 , srv1012067949:83 , srv2062098736:83 , srv335851397:83 , srv419113580:83 , srv1269045105:84 , srv1333375966:84 , srv1342157602:84 , srv1695374689:84 , srv1711993885:84 , srv1717193144:84 , srv1728924058:84 , srv1853053383:84 , srv189874114:84 , srv201021496:84 , srv205385523:84 , srv2073401217:84 , srv600309626:84 , srv805168008:84 , srv888625974:84 , srv1084538334:85 , srv1222437609:85 , srv1269409679:85 , srv1592496251:85 , srv1654028599:85 , srv1671719096:85 , srv1955472336:85 , srv2002886801:85 , srv2036358657:85 , srv2084232031:85 , srv2085275388:85 , srv522111761:85 , srv736310621:85 , srv793130651:85 , srv841201639:85 , srv1033344414:86 , srv1111526221:86 , srv1350687113:86 , srv1460978551:86 , srv1573542477:86 , srv162839981:86 , srv1667807173:86 , srv1862021687:86 , srv1890410104:86 , srv1954762314:86 , srv20524680:86 , srv258072912:86 , srv514654981:86 , srv734941457:86 , srv877691072:86 , srv1077380974:87 , srv1117229690:87 , srv118791802:87 , srv1216695141:87 , srv150461055:87 , srv1578348960:87 , srv1682173082:87 , srv1688374455:87 , srv1847351242:87 , srv1868903297:87 , srv1905192356:87 , srv2033492828:87 , srv2056979475:87 , srv2076157460:87 , srv529025109:87 , srv558836778:87 , srv584579206:87 , srv672655874:87 , srv771745466:87 , srv8882013:87 , srv1016595853:88 , srv1022703745:88 , srv1556045272:88 , srv1636058370:88 , srv1888006473:88 , srv2022181996:88 , srv2039641050:88 , srv206004858:88 , srv33610956:88 , srv410866116:88 , srv481404922:88 , srv526649839:88 , srv637237539:88 , srv731147622:88 , srv864612963:88 , srv939380009:88 , srv964297242:88 , srv1142936144:89 , srv1193277038:89 , srv1765839506:89 , srv1867797967:89 , srv1947591679:89 , srv394625797:89 , srv55427877:89 , srv608683709:89 , srv375184597:90 , srv1111100081:91 , srv1544455869:91 , srv2096570451:96 , srv941871598:445 }
2024-04-17 03:55:26,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-17 03:55:26,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv805168008=91, srv1111100081=6, srv335851397=67, srv771745466=89, srv1717193144=35, srv600309626=82, srv1905192356=46, srv736310621=88, srv1695374689=33, srv1867797967=41, srv419113580=72, srv1022703745=2, srv1269409679=15, srv8882013=95, srv2036358657=54, srv1636058370=27, srv589176928=81, srv1084538334=5, srv841201639=92, srv201021496=51, srv1728924058=36, srv558836778=79, srv1688374455=32, srv2002886801=50, srv793130651=90, srv1193277038=11, srv888625974=96, srv55427877=78, srv964297242=99, srv410866116=71, srv33610956=68, srv1544455869=21, srv481404922=73, srv529025109=77, srv734941457=87, srv1460978551=19, srv118791802=10, srv1111526221=7, srv2062098736=60, srv1711993885=34, srv1333375966=16, srv258072912=66, srv637237539=84, srv864612963=93, srv1117229690=8, srv375184597=69, srv2085275388=64, srv1016595853=1, srv1142936144=9, srv608683709=83, srv1947591679=47, srv206004858=59, srv2084232031=63, srv1853053383=39, srv1077380974=4, srv2056979475=58, srv1578348960=24, srv2073401217=61, srv941871598=98, srv1654028599=28, srv1862021687=40, srv20524680=56, srv1667807173=29, srv2076157460=62, srv1868903297=42, srv731147622=86, srv1955472336=49, srv526649839=76, srv1954762314=48, srv1592496251=25, srv1765839506=37, srv1033344414=3, srv1350687113=18, srv1216695141=12, srv2096570451=65, srv1682173082=31, srv1573542477=23, srv1847351242=38, srv672655874=85, srv1890410104=44, srv514654981=74, srv1556045272=22, srv877691072=94, srv205385523=57, srv2039641050=55, srv1888006473=43, srv2033492828=53, srv584579206=80, srv1222437609=13, srv150461055=20, srv522111761=75, srv162839981=26, srv2022181996=52, srv1269045105=14, srv394625797=70, srv1342157602=17, srv1012067949=0, srv189874114=45, srv939380009=97, srv1671719096=30} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-17 03:55:26,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-17 03:55:26,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-17 03:55:26,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-17 03:55:26,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-17 03:55:26,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-17 03:55:26,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-17 03:55:26,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-17 03:55:26,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-17 03:55:26,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-17 03:55:26,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-17 03:55:26,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-17 03:55:26,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-17 03:55:26,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-17 03:55:26,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-17 03:55:26,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-17 03:55:26,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-17 03:55:26,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-17 03:55:26,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-17 03:55:26,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-17 03:55:26,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-17 03:55:26,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-17 03:55:26,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-17 03:55:26,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-17 03:55:26,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-17 03:55:26,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-17 03:55:26,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-17 03:55:26,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-17 03:55:26,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-17 03:55:26,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-17 03:55:26,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-17 03:55:26,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-17 03:55:26,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-17 03:55:26,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-17 03:55:26,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-17 03:55:26,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-17 03:55:26,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-17 03:55:26,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-17 03:55:26,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-17 03:55:26,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-17 03:55:26,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-17 03:55:26,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-17 03:55:26,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-17 03:55:26,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-17 03:55:26,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-17 03:55:26,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-17 03:55:26,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-17 03:55:26,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-17 03:55:26,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-17 03:55:26,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-17 03:55:26,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-17 03:55:26,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-17 03:55:26,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-17 03:55:26,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-17 03:55:26,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-17 03:55:26,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-17 03:55:26,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-17 03:55:26,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-17 03:55:26,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-17 03:55:26,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-17 03:55:26,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-17 03:55:26,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-17 03:55:26,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-17 03:55:26,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-17 03:55:26,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-17 03:55:26,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-17 03:55:26,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-17 03:55:26,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-17 03:55:26,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-17 03:55:26,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-17 03:55:26,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-17 03:55:26,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-17 03:55:26,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-17 03:55:26,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-17 03:55:26,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-17 03:55:26,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-17 03:55:26,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-17 03:55:26,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-17 03:55:26,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-17 03:55:26,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-17 03:55:26,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-17 03:55:26,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-17 03:55:26,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-17 03:55:26,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-17 03:55:26,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-17 03:55:26,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-17 03:55:26,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-17 03:55:26,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-17 03:55:26,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-17 03:55:26,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-17 03:55:26,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-17 03:55:26,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-17 03:55:26,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-17 03:55:26,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-17 03:55:26,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-17 03:55:26,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-17 03:55:26,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-17 03:55:26,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-17 03:55:26,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-17 03:55:26,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-17 03:55:26,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-17 03:55:26,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-17 03:55:26,778 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03991104962013365, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.057295970912694054, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03991104962013365, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17375, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24025, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-17 03:55:26,778 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-04-17 03:55:26,778 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.1785023037802886, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03991104962013365, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.057295970912694054, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03991104962013365, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17375, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24025, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-04-17 03:55:26,952 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 254 ms to try 5000 different iterations.  Found a solution that moves 2633 regions; Going from a computed imbalance of 0.1785023037802886 to a new imbalance of 0.014643702659420173. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022283305498805854); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.036884872605995184, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29255555555555557, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022283305498805854); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011416666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04525, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-17 03:55:26,960 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv2096570451:75 , srv1142936144:81 , srv1544455869:81 , srv206004858:81 , srv33610956:81 , srv1111100081:82 , srv1765839506:82 , srv608683709:82 , srv672655874:82 , srv864612963:82 , srv1016595853:83 , srv1111526221:83 , srv1216695141:83 , srv1905192356:83 , srv1947591679:83 , srv375184597:83 , srv55427877:83 , srv584579206:83 , srv1022703745:84 , srv118791802:84 , srv1193277038:84 , srv1460978551:84 , srv1556045272:84 , srv1682173082:84 , srv1688374455:84 , srv1847351242:84 , srv1954762314:84 , srv2022181996:84 , srv394625797:84 , srv481404922:84 , srv637237539:84 , srv731147622:84 , srv1033344414:85 , srv1077380974:85 , srv162839981:85 , srv1888006473:85 , srv2036358657:85 , srv20524680:85 , srv2076157460:85 , srv2084232031:85 , srv410866116:85 , srv526649839:85 , srv558836778:85 , srv771745466:85 , srv793130651:85 , srv877691072:85 , srv8882013:85 , srv939380009:85 , srv964297242:85 , srv1117229690:86 , srv150461055:86 , srv1578348960:86 , srv1667807173:86 , srv1711993885:86 , srv1867797967:86 , srv1868903297:86 , srv1890410104:86 , srv189874114:86 , srv2002886801:86 , srv2039641050:86 , srv2056979475:86 , srv2085275388:86 , srv419113580:86 , srv514654981:86 , srv734941457:86 , srv1269045105:87 , srv1269409679:87 , srv1333375966:87 , srv1350687113:87 , srv1573542477:87 , srv1592496251:87 , srv1654028599:87 , srv1853053383:87 , srv1862021687:87 , srv2033492828:87 , srv258072912:87 , srv522111761:87 , srv529025109:87 , srv736310621:87 , srv888625974:87 , srv1084538334:88 , srv1222437609:88 , srv1636058370:88 , srv201021496:88 , srv600309626:88 , srv841201639:88 , srv1695374689:89 , srv1955472336:89 , srv205385523:89 , srv2073401217:89 , srv1342157602:90 , srv1671719096:90 , srv1717193144:90 , srv2062098736:90 , srv335851397:90 , srv1012067949:91 , srv1728924058:91 , srv589176928:91 , srv805168008:91 , srv941871598:527 }
2024-04-17 03:55:26,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-17 03:55:26,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv805168008=91, srv1111100081=6, srv335851397=67, srv771745466=89, srv1717193144=35, srv600309626=82, srv1905192356=46, srv736310621=88, srv1695374689=33, srv1867797967=41, srv419113580=72, srv1022703745=2, srv1269409679=15, srv8882013=95, srv2036358657=54, srv1636058370=27, srv589176928=81, srv1084538334=5, srv841201639=92, srv201021496=51, srv1728924058=36, srv558836778=79, srv1688374455=32, srv2002886801=50, srv793130651=90, srv1193277038=11, srv888625974=96, srv55427877=78, srv964297242=99, srv410866116=71, srv33610956=68, srv1544455869=21, srv481404922=73, srv529025109=77, srv734941457=87, srv1460978551=19, srv118791802=10, srv1111526221=7, srv2062098736=60, srv1711993885=34, srv1333375966=16, srv258072912=66, srv637237539=84, srv864612963=93, srv1117229690=8, srv375184597=69, srv2085275388=64, srv1016595853=1, srv1142936144=9, srv608683709=83, srv1947591679=47, srv206004858=59, srv2084232031=63, srv1853053383=39, srv1077380974=4, srv2056979475=58, srv1578348960=24, srv2073401217=61, srv941871598=98, srv1654028599=28, srv1862021687=40, srv20524680=56, srv1667807173=29, srv2076157460=62, srv1868903297=42, srv731147622=86, srv1955472336=49, srv526649839=76, srv1954762314=48, srv1592496251=25, srv1765839506=37, srv1033344414=3, srv1350687113=18, srv1216695141=12, srv2096570451=65, srv1682173082=31, srv1573542477=23, srv1847351242=38, srv672655874=85, srv1890410104=44, srv514654981=74, srv1556045272=22, srv877691072=94, srv205385523=57, srv2039641050=55, srv1888006473=43, srv2033492828=53, srv584579206=80, srv1222437609=13, srv150461055=20, srv522111761=75, srv162839981=26, srv2022181996=52, srv1269045105=14, srv394625797=70, srv1342157602=17, srv1012067949=0, srv189874114=45, srv939380009=97, srv1671719096=30} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-17 03:55:26,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-17 03:55:26,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-17 03:55:26,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-17 03:55:26,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-17 03:55:26,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-17 03:55:26,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-17 03:55:26,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-17 03:55:26,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-17 03:55:26,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-17 03:55:26,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-17 03:55:26,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-17 03:55:26,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-17 03:55:26,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-17 03:55:26,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-17 03:55:26,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-17 03:55:26,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-17 03:55:26,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-17 03:55:26,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-17 03:55:26,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-17 03:55:26,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-17 03:55:26,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-17 03:55:26,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-17 03:55:26,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-17 03:55:26,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-17 03:55:26,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-17 03:55:26,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-17 03:55:26,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-17 03:55:26,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-17 03:55:26,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-17 03:55:26,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-17 03:55:26,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-17 03:55:26,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-17 03:55:26,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-17 03:55:26,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-17 03:55:26,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-17 03:55:26,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-17 03:55:26,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-17 03:55:26,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-17 03:55:26,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-17 03:55:26,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-17 03:55:26,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-17 03:55:26,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-17 03:55:26,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-17 03:55:26,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-17 03:55:26,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-17 03:55:26,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-17 03:55:26,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-17 03:55:26,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-17 03:55:26,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-17 03:55:26,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-17 03:55:26,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-17 03:55:26,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-17 03:55:26,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-17 03:55:26,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-17 03:55:26,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-17 03:55:26,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-17 03:55:26,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-17 03:55:26,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-17 03:55:26,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-17 03:55:26,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-17 03:55:26,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-17 03:55:26,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-17 03:55:26,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-17 03:55:26,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-17 03:55:26,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-17 03:55:26,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-17 03:55:26,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-17 03:55:26,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-17 03:55:26,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-17 03:55:26,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-17 03:55:26,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-17 03:55:26,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-17 03:55:26,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-17 03:55:26,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-17 03:55:26,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-17 03:55:26,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-17 03:55:26,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-17 03:55:26,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-17 03:55:26,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-17 03:55:26,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-17 03:55:26,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-17 03:55:26,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-17 03:55:26,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-17 03:55:26,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-17 03:55:26,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-17 03:55:26,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-17 03:55:26,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-17 03:55:26,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-17 03:55:26,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-17 03:55:26,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-17 03:55:26,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-17 03:55:26,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-17 03:55:26,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-17 03:55:26,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-17 03:55:26,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-17 03:55:26,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-17 03:55:26,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-17 03:55:26,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-17 03:55:26,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-17 03:55:26,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-17 03:55:26,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-17 03:55:27,064 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022283305498805854); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.036884872605995184, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022283305498805854); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011416666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04525, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-17 03:55:27,064 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-04-17 03:55:27,065 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.014625265999365533, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022283305498805854); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.036884872605995184, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022283305498805854); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011416666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04525, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-04-17 03:55:27,221 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 229 ms to try 5000 different iterations.  Found a solution that moves 995 regions; Going from a computed imbalance of 0.014625265999365533 to a new imbalance of 6.245191189367381E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008365631386949046); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.013240416986458873); MoveCostFunction : (multiplier=7.0, imbalance=0.11055555555555556, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.008365631386949046); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004916666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-17 03:55:27,222 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1636058370:81 , srv1671719096:81 , srv1717193144:82 , srv1728924058:82 , srv1342157602:83 , srv1578348960:83 , srv1955472336:83 , srv2033492828:83 , srv2039641050:83 , srv335851397:83 , srv526649839:83 , srv805168008:83 , srv939380009:83 , srv1012067949:84 , srv1022703745:84 , srv1111100081:84 , srv1117229690:84 , srv1193277038:84 , srv1350687113:84 , srv150461055:84 , srv1862021687:84 , srv1867797967:84 , srv1888006473:84 , srv201021496:84 , srv2062098736:84 , srv2073401217:84 , srv394625797:84 , srv410866116:84 , srv514654981:84 , srv841201639:84 , srv964297242:84 , srv1084538334:85 , srv1222437609:85 , srv1269409679:85 , srv1544455869:85 , srv1556045272:85 , srv1573542477:85 , srv1592496251:85 , srv162839981:85 , srv1654028599:85 , srv1695374689:85 , srv1847351242:85 , srv1868903297:85 , srv1947591679:85 , srv205385523:85 , srv2056979475:85 , srv258072912:85 , srv522111761:85 , srv589176928:85 , srv637237539:85 , srv771745466:85 , srv8882013:85 , srv888625974:85 , srv1033344414:86 , srv1077380974:86 , srv118791802:86 , srv1216695141:86 , srv1667807173:86 , srv1682173082:86 , srv1688374455:86 , srv1765839506:86 , srv1853053383:86 , srv1890410104:86 , srv1905192356:86 , srv1954762314:86 , srv20524680:86 , srv2076157460:86 , srv2084232031:86 , srv2085275388:86 , srv481404922:86 , srv529025109:86 , srv55427877:86 , srv558836778:86 , srv584579206:86 , srv600309626:86 , srv608683709:86 , srv731147622:86 , srv734941457:86 , srv736310621:86 , srv1111526221:87 , srv1269045105:87 , srv1333375966:87 , srv1711993885:87 , srv189874114:87 , srv2002886801:87 , srv2022181996:87 , srv2036358657:87 , srv206004858:87 , srv2096570451:87 , srv375184597:87 , srv793130651:87 , srv877691072:87 , srv1142936144:88 , srv1460978551:88 , srv33610956:88 , srv419113580:88 , srv672655874:88 , srv1016595853:89 , srv864612963:89 , srv941871598:560 }
2024-04-17 03:55:27,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-17 03:55:27,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv805168008=91, srv1111100081=6, srv335851397=67, srv771745466=89, srv1717193144=35, srv600309626=82, srv1905192356=46, srv736310621=88, srv1695374689=33, srv1867797967=41, srv419113580=72, srv1022703745=2, srv1269409679=15, srv8882013=95, srv2036358657=54, srv1636058370=27, srv589176928=81, srv1084538334=5, srv841201639=92, srv201021496=51, srv1728924058=36, srv558836778=79, srv1688374455=32, srv2002886801=50, srv793130651=90, srv1193277038=11, srv888625974=96, srv55427877=78, srv964297242=99, srv410866116=71, srv33610956=68, srv1544455869=21, srv481404922=73, srv529025109=77, srv734941457=87, srv1460978551=19, srv118791802=10, srv1111526221=7, srv2062098736=60, srv1711993885=34, srv1333375966=16, srv258072912=66, srv637237539=84, srv864612963=93, srv1117229690=8, srv375184597=69, srv2085275388=64, srv1016595853=1, srv1142936144=9, srv608683709=83, srv1947591679=47, srv206004858=59, srv2084232031=63, srv1853053383=39, srv1077380974=4, srv2056979475=58, srv1578348960=24, srv2073401217=61, srv941871598=98, srv1654028599=28, srv1862021687=40, srv20524680=56, srv1667807173=29, srv2076157460=62, srv1868903297=42, srv731147622=86, srv1955472336=49, srv526649839=76, srv1954762314=48, srv1592496251=25, srv1765839506=37, srv1033344414=3, srv1350687113=18, srv1216695141=12, srv2096570451=65, srv1682173082=31, srv1573542477=23, srv1847351242=38, srv672655874=85, srv1890410104=44, srv514654981=74, srv1556045272=22, srv877691072=94, srv205385523=57, srv2039641050=55, srv1888006473=43, srv2033492828=53, srv584579206=80, srv1222437609=13, srv150461055=20, srv522111761=75, srv162839981=26, srv2022181996=52, srv1269045105=14, srv394625797=70, srv1342157602=17, srv1012067949=0, srv189874114=45, srv939380009=97, srv1671719096=30} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-17 03:55:27,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-17 03:55:27,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-17 03:55:27,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-17 03:55:27,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-17 03:55:27,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-17 03:55:27,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-17 03:55:27,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-17 03:55:27,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-17 03:55:27,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-17 03:55:27,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-17 03:55:27,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-17 03:55:27,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-17 03:55:27,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-17 03:55:27,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-17 03:55:27,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-17 03:55:27,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-17 03:55:27,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-17 03:55:27,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-17 03:55:27,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-17 03:55:27,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-17 03:55:27,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-17 03:55:27,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-17 03:55:27,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-17 03:55:27,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-17 03:55:27,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-17 03:55:27,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-17 03:55:27,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-17 03:55:27,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-17 03:55:27,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-17 03:55:27,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-17 03:55:27,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-17 03:55:27,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-17 03:55:27,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-17 03:55:27,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-17 03:55:27,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-17 03:55:27,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-17 03:55:27,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-17 03:55:27,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-17 03:55:27,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-17 03:55:27,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-17 03:55:27,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-17 03:55:27,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-17 03:55:27,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-17 03:55:27,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-17 03:55:27,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-17 03:55:27,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-17 03:55:27,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-17 03:55:27,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-17 03:55:27,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-17 03:55:27,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-17 03:55:27,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-17 03:55:27,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-17 03:55:27,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-17 03:55:27,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-17 03:55:27,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-17 03:55:27,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-17 03:55:27,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-17 03:55:27,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-17 03:55:27,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-17 03:55:27,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-17 03:55:27,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-17 03:55:27,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-17 03:55:27,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-17 03:55:27,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-17 03:55:27,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-17 03:55:27,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-17 03:55:27,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-17 03:55:27,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-17 03:55:27,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-17 03:55:27,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-17 03:55:27,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-17 03:55:27,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-17 03:55:27,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-17 03:55:27,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-17 03:55:27,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-17 03:55:27,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-17 03:55:27,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-17 03:55:27,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-17 03:55:27,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-17 03:55:27,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-17 03:55:27,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-17 03:55:27,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-17 03:55:27,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-17 03:55:27,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-17 03:55:27,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-17 03:55:27,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-17 03:55:27,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-17 03:55:27,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-17 03:55:27,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-17 03:55:27,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-17 03:55:27,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-17 03:55:27,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-17 03:55:27,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-17 03:55:27,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-17 03:55:27,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-17 03:55:27,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-17 03:55:27,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-17 03:55:27,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-17 03:55:27,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-17 03:55:27,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-17 03:55:27,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-17 03:55:27,320 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008365631386949046); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.013240416986458873); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.008365631386949046); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004916666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-17 03:55:27,320 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-04-17 03:55:27,320 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=6.175519800250924E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008365631386949046); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.013240416986458873); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.008365631386949046); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004916666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-04-17 03:55:27,531 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 283 ms to try 5000 different iterations.  Found a solution that moves 302 regions; Going from a computed imbalance of 6.175519800250924E-4 to a new imbalance of 3.8018832097778214E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0024158102511315956); MoveCostFunction : (multiplier=7.0, imbalance=0.033555555555555554, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-17 03:55:27,532 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1016595853:81 , srv375184597:82 , srv529025109:82 , srv1867797967:83 , srv2002886801:83 , srv2022181996:83 , srv558836778:83 , srv864612963:83 , srv877691072:83 , srv1084538334:84 , srv1142936144:84 , srv118791802:84 , srv1222437609:84 , srv1269045105:84 , srv1333375966:84 , srv1460978551:84 , srv1573542477:84 , srv1667807173:84 , srv1695374689:84 , srv1728924058:84 , srv1890410104:84 , srv2039641050:84 , srv2056979475:84 , srv2076157460:84 , srv2096570451:84 , srv258072912:84 , srv55427877:84 , srv589176928:84 , srv600309626:84 , srv731147622:84 , srv734941457:84 , srv736310621:84 , srv793130651:84 , srv805168008:84 , srv1012067949:85 , srv1077380974:85 , srv1111100081:85 , srv1117229690:85 , srv1193277038:85 , srv1269409679:85 , srv1342157602:85 , srv150461055:85 , srv1544455869:85 , srv1556045272:85 , srv1592496251:85 , srv1636058370:85 , srv1682173082:85 , srv1688374455:85 , srv1711993885:85 , srv1765839506:85 , srv1853053383:85 , srv1862021687:85 , srv1868903297:85 , srv1888006473:85 , srv189874114:85 , srv1905192356:85 , srv1947591679:85 , srv1954762314:85 , srv1955472336:85 , srv2033492828:85 , srv2036358657:85 , srv205385523:85 , srv2062098736:85 , srv2073401217:85 , srv2085275388:85 , srv335851397:85 , srv33610956:85 , srv394625797:85 , srv410866116:85 , srv419113580:85 , srv481404922:85 , srv522111761:85 , srv637237539:85 , srv672655874:85 , srv771745466:85 , srv841201639:85 , srv8882013:85 , srv964297242:85 , srv1022703745:86 , srv1033344414:86 , srv1111526221:86 , srv1216695141:86 , srv1350687113:86 , srv1578348960:86 , srv162839981:86 , srv1654028599:86 , srv1671719096:86 , srv1717193144:86 , srv1847351242:86 , srv201021496:86 , srv20524680:86 , srv206004858:86 , srv2084232031:86 , srv514654981:86 , srv526649839:86 , srv584579206:86 , srv608683709:86 , srv888625974:86 , srv939380009:87 , srv941871598:610 }
2024-04-17 03:55:27,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-17 03:55:27,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv805168008=91, srv1111100081=6, srv335851397=67, srv771745466=89, srv1717193144=35, srv600309626=82, srv1905192356=46, srv736310621=88, srv1695374689=33, srv1867797967=41, srv419113580=72, srv1022703745=2, srv1269409679=15, srv8882013=95, srv2036358657=54, srv1636058370=27, srv589176928=81, srv1084538334=5, srv841201639=92, srv201021496=51, srv1728924058=36, srv558836778=79, srv1688374455=32, srv2002886801=50, srv793130651=90, srv1193277038=11, srv888625974=96, srv55427877=78, srv964297242=99, srv410866116=71, srv33610956=68, srv1544455869=21, srv481404922=73, srv529025109=77, srv734941457=87, srv1460978551=19, srv118791802=10, srv1111526221=7, srv2062098736=60, srv1711993885=34, srv1333375966=16, srv258072912=66, srv637237539=84, srv864612963=93, srv1117229690=8, srv375184597=69, srv2085275388=64, srv1016595853=1, srv1142936144=9, srv608683709=83, srv1947591679=47, srv206004858=59, srv2084232031=63, srv1853053383=39, srv1077380974=4, srv2056979475=58, srv1578348960=24, srv2073401217=61, srv941871598=98, srv1654028599=28, srv1862021687=40, srv20524680=56, srv1667807173=29, srv2076157460=62, srv1868903297=42, srv731147622=86, srv1955472336=49, srv526649839=76, srv1954762314=48, srv1592496251=25, srv1765839506=37, srv1033344414=3, srv1350687113=18, srv1216695141=12, srv2096570451=65, srv1682173082=31, srv1573542477=23, srv1847351242=38, srv672655874=85, srv1890410104=44, srv514654981=74, srv1556045272=22, srv877691072=94, srv205385523=57, srv2039641050=55, srv1888006473=43, srv2033492828=53, srv584579206=80, srv1222437609=13, srv150461055=20, srv522111761=75, srv162839981=26, srv2022181996=52, srv1269045105=14, srv394625797=70, srv1342157602=17, srv1012067949=0, srv189874114=45, srv939380009=97, srv1671719096=30} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-17 03:55:27,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-17 03:55:27,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-17 03:55:27,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-17 03:55:27,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-17 03:55:27,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-17 03:55:27,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-17 03:55:27,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-17 03:55:27,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-17 03:55:27,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-17 03:55:27,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-17 03:55:27,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-17 03:55:27,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-17 03:55:27,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-17 03:55:27,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-17 03:55:27,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-17 03:55:27,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-17 03:55:27,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-17 03:55:27,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-17 03:55:27,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-17 03:55:27,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-17 03:55:27,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-17 03:55:27,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-17 03:55:27,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-17 03:55:27,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-17 03:55:27,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-17 03:55:27,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-17 03:55:27,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-17 03:55:27,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-17 03:55:27,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-17 03:55:27,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-17 03:55:27,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-17 03:55:27,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-17 03:55:27,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-17 03:55:27,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-17 03:55:27,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-17 03:55:27,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-17 03:55:27,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-17 03:55:27,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-17 03:55:27,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-17 03:55:27,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-17 03:55:27,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-17 03:55:27,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-17 03:55:27,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-17 03:55:27,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-17 03:55:27,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-17 03:55:27,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-17 03:55:27,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-17 03:55:27,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-17 03:55:27,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-17 03:55:27,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-17 03:55:27,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-17 03:55:27,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-17 03:55:27,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-17 03:55:27,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-17 03:55:27,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-17 03:55:27,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-17 03:55:27,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-17 03:55:27,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-17 03:55:27,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-17 03:55:27,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-17 03:55:27,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-17 03:55:27,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-17 03:55:27,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-17 03:55:27,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-17 03:55:27,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-17 03:55:27,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-17 03:55:27,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-17 03:55:27,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-17 03:55:27,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-17 03:55:27,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-17 03:55:27,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-17 03:55:27,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-17 03:55:27,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-17 03:55:27,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-17 03:55:27,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-17 03:55:27,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-17 03:55:27,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-17 03:55:27,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-17 03:55:27,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-17 03:55:27,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-17 03:55:27,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-17 03:55:27,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-17 03:55:27,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-17 03:55:27,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-17 03:55:27,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-17 03:55:27,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-17 03:55:27,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-17 03:55:27,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-17 03:55:27,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-17 03:55:27,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-17 03:55:27,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-17 03:55:27,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-17 03:55:27,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-17 03:55:27,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-17 03:55:27,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-17 03:55:27,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-17 03:55:27,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-17 03:55:27,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-17 03:55:27,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-17 03:55:27,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-17 03:55:27,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-17 03:55:27,633 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0024158102511315956); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-17 03:55:27,633 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-04-17 03:55:27,633 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=3.5904182900474646E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0024158102511315956); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-04-17 03:55:27,786 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 225 ms to try 5000 different iterations.  Found a solution that moves 44 regions; Going from a computed imbalance of 3.5904182900474646E-5 to a new imbalance of 6.706080257307306E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014213381090374027); MoveCostFunction : (multiplier=7.0, imbalance=0.004888888888888889); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-17 03:55:27,786 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1012067949:83 , srv1033344414:83 , srv1077380974:83 , srv1350687113:83 , srv1654028599:83 , srv1868903297:83 , srv20524680:83 , srv205385523:83 , srv481404922:83 , srv608683709:83 , srv939380009:83 , srv1022703745:84 , srv1084538334:84 , srv1111100081:84 , srv1111526221:84 , srv1117229690:84 , srv1142936144:84 , srv1193277038:84 , srv1216695141:84 , srv1222437609:84 , srv1269045105:84 , srv1269409679:84 , srv1333375966:84 , srv1342157602:84 , srv1460978551:84 , srv150461055:84 , srv1544455869:84 , srv1556045272:84 , srv1573542477:84 , srv1578348960:84 , srv1592496251:84 , srv162839981:84 , srv1636058370:84 , srv1667807173:84 , srv1671719096:84 , srv1682173082:84 , srv1688374455:84 , srv1695374689:84 , srv1711993885:84 , srv1717193144:84 , srv1765839506:84 , srv1847351242:84 , srv1853053383:84 , srv1862021687:84 , srv1867797967:84 , srv1888006473:84 , srv1890410104:84 , srv189874114:84 , srv1947591679:84 , srv1955472336:84 , srv201021496:84 , srv2022181996:84 , srv2033492828:84 , srv2036358657:84 , srv2056979475:84 , srv206004858:84 , srv2062098736:84 , srv2073401217:84 , srv2076157460:84 , srv2084232031:84 , srv2085275388:84 , srv2096570451:84 , srv258072912:84 , srv33610956:84 , srv375184597:84 , srv394625797:84 , srv410866116:84 , srv419113580:84 , srv514654981:84 , srv522111761:84 , srv526649839:84 , srv529025109:84 , srv55427877:84 , srv584579206:84 , srv589176928:84 , srv600309626:84 , srv637237539:84 , srv672655874:84 , srv731147622:84 , srv734941457:84 , srv736310621:84 , srv771745466:84 , srv805168008:84 , srv841201639:84 , srv864612963:84 , srv8882013:84 , srv888625974:84 , srv964297242:84 , srv1016595853:85 , srv118791802:85 , srv1728924058:85 , srv1905192356:85 , srv1954762314:85 , srv2002886801:85 , srv2039641050:85 , srv335851397:85 , srv558836778:85 , srv793130651:85 , srv877691072:85 , srv941871598:684 }
2024-04-17 03:55:27,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-17 03:55:27,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv805168008=91, srv1111100081=6, srv335851397=67, srv771745466=89, srv1717193144=35, srv600309626=82, srv1905192356=46, srv736310621=88, srv1695374689=33, srv1867797967=41, srv419113580=72, srv1022703745=2, srv1269409679=15, srv8882013=95, srv2036358657=54, srv1636058370=27, srv589176928=81, srv1084538334=5, srv841201639=92, srv201021496=51, srv1728924058=36, srv558836778=79, srv1688374455=32, srv2002886801=50, srv793130651=90, srv1193277038=11, srv888625974=96, srv55427877=78, srv964297242=99, srv410866116=71, srv33610956=68, srv1544455869=21, srv481404922=73, srv529025109=77, srv734941457=87, srv1460978551=19, srv118791802=10, srv1111526221=7, srv2062098736=60, srv1711993885=34, srv1333375966=16, srv258072912=66, srv637237539=84, srv864612963=93, srv1117229690=8, srv375184597=69, srv2085275388=64, srv1016595853=1, srv1142936144=9, srv608683709=83, srv1947591679=47, srv206004858=59, srv2084232031=63, srv1853053383=39, srv1077380974=4, srv2056979475=58, srv1578348960=24, srv2073401217=61, srv941871598=98, srv1654028599=28, srv1862021687=40, srv20524680=56, srv1667807173=29, srv2076157460=62, srv1868903297=42, srv731147622=86, srv1955472336=49, srv526649839=76, srv1954762314=48, srv1592496251=25, srv1765839506=37, srv1033344414=3, srv1350687113=18, srv1216695141=12, srv2096570451=65, srv1682173082=31, srv1573542477=23, srv1847351242=38, srv672655874=85, srv1890410104=44, srv514654981=74, srv1556045272=22, srv877691072=94, srv205385523=57, srv2039641050=55, srv1888006473=43, srv2033492828=53, srv584579206=80, srv1222437609=13, srv150461055=20, srv522111761=75, srv162839981=26, srv2022181996=52, srv1269045105=14, srv394625797=70, srv1342157602=17, srv1012067949=0, srv189874114=45, srv939380009=97, srv1671719096=30} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-17 03:55:27,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-17 03:55:27,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-17 03:55:27,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-17 03:55:27,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-17 03:55:27,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-17 03:55:27,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-17 03:55:27,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-17 03:55:27,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-17 03:55:27,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-17 03:55:27,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-17 03:55:27,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-17 03:55:27,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-17 03:55:27,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-17 03:55:27,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-17 03:55:27,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-17 03:55:27,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-17 03:55:27,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-17 03:55:27,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-17 03:55:27,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-17 03:55:27,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-17 03:55:27,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-17 03:55:27,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-17 03:55:27,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-17 03:55:27,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-17 03:55:27,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-17 03:55:27,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-17 03:55:27,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-17 03:55:27,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-17 03:55:27,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-17 03:55:27,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-17 03:55:27,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-17 03:55:27,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-17 03:55:27,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-17 03:55:27,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-17 03:55:27,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-17 03:55:27,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-17 03:55:27,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-17 03:55:27,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-17 03:55:27,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-17 03:55:27,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-17 03:55:27,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-17 03:55:27,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-17 03:55:27,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-17 03:55:27,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-17 03:55:27,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-17 03:55:27,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-17 03:55:27,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-17 03:55:27,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-17 03:55:27,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-17 03:55:27,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-17 03:55:27,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-17 03:55:27,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-17 03:55:27,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-17 03:55:27,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-17 03:55:27,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-17 03:55:27,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-17 03:55:27,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-17 03:55:27,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-17 03:55:27,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-17 03:55:27,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-17 03:55:27,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-17 03:55:27,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-17 03:55:27,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-17 03:55:27,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-17 03:55:27,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-17 03:55:27,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-17 03:55:27,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-17 03:55:27,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-17 03:55:27,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-17 03:55:27,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-17 03:55:27,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-17 03:55:27,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-17 03:55:27,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-17 03:55:27,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-17 03:55:27,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-17 03:55:27,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-17 03:55:27,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-17 03:55:27,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-17 03:55:27,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-17 03:55:27,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-17 03:55:27,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-17 03:55:27,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-17 03:55:27,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-17 03:55:27,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-17 03:55:27,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-17 03:55:27,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-17 03:55:27,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-17 03:55:27,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-17 03:55:27,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-17 03:55:27,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-17 03:55:27,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-17 03:55:27,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-17 03:55:27,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-17 03:55:27,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-17 03:55:27,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-17 03:55:27,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-17 03:55:27,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-17 03:55:27,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-17 03:55:27,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-17 03:55:27,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-17 03:55:27,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-17 03:55:27,884 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=6.397985672269699E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014213381090374027); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-17 03:55:27,884 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1012067949:83 , srv1033344414:83 , srv1077380974:83 , srv1350687113:83 , srv1654028599:83 , srv1868903297:83 , srv20524680:83 , srv205385523:83 , srv481404922:83 , srv608683709:83 , srv939380009:83 , srv1022703745:84 , srv1084538334:84 , srv1111100081:84 , srv1111526221:84 , srv1117229690:84 , srv1142936144:84 , srv1193277038:84 , srv1216695141:84 , srv1222437609:84 , srv1269045105:84 , srv1269409679:84 , srv1333375966:84 , srv1342157602:84 , srv1460978551:84 , srv150461055:84 , srv1544455869:84 , srv1556045272:84 , srv1573542477:84 , srv1578348960:84 , srv1592496251:84 , srv162839981:84 , srv1636058370:84 , srv1667807173:84 , srv1671719096:84 , srv1682173082:84 , srv1688374455:84 , srv1695374689:84 , srv1711993885:84 , srv1717193144:84 , srv1765839506:84 , srv1847351242:84 , srv1853053383:84 , srv1862021687:84 , srv1867797967:84 , srv1888006473:84 , srv1890410104:84 , srv189874114:84 , srv1947591679:84 , srv1955472336:84 , srv201021496:84 , srv2022181996:84 , srv2033492828:84 , srv2036358657:84 , srv2056979475:84 , srv206004858:84 , srv2062098736:84 , srv2073401217:84 , srv2076157460:84 , srv2084232031:84 , srv2085275388:84 , srv2096570451:84 , srv258072912:84 , srv33610956:84 , srv375184597:84 , srv394625797:84 , srv410866116:84 , srv419113580:84 , srv514654981:84 , srv522111761:84 , srv526649839:84 , srv529025109:84 , srv55427877:84 , srv584579206:84 , srv589176928:84 , srv600309626:84 , srv637237539:84 , srv672655874:84 , srv731147622:84 , srv734941457:84 , srv736310621:84 , srv771745466:84 , srv805168008:84 , srv841201639:84 , srv864612963:84 , srv8882013:84 , srv888625974:84 , srv964297242:84 , srv1016595853:85 , srv118791802:85 , srv1728924058:85 , srv1905192356:85 , srv1954762314:85 , srv2002886801:85 , srv2039641050:85 , srv335851397:85 , srv558836778:85 , srv793130651:85 , srv877691072:85 , srv941871598:684 }
2024-04-17 03:55:27,907 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=137 (was 122) - SystemLoadAverage LEAK? -, ProcessCount=179 (was 179), AvailableMemoryMB=1981 (was 2471)
2024-04-17 03:55:27,916 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=137, ProcessCount=179, AvailableMemoryMB=1981
2024-04-17 03:55:27,916 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-04-17 03:55:27,917 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2024-04-17 03:55:27,924 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1033569124:84 , srv1142554276:84 , srv1164760400:84 , srv1553330126:84 , srv1572044877:84 , srv1574075400:84 , srv16272164:84 , srv1668029830:84 , srv1710332936:84 , srv183393802:84 , srv1850654931:84 , srv1909645461:84 , srv1928250053:84 , srv200698610:84 , srv287558643:84 , srv384316202:84 , srv515722698:84 , srv537826665:84 , srv548951515:84 , srv653417019:84 , srv676318358:84 , srv69923399:84 , srv733870934:84 , srv769004186:84 , srv779447669:84 , srv805384586:84 , srv825439015:84 , srv857646477:84 , srv99044153:84 , srv1024366745:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2024-04-17 03:55:27,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-17 03:55:27,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1850654931=11, srv1909645461=12, srv769004186=24, srv805384586=26, srv16272164=7, srv69923399=22, srv653417019=20, srv676318358=21, srv99044153=29, srv548951515=19, srv384316202=16, srv1164760400=3, srv1572044877=5, srv1710332936=9, srv1574075400=6, srv183393802=10, srv200698610=14, srv1553330126=4, srv1668029830=8, srv537826665=18, srv1928250053=13, srv825439015=27, srv1024366745=0, srv1142554276=2, srv515722698=17, srv779447669=25, srv733870934=23, srv1033569124=1, srv857646477=28, srv287558643=15} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-17 03:55:27,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-17 03:55:27,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-17 03:55:27,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-17 03:55:27,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-17 03:55:27,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-17 03:55:27,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-17 03:55:27,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-17 03:55:27,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-17 03:55:27,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-17 03:55:27,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-17 03:55:27,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-17 03:55:27,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-17 03:55:27,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-17 03:55:27,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-17 03:55:27,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-17 03:55:27,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-17 03:55:27,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-17 03:55:27,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-17 03:55:27,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-17 03:55:27,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-17 03:55:27,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-17 03:55:27,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-17 03:55:27,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-17 03:55:27,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-17 03:55:27,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-17 03:55:27,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-17 03:55:27,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-17 03:55:27,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-17 03:55:27,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-17 03:55:27,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-17 03:55:27,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-04-17 03:55:27,949 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0627236273891114, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-17 03:55:27,949 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912390683366069, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0627236273891114, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2024-04-17 03:57:27,938 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 9456803 different iterations.  Found a solution that moves 1840 regions; Going from a computed imbalance of 0.9912390683366069 to a new imbalance of 4.2946517914333035E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6814814814814815, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-17 03:57:27,943 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1024366745:90 , srv1033569124:90 , srv1142554276:90 , srv1164760400:90 , srv1553330126:90 , srv1572044877:90 , srv1574075400:90 , srv16272164:90 , srv1668029830:90 , srv1710332936:90 , srv183393802:90 , srv1850654931:90 , srv1909645461:90 , srv1928250053:90 , srv200698610:90 , srv287558643:90 , srv384316202:90 , srv515722698:90 , srv537826665:90 , srv548951515:90 , srv653417019:90 , srv676318358:90 , srv69923399:90 , srv733870934:90 , srv769004186:90 , srv779447669:90 , srv805384586:90 , srv825439015:90 , srv857646477:90 , srv99044153:90 }
2024-04-17 03:57:27,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-17 03:57:27,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1850654931=11, srv1909645461=12, srv769004186=24, srv805384586=26, srv16272164=7, srv69923399=22, srv653417019=20, srv676318358=21, srv99044153=29, srv548951515=19, srv384316202=16, srv1164760400=3, srv1572044877=5, srv1710332936=9, srv1574075400=6, srv183393802=10, srv200698610=14, srv1553330126=4, srv1668029830=8, srv537826665=18, srv1928250053=13, srv825439015=27, srv1024366745=0, srv1142554276=2, srv515722698=17, srv779447669=25, srv733870934=23, srv1033569124=1, srv857646477=28, srv287558643=15} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-17 03:57:27,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-17 03:57:27,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-17 03:57:27,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-17 03:57:27,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-17 03:57:27,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-17 03:57:27,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-17 03:57:27,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-17 03:57:27,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-17 03:57:27,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-17 03:57:27,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-17 03:57:27,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-17 03:57:27,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-17 03:57:27,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-17 03:57:27,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-17 03:57:27,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-17 03:57:27,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-17 03:57:27,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-17 03:57:27,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-17 03:57:27,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-17 03:57:27,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-17 03:57:27,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-17 03:57:27,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-17 03:57:27,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-17 03:57:27,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-17 03:57:27,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-17 03:57:27,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-17 03:57:27,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-17 03:57:27,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-17 03:57:27,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-17 03:57:27,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-17 03:57:27,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-04-17 03:57:27,958 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-17 03:57:27,958 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1024366745:90 , srv1033569124:90 , srv1142554276:90 , srv1164760400:90 , srv1553330126:90 , srv1572044877:90 , srv1574075400:90 , srv16272164:90 , srv1668029830:90 , srv1710332936:90 , srv183393802:90 , srv1850654931:90 , srv1909645461:90 , srv1928250053:90 , srv200698610:90 , srv287558643:90 , srv384316202:90 , srv515722698:90 , srv537826665:90 , srv548951515:90 , srv653417019:90 , srv676318358:90 , srv69923399:90 , srv733870934:90 , srv769004186:90 , srv779447669:90 , srv805384586:90 , srv825439015:90 , srv857646477:90 , srv99044153:90 }
2024-04-17 03:57:27,971 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=188 (was 137) - SystemLoadAverage LEAK? -, ProcessCount=176 (was 179), AvailableMemoryMB=3079 (was 1981) - AvailableMemoryMB LEAK? -