2023-02-16 20:56:54,033 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-02-16 20:56:54,318 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-02-16 20:56:54,433 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-02-16 20:56:54,484 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-02-16 20:56:54,493 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-02-16 20:56:54,506 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=401, ProcessCount=166, AvailableMemoryMB=3219
2023-02-16 20:56:54,508 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-02-16 20:56:54,508 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-02-16 20:56:54,636 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1009197993:84 , srv1016213449:84 , srv1018390561:84 , srv1029662726:84 , srv1041100707:84 , srv105238771:84 , srv1054002343:84 , srv107455158:84 , srv1082654257:84 , srv1111363416:84 , srv1112216756:84 , srv1127685357:84 , srv1150998918:84 , srv1177829010:84 , srv1182337789:84 , srv1217531342:84 , srv1233023550:84 , srv1243436863:84 , srv1262986526:84 , srv1265410147:84 , srv1272401696:84 , srv128277443:84 , srv1295190800:84 , srv131135407:84 , srv1343523078:84 , srv1367767268:84 , srv1408239567:84 , srv1426799073:84 , srv143352637:84 , srv1456761086:84 , srv1462891738:84 , srv1465164583:84 , srv1516883730:84 , srv1518589206:84 , srv1529979051:84 , srv1545639529:84 , srv1554710984:84 , srv1625851614:84 , srv1636248320:84 , srv1700091970:84 , srv1706185215:84 , srv1711789624:84 , srv1712128781:84 , srv17201668:84 , srv1741963054:84 , srv1764969330:84 , srv1813644749:84 , srv1827986583:84 , srv1871378442:84 , srv1875703619:84 , srv1902819415:84 , srv1962053381:84 , srv1980191268:84 , srv1980990680:84 , srv199167553:84 , srv2016725821:84 , srv2063993627:84 , srv2109371556:84 , srv2126415970:84 , srv2137294843:84 , srv218096112:84 , srv22502784:84 , srv248307188:84 , srv250433885:84 , srv284910890:84 , srv285307941:84 , srv285820499:84 , srv287503712:84 , srv326490914:84 , srv335949426:84 , srv374978555:84 , srv380392999:84 , srv382618922:84 , srv386594722:84 , srv423488780:84 , srv520463971:84 , srv553221452:84 , srv553253268:84 , srv592198531:84 , srv629561124:84 , srv629926764:84 , srv647651471:84 , srv651008423:84 , srv666698382:84 , srv703778288:84 , srv71226017:84 , srv737556252:84 , srv738885105:84 , srv751958490:84 , srv794106785:84 , srv79525590:84 , srv798355517:84 , srv835584509:84 , srv849622897:84 , srv852929755:84 , srv856422135:84 , srv856681740:84 , srv928340655:84 , srv936186361:84 , srv516465742:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-02-16 20:56:54,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-16 20:56:54,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv629561124=80, srv1082654257=8, srv1217531342=15, srv131135407=23, srv1127685357=11, srv2063993627=56, srv2137294843=59, srv17201668=43, srv553253268=78, srv856681740=97, srv374978555=70, srv1112216756=10, srv592198531=79, srv107455158=7, srv1408239567=26, srv1016213449=1, srv553221452=77, srv1827986583=47, srv1462891738=30, srv666698382=84, srv1712128781=42, srv1741963054=44, srv1343523078=24, srv1426799073=27, srv22502784=61, srv1529979051=34, srv1700091970=39, srv1262986526=18, srv738885105=88, srv285820499=66, srv856422135=96, srv143352637=28, srv1367767268=25, srv1265410147=19, srv71226017=86, srv248307188=62, srv1041100707=4, srv1111363416=9, srv1177829010=13, srv1980990680=53, srv794106785=90, srv1150998918=12, srv423488780=74, srv199167553=54, srv1054002343=6, srv703778288=85, srv1813644749=46, srv1233023550=16, srv520463971=76, srv1516883730=32, srv516465742=75, srv1456761086=29, srv737556252=87, srv105238771=5, srv1764969330=45, srv1465164583=31, srv1871378442=48, srv647651471=82, srv1243436863=17, srv285307941=65, srv798355517=92, srv2109371556=57, srv382618922=72, srv1182337789=14, srv284910890=64, srv128277443=21, srv1711789624=41, srv1545639529=35, srv1636248320=38, srv1706185215=40, srv629926764=81, srv287503712=67, srv2016725821=55, srv651008423=83, srv751958490=89, srv79525590=91, srv936186361=99, srv2126415970=58, srv1980191268=52, srv1295190800=22, srv1009197993=0, srv335949426=69, srv1018390561=2, srv1029662726=3, srv218096112=60, srv250433885=63, srv1902819415=50, srv386594722=73, srv928340655=98, srv1875703619=49, srv835584509=93, srv1272401696=20, srv380392999=71, srv1625851614=37, srv326490914=68, srv849622897=94, srv1518589206=33, srv1962053381=51, srv1554710984=36, srv852929755=95} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-16 20:56:54,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-16 20:56:54,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-16 20:56:54,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-16 20:56:54,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-16 20:56:54,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-16 20:56:54,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-16 20:56:54,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-16 20:56:54,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-16 20:56:54,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-16 20:56:54,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-16 20:56:54,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-16 20:56:54,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-16 20:56:54,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-16 20:56:54,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-16 20:56:54,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-16 20:56:54,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-16 20:56:54,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-16 20:56:54,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-16 20:56:54,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-16 20:56:54,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-16 20:56:54,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-16 20:56:54,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-16 20:56:54,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-16 20:56:54,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-16 20:56:54,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-16 20:56:54,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-16 20:56:54,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-16 20:56:54,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-16 20:56:54,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-16 20:56:54,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-16 20:56:54,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-16 20:56:54,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-16 20:56:54,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-16 20:56:54,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-16 20:56:54,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-16 20:56:54,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-16 20:56:54,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-16 20:56:54,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-16 20:56:54,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-16 20:56:54,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-16 20:56:54,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-16 20:56:54,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-16 20:56:54,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-16 20:56:54,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-16 20:56:54,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-16 20:56:54,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-16 20:56:54,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-16 20:56:54,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-16 20:56:54,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-16 20:56:54,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-16 20:56:54,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-16 20:56:54,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-16 20:56:54,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-16 20:56:54,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-16 20:56:54,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-16 20:56:54,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-16 20:56:54,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-16 20:56:54,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-16 20:56:54,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-16 20:56:54,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-16 20:56:54,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-16 20:56:54,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-16 20:56:54,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-16 20:56:54,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-16 20:56:54,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-16 20:56:54,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-16 20:56:54,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-16 20:56:54,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-16 20:56:54,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-16 20:56:54,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-16 20:56:54,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-16 20:56:54,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-16 20:56:54,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-16 20:56:54,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-16 20:56:54,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-16 20:56:54,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-16 20:56:54,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-16 20:56:54,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-16 20:56:54,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-16 20:56:54,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-16 20:56:54,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-16 20:56:54,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-16 20:56:54,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-16 20:56:54,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-16 20:56:54,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-16 20:56:54,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-16 20:56:54,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-16 20:56:54,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-16 20:56:54,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-16 20:56:54,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-16 20:56:54,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-16 20:56:54,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-16 20:56:54,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-16 20:56:54,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-16 20:56:54,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-16 20:56:54,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-16 20:56:54,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-16 20:56:54,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-16 20:56:54,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-16 20:56:54,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-16 20:56:54,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-16 20:56:55,002 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-16 20:56:55,002 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-02-16 20:56:55,003 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-02-16 20:56:55,356 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 589 ms to try 5000 different iterations.  Found a solution that moves 4689 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.1783796024893629. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0396914147522866, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05464506430364703, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.521, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0396914147522866, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17341666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.242, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-16 20:56:55,370 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1111363416:82 , srv250433885:82 , srv1054002343:83 , srv1518589206:83 , srv1700091970:83 , srv335949426:83 , srv794106785:83 , srv1009197993:84 , srv1177829010:84 , srv1529979051:84 , srv1706185215:84 , srv1764969330:84 , srv1902819415:84 , srv2016725821:84 , srv285307941:84 , srv326490914:84 , srv666698382:84 , srv738885105:84 , srv1127685357:85 , srv1182337789:85 , srv1262986526:85 , srv128277443:85 , srv1456761086:85 , srv1554710984:85 , srv1741963054:85 , srv1962053381:85 , srv1980191268:85 , srv2126415970:85 , srv423488780:85 , srv520463971:85 , srv629561124:85 , srv71226017:85 , srv737556252:85 , srv856681740:85 , srv1029662726:86 , srv1041100707:86 , srv107455158:86 , srv1150998918:86 , srv1233023550:86 , srv1265410147:86 , srv1813644749:86 , srv1827986583:86 , srv2109371556:86 , srv285820499:86 , srv374978555:86 , srv380392999:86 , srv382618922:86 , srv386594722:86 , srv553253268:86 , srv629926764:86 , srv647651471:86 , srv703778288:86 , srv751958490:86 , srv835584509:86 , srv852929755:86 , srv856422135:86 , srv1016213449:87 , srv131135407:87 , srv1367767268:87 , srv1408239567:87 , srv143352637:87 , srv1462891738:87 , srv1516883730:87 , srv1625851614:87 , srv1875703619:87 , srv1980990680:87 , srv199167553:87 , srv2063993627:87 , srv22502784:87 , srv248307188:87 , srv287503712:87 , srv849622897:87 , srv1082654257:88 , srv1112216756:88 , srv1243436863:88 , srv1343523078:88 , srv1426799073:88 , srv1465164583:88 , srv1712128781:88 , srv553221452:88 , srv592198531:88 , srv928340655:88 , srv105238771:89 , srv1272401696:89 , srv1295190800:89 , srv1636248320:89 , srv2137294843:89 , srv218096112:89 , srv798355517:89 , srv1018390561:90 , srv1217531342:90 , srv1871378442:90 , srv284910890:90 , srv79525590:90 , srv1711789624:91 , srv17201668:91 , srv651008423:91 , srv1545639529:92 , srv936186361:92 , srv516465742:443 }
2023-02-16 20:56:55,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-16 20:56:55,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv629561124=80, srv1082654257=8, srv1217531342=15, srv131135407=23, srv1127685357=11, srv2063993627=56, srv2137294843=59, srv17201668=43, srv553253268=78, srv856681740=97, srv374978555=70, srv1112216756=10, srv592198531=79, srv107455158=7, srv1408239567=26, srv1016213449=1, srv553221452=77, srv1827986583=47, srv1462891738=30, srv666698382=84, srv1712128781=42, srv1741963054=44, srv1343523078=24, srv1426799073=27, srv22502784=61, srv1529979051=34, srv1700091970=39, srv1262986526=18, srv738885105=88, srv285820499=66, srv856422135=96, srv143352637=28, srv1367767268=25, srv1265410147=19, srv71226017=86, srv248307188=62, srv1041100707=4, srv1111363416=9, srv1177829010=13, srv1980990680=53, srv794106785=90, srv1150998918=12, srv423488780=74, srv199167553=54, srv1054002343=6, srv703778288=85, srv1813644749=46, srv1233023550=16, srv520463971=76, srv1516883730=32, srv516465742=75, srv1456761086=29, srv737556252=87, srv105238771=5, srv1764969330=45, srv1465164583=31, srv1871378442=48, srv647651471=82, srv1243436863=17, srv285307941=65, srv798355517=92, srv2109371556=57, srv382618922=72, srv1182337789=14, srv284910890=64, srv128277443=21, srv1711789624=41, srv1545639529=35, srv1636248320=38, srv1706185215=40, srv629926764=81, srv287503712=67, srv2016725821=55, srv651008423=83, srv751958490=89, srv79525590=91, srv936186361=99, srv2126415970=58, srv1980191268=52, srv1295190800=22, srv1009197993=0, srv335949426=69, srv1018390561=2, srv1029662726=3, srv218096112=60, srv250433885=63, srv1902819415=50, srv386594722=73, srv928340655=98, srv1875703619=49, srv835584509=93, srv1272401696=20, srv380392999=71, srv1625851614=37, srv326490914=68, srv849622897=94, srv1518589206=33, srv1962053381=51, srv1554710984=36, srv852929755=95} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-16 20:56:55,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-16 20:56:55,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-16 20:56:55,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-16 20:56:55,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-16 20:56:55,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-16 20:56:55,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-16 20:56:55,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-16 20:56:55,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-16 20:56:55,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-16 20:56:55,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-16 20:56:55,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-16 20:56:55,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-16 20:56:55,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-16 20:56:55,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-16 20:56:55,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-16 20:56:55,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-16 20:56:55,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-16 20:56:55,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-16 20:56:55,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-16 20:56:55,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-16 20:56:55,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-16 20:56:55,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-16 20:56:55,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-16 20:56:55,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-16 20:56:55,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-16 20:56:55,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-16 20:56:55,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-16 20:56:55,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-16 20:56:55,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-16 20:56:55,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-16 20:56:55,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-16 20:56:55,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-16 20:56:55,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-16 20:56:55,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-16 20:56:55,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-16 20:56:55,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-16 20:56:55,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-16 20:56:55,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-16 20:56:55,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-16 20:56:55,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-16 20:56:55,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-16 20:56:55,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-16 20:56:55,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-16 20:56:55,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-16 20:56:55,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-16 20:56:55,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-16 20:56:55,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-16 20:56:55,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-16 20:56:55,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-16 20:56:55,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-16 20:56:55,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-16 20:56:55,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-16 20:56:55,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-16 20:56:55,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-16 20:56:55,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-16 20:56:55,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-16 20:56:55,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-16 20:56:55,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-16 20:56:55,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-16 20:56:55,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-16 20:56:55,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-16 20:56:55,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-16 20:56:55,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-16 20:56:55,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-16 20:56:55,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-16 20:56:55,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-16 20:56:55,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-16 20:56:55,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-16 20:56:55,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-16 20:56:55,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-16 20:56:55,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-16 20:56:55,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-16 20:56:55,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-16 20:56:55,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-16 20:56:55,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-16 20:56:55,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-16 20:56:55,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-16 20:56:55,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-16 20:56:55,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-16 20:56:55,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-16 20:56:55,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-16 20:56:55,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-16 20:56:55,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-16 20:56:55,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-16 20:56:55,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-16 20:56:55,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-16 20:56:55,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-16 20:56:55,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-16 20:56:55,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-16 20:56:55,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-16 20:56:55,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-16 20:56:55,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-16 20:56:55,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-16 20:56:55,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-16 20:56:55,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-16 20:56:55,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-16 20:56:55,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-16 20:56:55,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-16 20:56:55,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-16 20:56:55,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-16 20:56:55,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-16 20:56:55,502 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0396914147522866, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05464506430364703, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0396914147522866, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17341666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.242, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-16 20:56:55,502 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-02-16 20:56:55,502 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17834676940960742, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0396914147522866, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05464506430364703, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0396914147522866, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17341666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.242, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-02-16 20:56:55,709 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 298 ms to try 5000 different iterations.  Found a solution that moves 2614 regions; Going from a computed imbalance of 0.17834676940960742 to a new imbalance of 0.014446709938507864. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020926298378736018); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03293703819180597, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29044444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020926298378736018); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011416666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043333333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-16 20:56:55,716 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1545639529:79 , srv1217531342:81 , srv1272401696:81 , srv1711789624:81 , srv17201668:81 , srv1871378442:81 , srv1018390561:82 , srv2137294843:82 , srv651008423:82 , srv798355517:82 , srv936186361:82 , srv1426799073:83 , srv1516883730:83 , srv1636248320:83 , srv199167553:83 , srv218096112:83 , srv553221452:83 , srv79525590:83 , srv1029662726:84 , srv105238771:84 , srv1082654257:84 , srv1112216756:84 , srv1243436863:84 , srv1295190800:84 , srv1462891738:84 , srv1465164583:84 , srv284910890:84 , srv835584509:84 , srv928340655:84 , srv1016213449:85 , srv131135407:85 , srv1343523078:85 , srv143352637:85 , srv1456761086:85 , srv1625851614:85 , srv1813644749:85 , srv2109371556:85 , srv22502784:85 , srv287503712:85 , srv374978555:85 , srv386594722:85 , srv520463971:85 , srv592198531:85 , srv629926764:85 , srv647651471:85 , srv751958490:85 , srv849622897:85 , srv1127685357:86 , srv1150998918:86 , srv1262986526:86 , srv1265410147:86 , srv128277443:86 , srv1529979051:86 , srv1741963054:86 , srv1980191268:86 , srv1980990680:86 , srv380392999:86 , srv703778288:86 , srv71226017:86 , srv1009197993:87 , srv107455158:87 , srv1367767268:87 , srv1408239567:87 , srv1554710984:87 , srv1764969330:87 , srv1875703619:87 , srv1962053381:87 , srv2063993627:87 , srv382618922:87 , srv423488780:87 , srv737556252:87 , srv738885105:87 , srv856422135:87 , srv856681740:87 , srv1054002343:88 , srv1177829010:88 , srv1233023550:88 , srv1700091970:88 , srv1706185215:88 , srv1712128781:88 , srv1827986583:88 , srv1902819415:88 , srv2126415970:88 , srv248307188:88 , srv326490914:88 , srv553253268:88 , srv666698382:88 , srv852929755:88 , srv1041100707:89 , srv1182337789:89 , srv2016725821:89 , srv285307941:89 , srv285820499:89 , srv335949426:89 , srv629561124:89 , srv794106785:89 , srv1111363416:90 , srv1518589206:90 , srv250433885:93 , srv516465742:517 }
2023-02-16 20:56:55,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-16 20:56:55,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv629561124=80, srv1082654257=8, srv1217531342=15, srv131135407=23, srv1127685357=11, srv2063993627=56, srv2137294843=59, srv17201668=43, srv553253268=78, srv856681740=97, srv374978555=70, srv1112216756=10, srv592198531=79, srv107455158=7, srv1408239567=26, srv1016213449=1, srv553221452=77, srv1827986583=47, srv1462891738=30, srv666698382=84, srv1712128781=42, srv1741963054=44, srv1343523078=24, srv1426799073=27, srv22502784=61, srv1529979051=34, srv1700091970=39, srv1262986526=18, srv738885105=88, srv285820499=66, srv856422135=96, srv143352637=28, srv1367767268=25, srv1265410147=19, srv71226017=86, srv248307188=62, srv1041100707=4, srv1111363416=9, srv1177829010=13, srv1980990680=53, srv794106785=90, srv1150998918=12, srv423488780=74, srv199167553=54, srv1054002343=6, srv703778288=85, srv1813644749=46, srv1233023550=16, srv520463971=76, srv1516883730=32, srv516465742=75, srv1456761086=29, srv737556252=87, srv105238771=5, srv1764969330=45, srv1465164583=31, srv1871378442=48, srv647651471=82, srv1243436863=17, srv285307941=65, srv798355517=92, srv2109371556=57, srv382618922=72, srv1182337789=14, srv284910890=64, srv128277443=21, srv1711789624=41, srv1545639529=35, srv1636248320=38, srv1706185215=40, srv629926764=81, srv287503712=67, srv2016725821=55, srv651008423=83, srv751958490=89, srv79525590=91, srv936186361=99, srv2126415970=58, srv1980191268=52, srv1295190800=22, srv1009197993=0, srv335949426=69, srv1018390561=2, srv1029662726=3, srv218096112=60, srv250433885=63, srv1902819415=50, srv386594722=73, srv928340655=98, srv1875703619=49, srv835584509=93, srv1272401696=20, srv380392999=71, srv1625851614=37, srv326490914=68, srv849622897=94, srv1518589206=33, srv1962053381=51, srv1554710984=36, srv852929755=95} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-16 20:56:55,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-16 20:56:55,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-16 20:56:55,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-16 20:56:55,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-16 20:56:55,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-16 20:56:55,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-16 20:56:55,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-16 20:56:55,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-16 20:56:55,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-16 20:56:55,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-16 20:56:55,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-16 20:56:55,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-16 20:56:55,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-16 20:56:55,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-16 20:56:55,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-16 20:56:55,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-16 20:56:55,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-16 20:56:55,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-16 20:56:55,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-16 20:56:55,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-16 20:56:55,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-16 20:56:55,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-16 20:56:55,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-16 20:56:55,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-16 20:56:55,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-16 20:56:55,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-16 20:56:55,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-16 20:56:55,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-16 20:56:55,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-16 20:56:55,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-16 20:56:55,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-16 20:56:55,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-16 20:56:55,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-16 20:56:55,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-16 20:56:55,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-16 20:56:55,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-16 20:56:55,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-16 20:56:55,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-16 20:56:55,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-16 20:56:55,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-16 20:56:55,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-16 20:56:55,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-16 20:56:55,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-16 20:56:55,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-16 20:56:55,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-16 20:56:55,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-16 20:56:55,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-16 20:56:55,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-16 20:56:55,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-16 20:56:55,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-16 20:56:55,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-16 20:56:55,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-16 20:56:55,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-16 20:56:55,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-16 20:56:55,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-16 20:56:55,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-16 20:56:55,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-16 20:56:55,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-16 20:56:55,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-16 20:56:55,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-16 20:56:55,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-16 20:56:55,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-16 20:56:55,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-16 20:56:55,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-16 20:56:55,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-16 20:56:55,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-16 20:56:55,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-16 20:56:55,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-16 20:56:55,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-16 20:56:55,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-16 20:56:55,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-16 20:56:55,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-16 20:56:55,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-16 20:56:55,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-16 20:56:55,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-16 20:56:55,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-16 20:56:55,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-16 20:56:55,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-16 20:56:55,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-16 20:56:55,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-16 20:56:55,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-16 20:56:55,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-16 20:56:55,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-16 20:56:55,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-16 20:56:55,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-16 20:56:55,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-16 20:56:55,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-16 20:56:55,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-16 20:56:55,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-16 20:56:55,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-16 20:56:55,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-16 20:56:55,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-16 20:56:55,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-16 20:56:55,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-16 20:56:55,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-16 20:56:55,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-16 20:56:55,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-16 20:56:55,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-16 20:56:55,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-16 20:56:55,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-16 20:56:55,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-16 20:56:55,826 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020926298378736018); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03293703819180597, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020926298378736018); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011416666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043333333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-16 20:56:55,827 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-02-16 20:56:55,827 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.014428406319296767, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020926298378736018); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03293703819180597, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020926298378736018); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011416666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043333333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-02-16 20:56:55,993 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 240 ms to try 5000 different iterations.  Found a solution that moves 937 regions; Going from a computed imbalance of 0.014428406319296767 to a new imbalance of 7.081241390088539E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005105203241514896); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00705915362006309); MoveCostFunction : (multiplier=7.0, imbalance=0.10411111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005105203241514896); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004666666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-16 20:56:55,995 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1041100707:82 , srv1712128781:82 , srv250433885:82 , srv285820499:82 , srv1408239567:83 , srv248307188:83 , srv284910890:83 , srv852929755:83 , srv105238771:84 , srv107455158:84 , srv1182337789:84 , srv1233023550:84 , srv1343523078:84 , srv1367767268:84 , srv1518589206:84 , srv1827986583:84 , srv1875703619:84 , srv2016725821:84 , srv553253268:84 , srv629561124:84 , srv651008423:84 , srv79525590:84 , srv936186361:84 , srv1009197993:85 , srv1016213449:85 , srv1082654257:85 , srv1111363416:85 , srv1112216756:85 , srv1127685357:85 , srv1150998918:85 , srv1177829010:85 , srv1265410147:85 , srv1295190800:85 , srv131135407:85 , srv143352637:85 , srv1465164583:85 , srv1554710984:85 , srv1902819415:85 , srv1962053381:85 , srv1980990680:85 , srv2063993627:85 , srv22502784:85 , srv285307941:85 , srv326490914:85 , srv380392999:85 , srv382618922:85 , srv592198531:85 , srv703778288:85 , srv794106785:85 , srv856422135:85 , srv856681740:85 , srv928340655:85 , srv1018390561:86 , srv1262986526:86 , srv1625851614:86 , srv1636248320:86 , srv1700091970:86 , srv1706185215:86 , srv1711789624:86 , srv17201668:86 , srv1980191268:86 , srv2109371556:86 , srv2137294843:86 , srv287503712:86 , srv335949426:86 , srv374978555:86 , srv386594722:86 , srv423488780:86 , srv553221452:86 , srv647651471:86 , srv737556252:86 , srv751958490:86 , srv849622897:86 , srv1054002343:87 , srv1217531342:87 , srv1243436863:87 , srv1272401696:87 , srv1426799073:87 , srv1456761086:87 , srv1462891738:87 , srv1516883730:87 , srv1529979051:87 , srv1545639529:87 , srv1741963054:87 , srv1764969330:87 , srv1813644749:87 , srv1871378442:87 , srv2126415970:87 , srv218096112:87 , srv520463971:87 , srv629926764:87 , srv666698382:87 , srv71226017:87 , srv738885105:87 , srv798355517:87 , srv1029662726:88 , srv128277443:88 , srv199167553:88 , srv835584509:88 , srv516465742:543 }
2023-02-16 20:56:55,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-16 20:56:55,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv629561124=80, srv1082654257=8, srv1217531342=15, srv131135407=23, srv1127685357=11, srv2063993627=56, srv2137294843=59, srv17201668=43, srv553253268=78, srv856681740=97, srv374978555=70, srv1112216756=10, srv592198531=79, srv107455158=7, srv1408239567=26, srv1016213449=1, srv553221452=77, srv1827986583=47, srv1462891738=30, srv666698382=84, srv1712128781=42, srv1741963054=44, srv1343523078=24, srv1426799073=27, srv22502784=61, srv1529979051=34, srv1700091970=39, srv1262986526=18, srv738885105=88, srv285820499=66, srv856422135=96, srv143352637=28, srv1367767268=25, srv1265410147=19, srv71226017=86, srv248307188=62, srv1041100707=4, srv1111363416=9, srv1177829010=13, srv1980990680=53, srv794106785=90, srv1150998918=12, srv423488780=74, srv199167553=54, srv1054002343=6, srv703778288=85, srv1813644749=46, srv1233023550=16, srv520463971=76, srv1516883730=32, srv516465742=75, srv1456761086=29, srv737556252=87, srv105238771=5, srv1764969330=45, srv1465164583=31, srv1871378442=48, srv647651471=82, srv1243436863=17, srv285307941=65, srv798355517=92, srv2109371556=57, srv382618922=72, srv1182337789=14, srv284910890=64, srv128277443=21, srv1711789624=41, srv1545639529=35, srv1636248320=38, srv1706185215=40, srv629926764=81, srv287503712=67, srv2016725821=55, srv651008423=83, srv751958490=89, srv79525590=91, srv936186361=99, srv2126415970=58, srv1980191268=52, srv1295190800=22, srv1009197993=0, srv335949426=69, srv1018390561=2, srv1029662726=3, srv218096112=60, srv250433885=63, srv1902819415=50, srv386594722=73, srv928340655=98, srv1875703619=49, srv835584509=93, srv1272401696=20, srv380392999=71, srv1625851614=37, srv326490914=68, srv849622897=94, srv1518589206=33, srv1962053381=51, srv1554710984=36, srv852929755=95} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-16 20:56:56,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-16 20:56:56,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-16 20:56:56,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-16 20:56:56,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-16 20:56:56,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-16 20:56:56,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-16 20:56:56,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-16 20:56:56,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-16 20:56:56,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-16 20:56:56,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-16 20:56:56,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-16 20:56:56,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-16 20:56:56,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-16 20:56:56,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-16 20:56:56,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-16 20:56:56,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-16 20:56:56,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-16 20:56:56,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-16 20:56:56,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-16 20:56:56,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-16 20:56:56,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-16 20:56:56,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-16 20:56:56,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-16 20:56:56,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-16 20:56:56,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-16 20:56:56,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-16 20:56:56,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-16 20:56:56,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-16 20:56:56,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-16 20:56:56,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-16 20:56:56,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-16 20:56:56,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-16 20:56:56,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-16 20:56:56,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-16 20:56:56,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-16 20:56:56,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-16 20:56:56,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-16 20:56:56,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-16 20:56:56,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-16 20:56:56,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-16 20:56:56,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-16 20:56:56,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-16 20:56:56,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-16 20:56:56,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-16 20:56:56,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-16 20:56:56,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-16 20:56:56,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-16 20:56:56,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-16 20:56:56,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-16 20:56:56,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-16 20:56:56,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-16 20:56:56,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-16 20:56:56,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-16 20:56:56,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-16 20:56:56,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-16 20:56:56,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-16 20:56:56,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-16 20:56:56,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-16 20:56:56,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-16 20:56:56,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-16 20:56:56,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-16 20:56:56,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-16 20:56:56,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-16 20:56:56,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-16 20:56:56,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-16 20:56:56,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-16 20:56:56,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-16 20:56:56,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-16 20:56:56,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-16 20:56:56,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-16 20:56:56,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-16 20:56:56,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-16 20:56:56,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-16 20:56:56,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-16 20:56:56,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-16 20:56:56,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-16 20:56:56,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-16 20:56:56,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-16 20:56:56,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-16 20:56:56,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-16 20:56:56,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-16 20:56:56,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-16 20:56:56,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-16 20:56:56,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-16 20:56:56,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-16 20:56:56,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-16 20:56:56,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-16 20:56:56,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-16 20:56:56,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-16 20:56:56,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-16 20:56:56,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-16 20:56:56,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-16 20:56:56,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-16 20:56:56,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-16 20:56:56,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-16 20:56:56,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-16 20:56:56,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-16 20:56:56,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-16 20:56:56,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-16 20:56:56,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-16 20:56:56,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-16 20:56:56,100 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005105203241514896); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00705915362006309); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005105203241514896); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004666666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-16 20:56:56,100 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-02-16 20:56:56,100 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=7.015631247774849E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005105203241514896); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00705915362006309); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005105203241514896); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004666666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-02-16 20:56:56,332 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 307 ms to try 5000 different iterations.  Found a solution that moves 252 regions; Going from a computed imbalance of 7.015631247774849E-4 to a new imbalance of 1.3094608047008372E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002010075630518424); MoveCostFunction : (multiplier=7.0, imbalance=0.028, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-16 20:56:56,333 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv2126415970:82 , srv1243436863:83 , srv128277443:83 , srv1545639529:83 , srv2063993627:83 , srv218096112:83 , srv592198531:83 , srv666698382:83 , srv737556252:83 , srv1018390561:84 , srv1029662726:84 , srv1054002343:84 , srv1182337789:84 , srv1217531342:84 , srv1233023550:84 , srv1295190800:84 , srv1367767268:84 , srv1426799073:84 , srv1462891738:84 , srv1554710984:84 , srv1636248320:84 , srv1706185215:84 , srv1711789624:84 , srv1712128781:84 , srv17201668:84 , srv1741963054:84 , srv1764969330:84 , srv1813644749:84 , srv1827986583:84 , srv1871378442:84 , srv1962053381:84 , srv2109371556:84 , srv248307188:84 , srv285307941:84 , srv287503712:84 , srv326490914:84 , srv335949426:84 , srv382618922:84 , srv423488780:84 , srv520463971:84 , srv553253268:84 , srv629561124:84 , srv71226017:84 , srv738885105:84 , srv798355517:84 , srv849622897:84 , srv856422135:84 , srv936186361:84 , srv1016213449:85 , srv1041100707:85 , srv105238771:85 , srv107455158:85 , srv1082654257:85 , srv1112216756:85 , srv1127685357:85 , srv1150998918:85 , srv1262986526:85 , srv1265410147:85 , srv1272401696:85 , srv131135407:85 , srv1343523078:85 , srv1408239567:85 , srv143352637:85 , srv1456761086:85 , srv1465164583:85 , srv1516883730:85 , srv1518589206:85 , srv1529979051:85 , srv1625851614:85 , srv1700091970:85 , srv1875703619:85 , srv1902819415:85 , srv1980191268:85 , srv1980990680:85 , srv199167553:85 , srv2016725821:85 , srv2137294843:85 , srv22502784:85 , srv250433885:85 , srv284910890:85 , srv285820499:85 , srv380392999:85 , srv386594722:85 , srv553221452:85 , srv629926764:85 , srv647651471:85 , srv651008423:85 , srv703778288:85 , srv751958490:85 , srv794106785:85 , srv79525590:85 , srv835584509:85 , srv852929755:85 , srv856681740:85 , srv928340655:85 , srv1009197993:86 , srv1111363416:86 , srv1177829010:86 , srv374978555:86 , srv516465742:639 }
2023-02-16 20:56:56,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-16 20:56:56,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv629561124=80, srv1082654257=8, srv1217531342=15, srv131135407=23, srv1127685357=11, srv2063993627=56, srv2137294843=59, srv17201668=43, srv553253268=78, srv856681740=97, srv374978555=70, srv1112216756=10, srv592198531=79, srv107455158=7, srv1408239567=26, srv1016213449=1, srv553221452=77, srv1827986583=47, srv1462891738=30, srv666698382=84, srv1712128781=42, srv1741963054=44, srv1343523078=24, srv1426799073=27, srv22502784=61, srv1529979051=34, srv1700091970=39, srv1262986526=18, srv738885105=88, srv285820499=66, srv856422135=96, srv143352637=28, srv1367767268=25, srv1265410147=19, srv71226017=86, srv248307188=62, srv1041100707=4, srv1111363416=9, srv1177829010=13, srv1980990680=53, srv794106785=90, srv1150998918=12, srv423488780=74, srv199167553=54, srv1054002343=6, srv703778288=85, srv1813644749=46, srv1233023550=16, srv520463971=76, srv1516883730=32, srv516465742=75, srv1456761086=29, srv737556252=87, srv105238771=5, srv1764969330=45, srv1465164583=31, srv1871378442=48, srv647651471=82, srv1243436863=17, srv285307941=65, srv798355517=92, srv2109371556=57, srv382618922=72, srv1182337789=14, srv284910890=64, srv128277443=21, srv1711789624=41, srv1545639529=35, srv1636248320=38, srv1706185215=40, srv629926764=81, srv287503712=67, srv2016725821=55, srv651008423=83, srv751958490=89, srv79525590=91, srv936186361=99, srv2126415970=58, srv1980191268=52, srv1295190800=22, srv1009197993=0, srv335949426=69, srv1018390561=2, srv1029662726=3, srv218096112=60, srv250433885=63, srv1902819415=50, srv386594722=73, srv928340655=98, srv1875703619=49, srv835584509=93, srv1272401696=20, srv380392999=71, srv1625851614=37, srv326490914=68, srv849622897=94, srv1518589206=33, srv1962053381=51, srv1554710984=36, srv852929755=95} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-16 20:56:56,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-16 20:56:56,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-16 20:56:56,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-16 20:56:56,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-16 20:56:56,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-16 20:56:56,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-16 20:56:56,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-16 20:56:56,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-16 20:56:56,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-16 20:56:56,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-16 20:56:56,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-16 20:56:56,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-16 20:56:56,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-16 20:56:56,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-16 20:56:56,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-16 20:56:56,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-16 20:56:56,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-16 20:56:56,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-16 20:56:56,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-16 20:56:56,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-16 20:56:56,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-16 20:56:56,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-16 20:56:56,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-16 20:56:56,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-16 20:56:56,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-16 20:56:56,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-16 20:56:56,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-16 20:56:56,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-16 20:56:56,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-16 20:56:56,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-16 20:56:56,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-16 20:56:56,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-16 20:56:56,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-16 20:56:56,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-16 20:56:56,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-16 20:56:56,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-16 20:56:56,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-16 20:56:56,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-16 20:56:56,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-16 20:56:56,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-16 20:56:56,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-16 20:56:56,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-16 20:56:56,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-16 20:56:56,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-16 20:56:56,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-16 20:56:56,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-16 20:56:56,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-16 20:56:56,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-16 20:56:56,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-16 20:56:56,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-16 20:56:56,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-16 20:56:56,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-16 20:56:56,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-16 20:56:56,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-16 20:56:56,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-16 20:56:56,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-16 20:56:56,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-16 20:56:56,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-16 20:56:56,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-16 20:56:56,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-16 20:56:56,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-16 20:56:56,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-16 20:56:56,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-16 20:56:56,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-16 20:56:56,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-16 20:56:56,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-16 20:56:56,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-16 20:56:56,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-16 20:56:56,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-16 20:56:56,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-16 20:56:56,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-16 20:56:56,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-16 20:56:56,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-16 20:56:56,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-16 20:56:56,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-16 20:56:56,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-16 20:56:56,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-16 20:56:56,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-16 20:56:56,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-16 20:56:56,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-16 20:56:56,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-16 20:56:56,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-16 20:56:56,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-16 20:56:56,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-16 20:56:56,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-16 20:56:56,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-16 20:56:56,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-16 20:56:56,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-16 20:56:56,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-16 20:56:56,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-16 20:56:56,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-16 20:56:56,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-16 20:56:56,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-16 20:56:56,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-16 20:56:56,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-16 20:56:56,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-16 20:56:56,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-16 20:56:56,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-16 20:56:56,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-16 20:56:56,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-16 20:56:56,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-16 20:56:56,474 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=1.133006633270208E-5 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002010075630518424); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-16 20:56:56,475 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv2126415970:82 , srv1243436863:83 , srv128277443:83 , srv1545639529:83 , srv2063993627:83 , srv218096112:83 , srv592198531:83 , srv666698382:83 , srv737556252:83 , srv1018390561:84 , srv1029662726:84 , srv1054002343:84 , srv1182337789:84 , srv1217531342:84 , srv1233023550:84 , srv1295190800:84 , srv1367767268:84 , srv1426799073:84 , srv1462891738:84 , srv1554710984:84 , srv1636248320:84 , srv1706185215:84 , srv1711789624:84 , srv1712128781:84 , srv17201668:84 , srv1741963054:84 , srv1764969330:84 , srv1813644749:84 , srv1827986583:84 , srv1871378442:84 , srv1962053381:84 , srv2109371556:84 , srv248307188:84 , srv285307941:84 , srv287503712:84 , srv326490914:84 , srv335949426:84 , srv382618922:84 , srv423488780:84 , srv520463971:84 , srv553253268:84 , srv629561124:84 , srv71226017:84 , srv738885105:84 , srv798355517:84 , srv849622897:84 , srv856422135:84 , srv936186361:84 , srv1016213449:85 , srv1041100707:85 , srv105238771:85 , srv107455158:85 , srv1082654257:85 , srv1112216756:85 , srv1127685357:85 , srv1150998918:85 , srv1262986526:85 , srv1265410147:85 , srv1272401696:85 , srv131135407:85 , srv1343523078:85 , srv1408239567:85 , srv143352637:85 , srv1456761086:85 , srv1465164583:85 , srv1516883730:85 , srv1518589206:85 , srv1529979051:85 , srv1625851614:85 , srv1700091970:85 , srv1875703619:85 , srv1902819415:85 , srv1980191268:85 , srv1980990680:85 , srv199167553:85 , srv2016725821:85 , srv2137294843:85 , srv22502784:85 , srv250433885:85 , srv284910890:85 , srv285820499:85 , srv380392999:85 , srv386594722:85 , srv553221452:85 , srv629926764:85 , srv647651471:85 , srv651008423:85 , srv703778288:85 , srv751958490:85 , srv794106785:85 , srv79525590:85 , srv835584509:85 , srv852929755:85 , srv856681740:85 , srv928340655:85 , srv1009197993:86 , srv1111363416:86 , srv1177829010:86 , srv374978555:86 , srv516465742:639 }
2023-02-16 20:56:56,500 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=401 (was 401), ProcessCount=166 (was 166), AvailableMemoryMB=2734 (was 3219)
2023-02-16 20:56:56,508 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=401, ProcessCount=166, AvailableMemoryMB=2734
2023-02-16 20:56:56,509 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-02-16 20:56:56,509 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-02-16 20:56:56,521 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv100150636:84 , srv1101391737:84 , srv1137875483:84 , srv1146567469:84 , srv1210417203:84 , srv1219790371:84 , srv126175649:84 , srv1349541634:84 , srv138009697:84 , srv172964236:84 , srv1761810712:84 , srv1774225850:84 , srv184700435:84 , srv1880622719:84 , srv1889449085:84 , srv1923173736:84 , srv1924401370:84 , srv2035801855:84 , srv2095246443:84 , srv2147387235:84 , srv411516001:84 , srv499650937:84 , srv566253704:84 , srv617250318:84 , srv627140676:84 , srv681517101:84 , srv68705045:84 , srv764477395:84 , srv839909424:84 , srv1135475362:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-02-16 20:56:56,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-16 20:56:56,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1219790371=6, srv1146567469=4, srv138009697=9, srv566253704=23, srv1210417203=5, srv2035801855=18, srv126175649=7, srv764477395=28, srv1774225850=12, srv1923173736=16, srv1889449085=15, srv411516001=21, srv499650937=22, srv627140676=25, srv1101391737=1, srv68705045=27, srv1137875483=3, srv617250318=24, srv839909424=29, srv184700435=13, srv2147387235=20, srv1880622719=14, srv681517101=26, srv1349541634=8, srv1761810712=11, srv2095246443=19, srv172964236=10, srv1924401370=17, srv100150636=0, srv1135475362=2} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-16 20:56:56,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-16 20:56:56,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-16 20:56:56,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-16 20:56:56,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-16 20:56:56,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-16 20:56:56,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-16 20:56:56,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-16 20:56:56,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-16 20:56:56,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-16 20:56:56,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-16 20:56:56,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-16 20:56:56,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-16 20:56:56,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-16 20:56:56,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-16 20:56:56,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-16 20:56:56,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-16 20:56:56,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-16 20:56:56,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-16 20:56:56,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-16 20:56:56,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-16 20:56:56,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-16 20:56:56,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-16 20:56:56,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-16 20:56:56,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-16 20:56:56,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-16 20:56:56,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-16 20:56:56,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-16 20:56:56,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-16 20:56:56,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-16 20:56:56,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-16 20:56:56,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-02-16 20:56:56,565 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.126411840834372, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-16 20:56:56,566 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912591362847023, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.126411840834372, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-02-16 20:58:56,544 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 9429726 different iterations.  Found a solution that moves 1847 regions; Going from a computed imbalance of 0.9912591362847023 to a new imbalance of 4.3109901406398434E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6840740740740741, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-16 20:58:56,553 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv100150636:90 , srv1101391737:90 , srv1135475362:90 , srv1137875483:90 , srv1146567469:90 , srv1210417203:90 , srv1219790371:90 , srv126175649:90 , srv1349541634:90 , srv138009697:90 , srv172964236:90 , srv1761810712:90 , srv1774225850:90 , srv184700435:90 , srv1880622719:90 , srv1889449085:90 , srv1923173736:90 , srv1924401370:90 , srv2035801855:90 , srv2095246443:90 , srv2147387235:90 , srv411516001:90 , srv499650937:90 , srv566253704:90 , srv617250318:90 , srv627140676:90 , srv681517101:90 , srv68705045:90 , srv764477395:90 , srv839909424:90 }
2023-02-16 20:58:56,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-16 20:58:56,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1219790371=6, srv1146567469=4, srv138009697=9, srv566253704=23, srv1210417203=5, srv2035801855=18, srv126175649=7, srv764477395=28, srv1774225850=12, srv1923173736=16, srv1889449085=15, srv411516001=21, srv499650937=22, srv627140676=25, srv1101391737=1, srv68705045=27, srv1137875483=3, srv617250318=24, srv839909424=29, srv184700435=13, srv2147387235=20, srv1880622719=14, srv681517101=26, srv1349541634=8, srv1761810712=11, srv2095246443=19, srv172964236=10, srv1924401370=17, srv100150636=0, srv1135475362=2} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-16 20:58:56,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-16 20:58:56,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-16 20:58:56,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-16 20:58:56,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-16 20:58:56,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-16 20:58:56,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-16 20:58:56,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-16 20:58:56,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-16 20:58:56,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-16 20:58:56,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-16 20:58:56,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-16 20:58:56,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-16 20:58:56,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-16 20:58:56,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-16 20:58:56,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-16 20:58:56,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-16 20:58:56,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-16 20:58:56,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-16 20:58:56,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-16 20:58:56,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-16 20:58:56,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-16 20:58:56,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-16 20:58:56,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-16 20:58:56,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-16 20:58:56,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-16 20:58:56,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-16 20:58:56,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-16 20:58:56,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-16 20:58:56,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-16 20:58:56,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-16 20:58:56,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-02-16 20:58:56,576 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-16 20:58:56,577 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv100150636:90 , srv1101391737:90 , srv1135475362:90 , srv1137875483:90 , srv1146567469:90 , srv1210417203:90 , srv1219790371:90 , srv126175649:90 , srv1349541634:90 , srv138009697:90 , srv172964236:90 , srv1761810712:90 , srv1774225850:90 , srv184700435:90 , srv1880622719:90 , srv1889449085:90 , srv1923173736:90 , srv1924401370:90 , srv2035801855:90 , srv2095246443:90 , srv2147387235:90 , srv411516001:90 , srv499650937:90 , srv566253704:90 , srv617250318:90 , srv627140676:90 , srv681517101:90 , srv68705045:90 , srv764477395:90 , srv839909424:90 }
2023-02-16 20:58:56,595 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=9 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=246 (was 401), ProcessCount=164 (was 166), AvailableMemoryMB=3221 (was 2734) - AvailableMemoryMB LEAK? -