2023-09-19 00:53:15,682 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-09-19 00:53:16,001 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-09-19 00:53:16,119 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-09-19 00:53:16,184 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-09-19 00:53:16,191 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-09-19 00:53:16,205 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=256, ProcessCount=169, AvailableMemoryMB=10764
2023-09-19 00:53:16,207 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-09-19 00:53:16,207 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-09-19 00:53:16,356 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1000184426:84 , srv1008345322:84 , srv1012209872:84 , srv1026671180:84 , srv1044791856:84 , srv1083857583:84 , srv1127343032:84 , srv1130135281:84 , srv1145055772:84 , srv1165799614:84 , srv1195304882:84 , srv1213667577:84 , srv1241119813:84 , srv1258835321:84 , srv1291006697:84 , srv1292532270:84 , srv1297451423:84 , srv1319095712:84 , srv1345354122:84 , srv1408738766:84 , srv1418135883:84 , srv1419023443:84 , srv1449333035:84 , srv1489069661:84 , srv1510812525:84 , srv1571012170:84 , srv1575300691:84 , srv1587021530:84 , srv1612443687:84 , srv1621656725:84 , srv1629657332:84 , srv1634505799:84 , srv1635503366:84 , srv1655297758:84 , srv166762015:84 , srv1669839367:84 , srv1702814584:84 , srv1719110060:84 , srv1729062263:84 , srv1762541862:84 , srv1773776967:84 , srv1794099687:84 , srv1805790015:84 , srv1807407250:84 , srv181151495:84 , srv1822626525:84 , srv1823517251:84 , srv1826509293:84 , srv1838440573:84 , srv185256840:84 , srv1871315937:84 , srv1875966297:84 , srv1880124456:84 , srv1892907500:84 , srv1915754122:84 , srv1942990835:84 , srv1944464619:84 , srv1948965020:84 , srv1996316540:84 , srv2037740323:84 , srv2059142173:84 , srv2062154808:84 , srv2108762727:84 , srv2112270972:84 , srv2129461379:84 , srv2130483252:84 , srv220323738:84 , srv251013835:84 , srv25191683:84 , srv257791792:84 , srv263551861:84 , srv265048299:84 , srv285186722:84 , srv290921615:84 , srv354190976:84 , srv366415742:84 , srv385640352:84 , srv400012267:84 , srv411766767:84 , srv41392230:84 , srv440499582:84 , srv474031333:84 , srv498988739:84 , srv520552508:84 , srv561135034:84 , srv561773428:84 , srv56339348:84 , srv588505057:84 , srv617292336:84 , srv7493924:84 , srv778148461:84 , srv785087697:84 , srv834563301:84 , srv881726222:84 , srv890457078:84 , srv911895754:84 , srv918517263:84 , srv923007739:84 , srv955548255:84 , srv185550815:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-09-19 00:53:16,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-19 00:53:16,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv185256840=49, srv1213667577=11, srv1942990835=56, srv2130483252=66, srv354190976=75, srv918517263=97, srv1418135883=20, srv2112270972=64, srv2037740323=60, srv2059142173=61, srv498988739=83, srv1044791856=4, srv1083857583=5, srv778148461=91, srv1892907500=54, srv911895754=96, srv1702814584=36, srv1729062263=38, srv1510812525=24, srv520552508=84, srv1012209872=2, srv1145055772=8, srv2062154808=62, srv1621656725=29, srv561135034=85, srv1008345322=1, srv1823517251=46, srv56339348=87, srv1571012170=25, srv1419023443=21, srv1880124456=53, srv285186722=73, srv1292532270=15, srv1762541862=39, srv1575300691=26, srv2129461379=65, srv220323738=67, srv1944464619=57, srv1165799614=9, srv2108762727=63, srv1838440573=48, srv263551861=71, srv1130135281=7, srv25191683=69, srv181151495=44, srv1345354122=18, srv1612443687=28, srv1773776967=40, srv251013835=68, srv1948965020=58, srv166762015=34, srv1587021530=27, srv1408738766=19, srv1915754122=55, srv1826509293=47, srv785087697=92, srv1629657332=30, srv955548255=99, srv411766767=79, srv1996316540=59, srv1669839367=35, srv1794099687=41, srv1241119813=12, srv1000184426=0, srv1871315937=51, srv1719110060=37, srv1449333035=22, srv41392230=80, srv1297451423=16, srv588505057=88, srv366415742=76, srv1807407250=43, srv1822626525=45, srv1127343032=6, srv881726222=94, srv385640352=77, srv290921615=74, srv923007739=98, srv1258835321=13, srv561773428=86, srv1195304882=10, srv185550815=50, srv257791792=70, srv1319095712=17, srv834563301=93, srv265048299=72, srv1489069661=23, srv7493924=90, srv400012267=78, srv1026671180=3, srv1291006697=14, srv474031333=82, srv1635503366=32, srv1655297758=33, srv440499582=81, srv1634505799=31, srv890457078=95, srv1805790015=42, srv1875966297=52, srv617292336=89} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-19 00:53:16,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-19 00:53:16,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-19 00:53:16,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-19 00:53:16,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-19 00:53:16,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-19 00:53:16,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-19 00:53:16,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-19 00:53:16,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-19 00:53:16,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-19 00:53:16,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-19 00:53:16,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-19 00:53:16,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-19 00:53:16,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-19 00:53:16,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-19 00:53:16,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-19 00:53:16,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-19 00:53:16,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-19 00:53:16,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-19 00:53:16,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-19 00:53:16,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-19 00:53:16,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-19 00:53:16,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-19 00:53:16,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-19 00:53:16,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-19 00:53:16,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-19 00:53:16,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-19 00:53:16,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-19 00:53:16,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-19 00:53:16,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-19 00:53:16,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-19 00:53:16,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-19 00:53:16,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-19 00:53:16,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-19 00:53:16,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-19 00:53:16,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-19 00:53:16,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-19 00:53:16,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-19 00:53:16,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-19 00:53:16,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-19 00:53:16,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-19 00:53:16,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-19 00:53:16,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-19 00:53:16,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-19 00:53:16,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-19 00:53:16,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-19 00:53:16,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-19 00:53:16,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-19 00:53:16,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-19 00:53:16,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-19 00:53:16,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-19 00:53:16,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-19 00:53:16,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-19 00:53:16,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-19 00:53:16,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-19 00:53:16,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-19 00:53:16,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-19 00:53:16,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-19 00:53:16,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-19 00:53:16,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-19 00:53:16,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-19 00:53:16,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-19 00:53:16,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-19 00:53:16,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-19 00:53:16,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-19 00:53:16,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-19 00:53:16,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-19 00:53:16,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-19 00:53:16,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-19 00:53:16,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-19 00:53:16,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-19 00:53:16,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-19 00:53:16,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-19 00:53:16,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-19 00:53:16,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-19 00:53:16,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-19 00:53:16,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-19 00:53:16,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-19 00:53:16,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-19 00:53:16,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-19 00:53:16,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-19 00:53:16,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-19 00:53:16,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-19 00:53:16,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-19 00:53:16,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-19 00:53:16,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-19 00:53:16,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-19 00:53:16,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-19 00:53:16,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-19 00:53:16,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-19 00:53:16,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-19 00:53:16,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-19 00:53:16,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-19 00:53:16,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-19 00:53:16,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-19 00:53:16,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-19 00:53:16,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-19 00:53:16,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-19 00:53:16,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-19 00:53:16,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-19 00:53:16,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-19 00:53:16,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-19 00:53:16,644 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-19 00:53:16,644 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-09-19 00:53:16,645 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-09-19 00:53:17,021 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 534 ms to try 5000 different iterations.  Found a solution that moves 4729 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.1808834925531582. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.041123697530328004, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05596615940796425, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5254444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.041123697530328004, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17566666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24716666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-19 00:53:17,038 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1418135883:82 , srv1587021530:82 , srv7493924:82 , srv1083857583:83 , srv1241119813:83 , srv1634505799:83 , srv1669839367:83 , srv1773776967:83 , srv1807407250:83 , srv2037740323:83 , srv2112270972:83 , srv385640352:83 , srv411766767:83 , srv498988739:83 , srv588505057:83 , srv778148461:83 , srv923007739:83 , srv1130135281:84 , srv1145055772:84 , srv1510812525:84 , srv181151495:84 , srv1942990835:84 , srv2059142173:84 , srv220323738:84 , srv263551861:84 , srv265048299:84 , srv354190976:84 , srv400012267:84 , srv1000184426:85 , srv1008345322:85 , srv1127343032:85 , srv1195304882:85 , srv1319095712:85 , srv1408738766:85 , srv1489069661:85 , srv1621656725:85 , srv1655297758:85 , srv1762541862:85 , srv1880124456:85 , srv2108762727:85 , srv2129461379:85 , srv285186722:85 , srv366415742:85 , srv890457078:85 , srv911895754:85 , srv918517263:85 , srv955548255:85 , srv1044791856:86 , srv1213667577:86 , srv1291006697:86 , srv1292532270:86 , srv1612443687:86 , srv1629657332:86 , srv1838440573:86 , srv185256840:86 , srv1871315937:86 , srv1875966297:86 , srv1915754122:86 , srv440499582:86 , srv561135034:86 , srv834563301:86 , srv881726222:86 , srv1012209872:87 , srv1297451423:87 , srv1449333035:87 , srv1571012170:87 , srv1635503366:87 , srv1892907500:87 , srv1948965020:87 , srv2062154808:87 , srv257791792:87 , srv290921615:87 , srv785087697:87 , srv1258835321:88 , srv1719110060:88 , srv1729062263:88 , srv1822626525:88 , srv1944464619:88 , srv1996316540:88 , srv520552508:88 , srv56339348:88 , srv1165799614:89 , srv1419023443:89 , srv166762015:89 , srv1702814584:89 , srv1823517251:89 , srv41392230:89 , srv617292336:89 , srv25191683:90 , srv1026671180:91 , srv1345354122:91 , srv1826509293:91 , srv561773428:91 , srv251013835:92 , srv474031333:92 , srv1794099687:93 , srv1805790015:93 , srv1575300691:96 , srv2130483252:104 , srv185550815:455 }
2023-09-19 00:53:17,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-19 00:53:17,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv185256840=49, srv1213667577=11, srv1942990835=56, srv2130483252=66, srv354190976=75, srv918517263=97, srv1418135883=20, srv2112270972=64, srv2037740323=60, srv2059142173=61, srv498988739=83, srv1044791856=4, srv1083857583=5, srv778148461=91, srv1892907500=54, srv911895754=96, srv1702814584=36, srv1729062263=38, srv1510812525=24, srv520552508=84, srv1012209872=2, srv1145055772=8, srv2062154808=62, srv1621656725=29, srv561135034=85, srv1008345322=1, srv1823517251=46, srv56339348=87, srv1571012170=25, srv1419023443=21, srv1880124456=53, srv285186722=73, srv1292532270=15, srv1762541862=39, srv1575300691=26, srv2129461379=65, srv220323738=67, srv1944464619=57, srv1165799614=9, srv2108762727=63, srv1838440573=48, srv263551861=71, srv1130135281=7, srv25191683=69, srv181151495=44, srv1345354122=18, srv1612443687=28, srv1773776967=40, srv251013835=68, srv1948965020=58, srv166762015=34, srv1587021530=27, srv1408738766=19, srv1915754122=55, srv1826509293=47, srv785087697=92, srv1629657332=30, srv955548255=99, srv411766767=79, srv1996316540=59, srv1669839367=35, srv1794099687=41, srv1241119813=12, srv1000184426=0, srv1871315937=51, srv1719110060=37, srv1449333035=22, srv41392230=80, srv1297451423=16, srv588505057=88, srv366415742=76, srv1807407250=43, srv1822626525=45, srv1127343032=6, srv881726222=94, srv385640352=77, srv290921615=74, srv923007739=98, srv1258835321=13, srv561773428=86, srv1195304882=10, srv185550815=50, srv257791792=70, srv1319095712=17, srv834563301=93, srv265048299=72, srv1489069661=23, srv7493924=90, srv400012267=78, srv1026671180=3, srv1291006697=14, srv474031333=82, srv1635503366=32, srv1655297758=33, srv440499582=81, srv1634505799=31, srv890457078=95, srv1805790015=42, srv1875966297=52, srv617292336=89} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-19 00:53:17,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-19 00:53:17,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-19 00:53:17,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-19 00:53:17,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-19 00:53:17,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-19 00:53:17,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-19 00:53:17,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-19 00:53:17,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-19 00:53:17,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-19 00:53:17,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-19 00:53:17,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-19 00:53:17,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-19 00:53:17,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-19 00:53:17,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-19 00:53:17,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-19 00:53:17,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-19 00:53:17,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-19 00:53:17,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-19 00:53:17,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-19 00:53:17,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-19 00:53:17,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-19 00:53:17,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-19 00:53:17,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-19 00:53:17,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-19 00:53:17,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-19 00:53:17,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-19 00:53:17,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-19 00:53:17,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-19 00:53:17,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-19 00:53:17,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-19 00:53:17,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-19 00:53:17,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-19 00:53:17,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-19 00:53:17,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-19 00:53:17,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-19 00:53:17,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-19 00:53:17,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-19 00:53:17,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-19 00:53:17,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-19 00:53:17,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-19 00:53:17,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-19 00:53:17,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-19 00:53:17,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-19 00:53:17,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-19 00:53:17,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-19 00:53:17,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-19 00:53:17,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-19 00:53:17,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-19 00:53:17,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-19 00:53:17,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-19 00:53:17,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-19 00:53:17,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-19 00:53:17,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-19 00:53:17,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-19 00:53:17,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-19 00:53:17,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-19 00:53:17,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-19 00:53:17,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-19 00:53:17,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-19 00:53:17,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-19 00:53:17,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-19 00:53:17,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-19 00:53:17,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-19 00:53:17,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-19 00:53:17,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-19 00:53:17,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-19 00:53:17,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-19 00:53:17,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-19 00:53:17,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-19 00:53:17,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-19 00:53:17,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-19 00:53:17,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-19 00:53:17,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-19 00:53:17,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-19 00:53:17,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-19 00:53:17,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-19 00:53:17,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-19 00:53:17,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-19 00:53:17,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-19 00:53:17,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-19 00:53:17,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-19 00:53:17,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-19 00:53:17,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-19 00:53:17,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-19 00:53:17,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-19 00:53:17,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-19 00:53:17,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-19 00:53:17,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-19 00:53:17,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-19 00:53:17,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-19 00:53:17,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-19 00:53:17,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-19 00:53:17,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-19 00:53:17,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-19 00:53:17,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-19 00:53:17,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-19 00:53:17,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-19 00:53:17,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-19 00:53:17,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-19 00:53:17,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-19 00:53:17,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-19 00:53:17,279 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.041123697530328004, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05596615940796425, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.041123697530328004, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17566666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24716666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-19 00:53:17,280 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-09-19 00:53:17,280 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18085037938741633, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.041123697530328004, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05596615940796425, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.041123697530328004, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17566666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24716666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-09-19 00:53:17,661 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 539 ms to try 5000 different iterations.  Found a solution that moves 2596 regions; Going from a computed imbalance of 0.18085037938741633 to a new imbalance of 0.017173267910997027. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022171659648805984); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0356815947865218, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.28844444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022171659648805984); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01425); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.045083333333333336, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-19 00:53:17,674 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv2130483252:68 , srv1575300691:75 , srv1805790015:78 , srv561773428:79 , srv1026671180:80 , srv251013835:80 , srv166762015:81 , srv1794099687:81 , srv1826509293:81 , srv474031333:81 , srv1345354122:82 , srv617292336:82 , srv1012209872:83 , srv1729062263:83 , srv1944464619:83 , srv25191683:83 , srv1258835321:84 , srv1419023443:84 , srv1635503366:84 , srv1702814584:84 , srv1719110060:84 , srv1822626525:84 , srv1823517251:84 , srv1871315937:84 , srv1892907500:84 , srv1948965020:84 , srv1996316540:84 , srv41392230:84 , srv520552508:84 , srv561135034:84 , srv1165799614:85 , srv1291006697:85 , srv1319095712:85 , srv1449333035:85 , srv1489069661:85 , srv1612443687:85 , srv1655297758:85 , srv1838440573:85 , srv2062154808:85 , srv285186722:85 , srv785087697:85 , srv918517263:85 , srv1000184426:86 , srv1297451423:86 , srv1408738766:86 , srv181151495:86 , srv1915754122:86 , srv440499582:86 , srv881726222:86 , srv955548255:86 , srv1083857583:87 , srv1130135281:87 , srv1213667577:87 , srv1510812525:87 , srv1571012170:87 , srv1621656725:87 , srv1669839367:87 , srv185256840:87 , srv1875966297:87 , srv1880124456:87 , srv2112270972:87 , srv220323738:87 , srv257791792:87 , srv263551861:87 , srv400012267:87 , srv56339348:87 , srv778148461:87 , srv834563301:87 , srv923007739:87 , srv1195304882:88 , srv1241119813:88 , srv1292532270:88 , srv1587021530:88 , srv1634505799:88 , srv1762541862:88 , srv1807407250:88 , srv265048299:88 , srv290921615:88 , srv366415742:88 , srv498988739:88 , srv1008345322:89 , srv1044791856:89 , srv1127343032:89 , srv1418135883:89 , srv1629657332:89 , srv1773776967:89 , srv1942990835:89 , srv2037740323:89 , srv2059142173:89 , srv2108762727:89 , srv411766767:89 , srv588505057:89 , srv911895754:89 , srv2129461379:90 , srv385640352:90 , srv7493924:90 , srv890457078:90 , srv1145055772:91 , srv354190976:91 , srv185550815:516 }
2023-09-19 00:53:17,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-19 00:53:17,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv185256840=49, srv1213667577=11, srv1942990835=56, srv2130483252=66, srv354190976=75, srv918517263=97, srv1418135883=20, srv2112270972=64, srv2037740323=60, srv2059142173=61, srv498988739=83, srv1044791856=4, srv1083857583=5, srv778148461=91, srv1892907500=54, srv911895754=96, srv1702814584=36, srv1729062263=38, srv1510812525=24, srv520552508=84, srv1012209872=2, srv1145055772=8, srv2062154808=62, srv1621656725=29, srv561135034=85, srv1008345322=1, srv1823517251=46, srv56339348=87, srv1571012170=25, srv1419023443=21, srv1880124456=53, srv285186722=73, srv1292532270=15, srv1762541862=39, srv1575300691=26, srv2129461379=65, srv220323738=67, srv1944464619=57, srv1165799614=9, srv2108762727=63, srv1838440573=48, srv263551861=71, srv1130135281=7, srv25191683=69, srv181151495=44, srv1345354122=18, srv1612443687=28, srv1773776967=40, srv251013835=68, srv1948965020=58, srv166762015=34, srv1587021530=27, srv1408738766=19, srv1915754122=55, srv1826509293=47, srv785087697=92, srv1629657332=30, srv955548255=99, srv411766767=79, srv1996316540=59, srv1669839367=35, srv1794099687=41, srv1241119813=12, srv1000184426=0, srv1871315937=51, srv1719110060=37, srv1449333035=22, srv41392230=80, srv1297451423=16, srv588505057=88, srv366415742=76, srv1807407250=43, srv1822626525=45, srv1127343032=6, srv881726222=94, srv385640352=77, srv290921615=74, srv923007739=98, srv1258835321=13, srv561773428=86, srv1195304882=10, srv185550815=50, srv257791792=70, srv1319095712=17, srv834563301=93, srv265048299=72, srv1489069661=23, srv7493924=90, srv400012267=78, srv1026671180=3, srv1291006697=14, srv474031333=82, srv1635503366=32, srv1655297758=33, srv440499582=81, srv1634505799=31, srv890457078=95, srv1805790015=42, srv1875966297=52, srv617292336=89} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-19 00:53:17,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-19 00:53:17,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-19 00:53:17,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-19 00:53:17,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-19 00:53:17,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-19 00:53:17,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-19 00:53:17,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-19 00:53:17,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-19 00:53:17,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-19 00:53:17,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-19 00:53:17,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-19 00:53:17,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-19 00:53:17,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-19 00:53:17,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-19 00:53:17,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-19 00:53:17,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-19 00:53:17,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-19 00:53:17,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-19 00:53:17,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-19 00:53:17,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-19 00:53:17,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-19 00:53:17,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-19 00:53:17,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-19 00:53:17,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-19 00:53:17,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-19 00:53:17,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-19 00:53:17,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-19 00:53:17,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-19 00:53:17,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-19 00:53:17,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-19 00:53:17,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-19 00:53:17,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-19 00:53:17,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-19 00:53:17,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-19 00:53:17,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-19 00:53:17,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-19 00:53:17,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-19 00:53:17,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-19 00:53:17,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-19 00:53:17,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-19 00:53:17,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-19 00:53:17,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-19 00:53:17,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-19 00:53:17,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-19 00:53:17,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-19 00:53:17,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-19 00:53:17,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-19 00:53:17,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-19 00:53:17,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-19 00:53:17,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-19 00:53:17,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-19 00:53:17,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-19 00:53:17,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-19 00:53:17,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-19 00:53:17,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-19 00:53:17,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-19 00:53:17,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-19 00:53:17,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-19 00:53:17,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-19 00:53:17,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-19 00:53:17,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-19 00:53:17,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-19 00:53:17,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-19 00:53:17,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-19 00:53:17,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-19 00:53:17,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-19 00:53:17,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-19 00:53:17,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-19 00:53:17,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-19 00:53:17,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-19 00:53:17,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-19 00:53:17,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-19 00:53:17,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-19 00:53:17,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-19 00:53:17,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-19 00:53:17,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-19 00:53:17,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-19 00:53:17,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-19 00:53:17,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-19 00:53:17,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-19 00:53:17,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-19 00:53:17,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-19 00:53:17,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-19 00:53:17,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-19 00:53:17,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-19 00:53:17,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-19 00:53:17,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-19 00:53:17,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-19 00:53:17,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-19 00:53:17,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-19 00:53:17,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-19 00:53:17,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-19 00:53:17,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-19 00:53:17,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-19 00:53:17,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-19 00:53:17,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-19 00:53:17,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-19 00:53:17,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-19 00:53:17,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-19 00:53:17,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-19 00:53:17,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-19 00:53:17,895 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022171659648805984); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0356815947865218, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022171659648805984); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01425); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.045083333333333336, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-19 00:53:17,896 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-09-19 00:53:17,896 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.017155090330479808, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022171659648805984); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0356815947865218, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022171659648805984); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01425); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.045083333333333336, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-09-19 00:53:18,294 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 535 ms to try 5000 different iterations.  Found a solution that moves 1008 regions; Going from a computed imbalance of 0.017155090330479808 to a new imbalance of 0.001162514549089774. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007106690545187014); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0107517649218062); MoveCostFunction : (multiplier=7.0, imbalance=0.112, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007106690545187014); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=7.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004416666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-19 00:53:18,296 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1629657332:82 , srv290921615:82 , srv1145055772:83 , srv1165799614:83 , srv1345354122:83 , srv1571012170:83 , srv2129461379:83 , srv257791792:83 , srv354190976:83 , srv56339348:83 , srv890457078:83 , srv911895754:83 , srv1044791856:84 , srv1127343032:84 , srv1195304882:84 , srv1213667577:84 , srv1292532270:84 , srv1621656725:84 , srv1794099687:84 , srv1823517251:84 , srv1875966297:84 , srv2059142173:84 , srv2108762727:84 , srv265048299:84 , srv366415742:84 , srv385640352:84 , srv1008345322:85 , srv1258835321:85 , srv1297451423:85 , srv1419023443:85 , srv1449333035:85 , srv1702814584:85 , srv1762541862:85 , srv1773776967:85 , srv1805790015:85 , srv1822626525:85 , srv1826509293:85 , srv185256840:85 , srv1880124456:85 , srv1942990835:85 , srv1996316540:85 , srv2037740323:85 , srv2062154808:85 , srv2130483252:85 , srv251013835:85 , srv25191683:85 , srv411766767:85 , srv41392230:85 , srv440499582:85 , srv520552508:85 , srv7493924:85 , srv785087697:85 , srv834563301:85 , srv881726222:85 , srv1000184426:86 , srv1026671180:86 , srv1291006697:86 , srv1319095712:86 , srv1408738766:86 , srv1418135883:86 , srv1510812525:86 , srv1575300691:86 , srv1634505799:86 , srv1635503366:86 , srv1719110060:86 , srv1729062263:86 , srv1838440573:86 , srv1892907500:86 , srv400012267:86 , srv474031333:86 , srv498988739:86 , srv588505057:86 , srv617292336:86 , srv955548255:86 , srv1012209872:87 , srv1130135281:87 , srv1241119813:87 , srv1489069661:87 , srv1612443687:87 , srv1655297758:87 , srv166762015:87 , srv1669839367:87 , srv1807407250:87 , srv181151495:87 , srv1915754122:87 , srv1944464619:87 , srv1948965020:87 , srv2112270972:87 , srv220323738:87 , srv263551861:87 , srv561135034:87 , srv561773428:87 , srv918517263:87 , srv923007739:87 , srv1083857583:88 , srv1587021530:88 , srv1871315937:88 , srv285186722:88 , srv778148461:88 , srv185550815:550 }
2023-09-19 00:53:18,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-19 00:53:18,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv185256840=49, srv1213667577=11, srv1942990835=56, srv2130483252=66, srv354190976=75, srv918517263=97, srv1418135883=20, srv2112270972=64, srv2037740323=60, srv2059142173=61, srv498988739=83, srv1044791856=4, srv1083857583=5, srv778148461=91, srv1892907500=54, srv911895754=96, srv1702814584=36, srv1729062263=38, srv1510812525=24, srv520552508=84, srv1012209872=2, srv1145055772=8, srv2062154808=62, srv1621656725=29, srv561135034=85, srv1008345322=1, srv1823517251=46, srv56339348=87, srv1571012170=25, srv1419023443=21, srv1880124456=53, srv285186722=73, srv1292532270=15, srv1762541862=39, srv1575300691=26, srv2129461379=65, srv220323738=67, srv1944464619=57, srv1165799614=9, srv2108762727=63, srv1838440573=48, srv263551861=71, srv1130135281=7, srv25191683=69, srv181151495=44, srv1345354122=18, srv1612443687=28, srv1773776967=40, srv251013835=68, srv1948965020=58, srv166762015=34, srv1587021530=27, srv1408738766=19, srv1915754122=55, srv1826509293=47, srv785087697=92, srv1629657332=30, srv955548255=99, srv411766767=79, srv1996316540=59, srv1669839367=35, srv1794099687=41, srv1241119813=12, srv1000184426=0, srv1871315937=51, srv1719110060=37, srv1449333035=22, srv41392230=80, srv1297451423=16, srv588505057=88, srv366415742=76, srv1807407250=43, srv1822626525=45, srv1127343032=6, srv881726222=94, srv385640352=77, srv290921615=74, srv923007739=98, srv1258835321=13, srv561773428=86, srv1195304882=10, srv185550815=50, srv257791792=70, srv1319095712=17, srv834563301=93, srv265048299=72, srv1489069661=23, srv7493924=90, srv400012267=78, srv1026671180=3, srv1291006697=14, srv474031333=82, srv1635503366=32, srv1655297758=33, srv440499582=81, srv1634505799=31, srv890457078=95, srv1805790015=42, srv1875966297=52, srv617292336=89} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-19 00:53:18,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-19 00:53:18,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-19 00:53:18,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-19 00:53:18,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-19 00:53:18,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-19 00:53:18,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-19 00:53:18,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-19 00:53:18,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-19 00:53:18,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-19 00:53:18,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-19 00:53:18,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-19 00:53:18,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-19 00:53:18,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-19 00:53:18,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-19 00:53:18,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-19 00:53:18,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-19 00:53:18,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-19 00:53:18,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-19 00:53:18,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-19 00:53:18,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-19 00:53:18,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-19 00:53:18,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-19 00:53:18,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-19 00:53:18,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-19 00:53:18,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-19 00:53:18,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-19 00:53:18,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-19 00:53:18,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-19 00:53:18,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-19 00:53:18,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-19 00:53:18,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-19 00:53:18,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-19 00:53:18,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-19 00:53:18,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-19 00:53:18,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-19 00:53:18,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-19 00:53:18,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-19 00:53:18,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-19 00:53:18,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-19 00:53:18,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-19 00:53:18,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-19 00:53:18,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-19 00:53:18,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-19 00:53:18,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-19 00:53:18,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-19 00:53:18,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-19 00:53:18,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-19 00:53:18,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-19 00:53:18,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-19 00:53:18,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-19 00:53:18,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-19 00:53:18,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-19 00:53:18,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-19 00:53:18,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-19 00:53:18,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-19 00:53:18,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-19 00:53:18,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-19 00:53:18,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-19 00:53:18,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-19 00:53:18,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-19 00:53:18,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-19 00:53:18,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-19 00:53:18,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-19 00:53:18,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-19 00:53:18,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-19 00:53:18,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-19 00:53:18,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-19 00:53:18,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-19 00:53:18,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-19 00:53:18,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-19 00:53:18,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-19 00:53:18,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-19 00:53:18,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-19 00:53:18,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-19 00:53:18,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-19 00:53:18,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-19 00:53:18,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-19 00:53:18,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-19 00:53:18,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-19 00:53:18,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-19 00:53:18,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-19 00:53:18,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-19 00:53:18,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-19 00:53:18,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-19 00:53:18,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-19 00:53:18,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-19 00:53:18,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-19 00:53:18,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-19 00:53:18,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-19 00:53:18,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-19 00:53:18,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-19 00:53:18,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-19 00:53:18,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-19 00:53:18,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-19 00:53:18,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-19 00:53:18,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-19 00:53:18,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-19 00:53:18,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-19 00:53:18,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-19 00:53:18,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-19 00:53:18,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-19 00:53:18,459 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007106690545187014); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0107517649218062); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007106690545187014); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=7.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004416666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-19 00:53:18,460 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-09-19 00:53:18,460 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.0011554563822325488, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007106690545187014); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0107517649218062); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007106690545187014); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=7.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004416666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-09-19 00:53:18,840 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 490 ms to try 5000 different iterations.  Found a solution that moves 272 regions; Going from a computed imbalance of 0.0011554563822325488 to a new imbalance of 2.8362693860466967E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002010075630518424); MoveCostFunction : (multiplier=7.0, imbalance=0.030222222222222223, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-19 00:53:18,841 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1008345322:83 , srv1044791856:83 , srv1915754122:83 , srv400012267:83 , srv474031333:83 , srv1083857583:84 , srv1130135281:84 , srv1145055772:84 , srv1241119813:84 , srv1258835321:84 , srv1292532270:84 , srv1297451423:84 , srv1419023443:84 , srv1587021530:84 , srv1612443687:84 , srv166762015:84 , srv1702814584:84 , srv1719110060:84 , srv1729062263:84 , srv1762541862:84 , srv1794099687:84 , srv1807407250:84 , srv185256840:84 , srv1871315937:84 , srv1892907500:84 , srv1944464619:84 , srv1948965020:84 , srv2108762727:84 , srv2129461379:84 , srv220323738:84 , srv285186722:84 , srv41392230:84 , srv561135034:84 , srv588505057:84 , srv7493924:84 , srv778148461:84 , srv834563301:84 , srv890457078:84 , srv1000184426:85 , srv1012209872:85 , srv1026671180:85 , srv1127343032:85 , srv1165799614:85 , srv1195304882:85 , srv1213667577:85 , srv1291006697:85 , srv1319095712:85 , srv1408738766:85 , srv1418135883:85 , srv1449333035:85 , srv1510812525:85 , srv1571012170:85 , srv1575300691:85 , srv1629657332:85 , srv1634505799:85 , srv1635503366:85 , srv1655297758:85 , srv1669839367:85 , srv1773776967:85 , srv181151495:85 , srv1822626525:85 , srv1823517251:85 , srv1826509293:85 , srv1838440573:85 , srv1880124456:85 , srv1942990835:85 , srv1996316540:85 , srv2037740323:85 , srv2059142173:85 , srv2062154808:85 , srv2112270972:85 , srv2130483252:85 , srv251013835:85 , srv25191683:85 , srv257791792:85 , srv263551861:85 , srv290921615:85 , srv354190976:85 , srv366415742:85 , srv385640352:85 , srv411766767:85 , srv440499582:85 , srv498988739:85 , srv520552508:85 , srv561773428:85 , srv56339348:85 , srv617292336:85 , srv785087697:85 , srv881726222:85 , srv911895754:85 , srv918517263:85 , srv923007739:85 , srv955548255:85 , srv1345354122:86 , srv1489069661:86 , srv1621656725:86 , srv1805790015:86 , srv1875966297:86 , srv265048299:87 , srv185550815:621 }
2023-09-19 00:53:18,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-19 00:53:18,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv185256840=49, srv1213667577=11, srv1942990835=56, srv2130483252=66, srv354190976=75, srv918517263=97, srv1418135883=20, srv2112270972=64, srv2037740323=60, srv2059142173=61, srv498988739=83, srv1044791856=4, srv1083857583=5, srv778148461=91, srv1892907500=54, srv911895754=96, srv1702814584=36, srv1729062263=38, srv1510812525=24, srv520552508=84, srv1012209872=2, srv1145055772=8, srv2062154808=62, srv1621656725=29, srv561135034=85, srv1008345322=1, srv1823517251=46, srv56339348=87, srv1571012170=25, srv1419023443=21, srv1880124456=53, srv285186722=73, srv1292532270=15, srv1762541862=39, srv1575300691=26, srv2129461379=65, srv220323738=67, srv1944464619=57, srv1165799614=9, srv2108762727=63, srv1838440573=48, srv263551861=71, srv1130135281=7, srv25191683=69, srv181151495=44, srv1345354122=18, srv1612443687=28, srv1773776967=40, srv251013835=68, srv1948965020=58, srv166762015=34, srv1587021530=27, srv1408738766=19, srv1915754122=55, srv1826509293=47, srv785087697=92, srv1629657332=30, srv955548255=99, srv411766767=79, srv1996316540=59, srv1669839367=35, srv1794099687=41, srv1241119813=12, srv1000184426=0, srv1871315937=51, srv1719110060=37, srv1449333035=22, srv41392230=80, srv1297451423=16, srv588505057=88, srv366415742=76, srv1807407250=43, srv1822626525=45, srv1127343032=6, srv881726222=94, srv385640352=77, srv290921615=74, srv923007739=98, srv1258835321=13, srv561773428=86, srv1195304882=10, srv185550815=50, srv257791792=70, srv1319095712=17, srv834563301=93, srv265048299=72, srv1489069661=23, srv7493924=90, srv400012267=78, srv1026671180=3, srv1291006697=14, srv474031333=82, srv1635503366=32, srv1655297758=33, srv440499582=81, srv1634505799=31, srv890457078=95, srv1805790015=42, srv1875966297=52, srv617292336=89} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-19 00:53:18,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-19 00:53:18,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-19 00:53:18,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-19 00:53:18,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-19 00:53:18,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-19 00:53:18,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-19 00:53:18,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-19 00:53:18,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-19 00:53:18,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-19 00:53:18,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-19 00:53:18,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-19 00:53:18,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-19 00:53:18,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-19 00:53:18,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-19 00:53:18,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-19 00:53:18,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-19 00:53:18,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-19 00:53:18,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-19 00:53:18,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-19 00:53:18,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-19 00:53:18,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-19 00:53:18,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-19 00:53:18,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-19 00:53:18,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-19 00:53:18,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-19 00:53:18,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-19 00:53:18,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-19 00:53:18,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-19 00:53:18,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-19 00:53:18,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-19 00:53:18,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-19 00:53:18,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-19 00:53:18,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-19 00:53:18,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-19 00:53:18,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-19 00:53:18,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-19 00:53:18,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-19 00:53:18,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-19 00:53:18,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-19 00:53:18,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-19 00:53:18,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-19 00:53:18,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-19 00:53:18,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-19 00:53:18,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-19 00:53:18,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-19 00:53:18,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-19 00:53:18,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-19 00:53:18,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-19 00:53:18,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-19 00:53:18,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-19 00:53:18,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-19 00:53:18,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-19 00:53:18,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-19 00:53:18,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-19 00:53:18,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-19 00:53:18,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-19 00:53:18,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-19 00:53:18,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-19 00:53:18,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-19 00:53:18,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-19 00:53:18,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-19 00:53:18,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-19 00:53:18,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-19 00:53:18,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-19 00:53:18,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-19 00:53:18,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-19 00:53:18,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-19 00:53:18,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-19 00:53:18,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-19 00:53:18,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-19 00:53:18,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-19 00:53:18,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-19 00:53:18,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-19 00:53:18,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-19 00:53:18,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-19 00:53:18,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-19 00:53:18,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-19 00:53:18,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-19 00:53:18,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-19 00:53:18,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-19 00:53:18,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-19 00:53:18,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-19 00:53:18,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-19 00:53:18,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-19 00:53:18,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-19 00:53:18,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-19 00:53:18,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-19 00:53:18,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-19 00:53:18,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-19 00:53:18,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-19 00:53:18,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-19 00:53:18,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-19 00:53:18,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-19 00:53:18,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-19 00:53:18,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-19 00:53:18,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-19 00:53:18,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-19 00:53:18,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-19 00:53:18,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-19 00:53:18,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-19 00:53:18,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-19 00:53:18,965 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002010075630518424); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-19 00:53:18,965 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-09-19 00:53:18,965 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.6458109152961765E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002010075630518424); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-09-19 00:53:19,204 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 331 ms to try 5000 different iterations.  Found a solution that moves 21 regions; Going from a computed imbalance of 2.6458109152961765E-5 to a new imbalance of 7.83646694320964E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.0023333333333333335); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-19 00:53:19,205 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1127343032:83 , srv1489069661:83 , srv1875966297:83 , srv1942990835:83 , srv25191683:83 , srv263551861:83 , srv265048299:83 , srv354190976:83 , srv56339348:83 , srv1000184426:84 , srv1008345322:84 , srv1012209872:84 , srv1026671180:84 , srv1044791856:84 , srv1083857583:84 , srv1130135281:84 , srv1145055772:84 , srv1165799614:84 , srv1195304882:84 , srv1213667577:84 , srv1241119813:84 , srv1291006697:84 , srv1292532270:84 , srv1297451423:84 , srv1345354122:84 , srv1408738766:84 , srv1418135883:84 , srv1419023443:84 , srv1449333035:84 , srv1510812525:84 , srv1571012170:84 , srv1575300691:84 , srv1587021530:84 , srv1612443687:84 , srv1621656725:84 , srv1629657332:84 , srv1634505799:84 , srv1635503366:84 , srv1655297758:84 , srv1669839367:84 , srv1702814584:84 , srv1719110060:84 , srv1762541862:84 , srv1773776967:84 , srv1794099687:84 , srv1805790015:84 , srv1807407250:84 , srv181151495:84 , srv1822626525:84 , srv1823517251:84 , srv1826509293:84 , srv1838440573:84 , srv185256840:84 , srv1871315937:84 , srv1880124456:84 , srv1915754122:84 , srv1944464619:84 , srv1948965020:84 , srv1996316540:84 , srv2037740323:84 , srv2059142173:84 , srv2062154808:84 , srv2108762727:84 , srv2112270972:84 , srv2129461379:84 , srv2130483252:84 , srv220323738:84 , srv251013835:84 , srv257791792:84 , srv285186722:84 , srv290921615:84 , srv366415742:84 , srv385640352:84 , srv411766767:84 , srv41392230:84 , srv440499582:84 , srv474031333:84 , srv498988739:84 , srv520552508:84 , srv561773428:84 , srv588505057:84 , srv617292336:84 , srv778148461:84 , srv785087697:84 , srv834563301:84 , srv881726222:84 , srv890457078:84 , srv911895754:84 , srv918517263:84 , srv923007739:84 , srv955548255:84 , srv1258835321:85 , srv1319095712:85 , srv166762015:85 , srv1729062263:85 , srv1892907500:85 , srv561135034:85 , srv7493924:85 , srv400012267:86 , srv185550815:684 }
2023-09-19 00:53:19,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-19 00:53:19,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv185256840=49, srv1213667577=11, srv1942990835=56, srv2130483252=66, srv354190976=75, srv918517263=97, srv1418135883=20, srv2112270972=64, srv2037740323=60, srv2059142173=61, srv498988739=83, srv1044791856=4, srv1083857583=5, srv778148461=91, srv1892907500=54, srv911895754=96, srv1702814584=36, srv1729062263=38, srv1510812525=24, srv520552508=84, srv1012209872=2, srv1145055772=8, srv2062154808=62, srv1621656725=29, srv561135034=85, srv1008345322=1, srv1823517251=46, srv56339348=87, srv1571012170=25, srv1419023443=21, srv1880124456=53, srv285186722=73, srv1292532270=15, srv1762541862=39, srv1575300691=26, srv2129461379=65, srv220323738=67, srv1944464619=57, srv1165799614=9, srv2108762727=63, srv1838440573=48, srv263551861=71, srv1130135281=7, srv25191683=69, srv181151495=44, srv1345354122=18, srv1612443687=28, srv1773776967=40, srv251013835=68, srv1948965020=58, srv166762015=34, srv1587021530=27, srv1408738766=19, srv1915754122=55, srv1826509293=47, srv785087697=92, srv1629657332=30, srv955548255=99, srv411766767=79, srv1996316540=59, srv1669839367=35, srv1794099687=41, srv1241119813=12, srv1000184426=0, srv1871315937=51, srv1719110060=37, srv1449333035=22, srv41392230=80, srv1297451423=16, srv588505057=88, srv366415742=76, srv1807407250=43, srv1822626525=45, srv1127343032=6, srv881726222=94, srv385640352=77, srv290921615=74, srv923007739=98, srv1258835321=13, srv561773428=86, srv1195304882=10, srv185550815=50, srv257791792=70, srv1319095712=17, srv834563301=93, srv265048299=72, srv1489069661=23, srv7493924=90, srv400012267=78, srv1026671180=3, srv1291006697=14, srv474031333=82, srv1635503366=32, srv1655297758=33, srv440499582=81, srv1634505799=31, srv890457078=95, srv1805790015=42, srv1875966297=52, srv617292336=89} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-19 00:53:19,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-19 00:53:19,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-19 00:53:19,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-19 00:53:19,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-19 00:53:19,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-19 00:53:19,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-19 00:53:19,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-19 00:53:19,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-19 00:53:19,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-19 00:53:19,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-19 00:53:19,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-19 00:53:19,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-19 00:53:19,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-19 00:53:19,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-19 00:53:19,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-19 00:53:19,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-19 00:53:19,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-19 00:53:19,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-19 00:53:19,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-19 00:53:19,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-19 00:53:19,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-19 00:53:19,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-19 00:53:19,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-19 00:53:19,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-19 00:53:19,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-19 00:53:19,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-19 00:53:19,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-19 00:53:19,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-19 00:53:19,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-19 00:53:19,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-19 00:53:19,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-19 00:53:19,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-19 00:53:19,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-19 00:53:19,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-19 00:53:19,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-19 00:53:19,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-19 00:53:19,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-19 00:53:19,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-19 00:53:19,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-19 00:53:19,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-19 00:53:19,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-19 00:53:19,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-19 00:53:19,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-19 00:53:19,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-19 00:53:19,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-19 00:53:19,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-19 00:53:19,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-19 00:53:19,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-19 00:53:19,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-19 00:53:19,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-19 00:53:19,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-19 00:53:19,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-19 00:53:19,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-19 00:53:19,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-19 00:53:19,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-19 00:53:19,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-19 00:53:19,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-19 00:53:19,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-19 00:53:19,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-19 00:53:19,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-19 00:53:19,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-19 00:53:19,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-19 00:53:19,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-19 00:53:19,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-19 00:53:19,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-19 00:53:19,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-19 00:53:19,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-19 00:53:19,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-19 00:53:19,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-19 00:53:19,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-19 00:53:19,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-19 00:53:19,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-19 00:53:19,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-19 00:53:19,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-19 00:53:19,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-19 00:53:19,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-19 00:53:19,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-19 00:53:19,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-19 00:53:19,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-19 00:53:19,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-19 00:53:19,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-19 00:53:19,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-19 00:53:19,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-19 00:53:19,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-19 00:53:19,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-19 00:53:19,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-19 00:53:19,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-19 00:53:19,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-19 00:53:19,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-19 00:53:19,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-19 00:53:19,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-19 00:53:19,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-19 00:53:19,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-19 00:53:19,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-19 00:53:19,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-19 00:53:19,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-19 00:53:19,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-19 00:53:19,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-19 00:53:19,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-19 00:53:19,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-19 00:53:19,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-19 00:53:19,343 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.689421800350782E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-19 00:53:19,344 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1127343032:83 , srv1489069661:83 , srv1875966297:83 , srv1942990835:83 , srv25191683:83 , srv263551861:83 , srv265048299:83 , srv354190976:83 , srv56339348:83 , srv1000184426:84 , srv1008345322:84 , srv1012209872:84 , srv1026671180:84 , srv1044791856:84 , srv1083857583:84 , srv1130135281:84 , srv1145055772:84 , srv1165799614:84 , srv1195304882:84 , srv1213667577:84 , srv1241119813:84 , srv1291006697:84 , srv1292532270:84 , srv1297451423:84 , srv1345354122:84 , srv1408738766:84 , srv1418135883:84 , srv1419023443:84 , srv1449333035:84 , srv1510812525:84 , srv1571012170:84 , srv1575300691:84 , srv1587021530:84 , srv1612443687:84 , srv1621656725:84 , srv1629657332:84 , srv1634505799:84 , srv1635503366:84 , srv1655297758:84 , srv1669839367:84 , srv1702814584:84 , srv1719110060:84 , srv1762541862:84 , srv1773776967:84 , srv1794099687:84 , srv1805790015:84 , srv1807407250:84 , srv181151495:84 , srv1822626525:84 , srv1823517251:84 , srv1826509293:84 , srv1838440573:84 , srv185256840:84 , srv1871315937:84 , srv1880124456:84 , srv1915754122:84 , srv1944464619:84 , srv1948965020:84 , srv1996316540:84 , srv2037740323:84 , srv2059142173:84 , srv2062154808:84 , srv2108762727:84 , srv2112270972:84 , srv2129461379:84 , srv2130483252:84 , srv220323738:84 , srv251013835:84 , srv257791792:84 , srv285186722:84 , srv290921615:84 , srv366415742:84 , srv385640352:84 , srv411766767:84 , srv41392230:84 , srv440499582:84 , srv474031333:84 , srv498988739:84 , srv520552508:84 , srv561773428:84 , srv588505057:84 , srv617292336:84 , srv778148461:84 , srv785087697:84 , srv834563301:84 , srv881726222:84 , srv890457078:84 , srv911895754:84 , srv918517263:84 , srv923007739:84 , srv955548255:84 , srv1258835321:85 , srv1319095712:85 , srv166762015:85 , srv1729062263:85 , srv1892907500:85 , srv561135034:85 , srv7493924:85 , srv400012267:86 , srv185550815:684 }
2023-09-19 00:53:19,369 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=276 (was 256) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 169), AvailableMemoryMB=10123 (was 10764)
2023-09-19 00:53:19,379 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=276, ProcessCount=169, AvailableMemoryMB=10123
2023-09-19 00:53:19,380 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-09-19 00:53:19,380 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-09-19 00:53:19,388 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1192494527:84 , srv1433869677:84 , srv1448803218:84 , srv1479728021:84 , srv1518013972:84 , srv1554840375:84 , srv177076591:84 , srv1835831345:84 , srv1850462698:84 , srv1975155369:84 , srv199886490:84 , srv2010708436:84 , srv2024654638:84 , srv2028880740:84 , srv2042490404:84 , srv255161211:84 , srv280126125:84 , srv3254931:84 , srv443940894:84 , srv493904687:84 , srv519745359:84 , srv620991187:84 , srv630277003:84 , srv653565365:84 , srv683281372:84 , srv692290174:84 , srv814186922:84 , srv933781168:84 , srv986749668:84 , srv1473121620:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-09-19 00:53:19,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-19 00:53:19,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1518013972=5, srv1433869677=1, srv692290174=26, srv620991187=22, srv814186922=27, srv683281372=25, srv653565365=24, srv1554840375=6, srv1975155369=10, srv2028880740=14, srv1448803218=2, srv177076591=7, srv1850462698=9, srv2010708436=12, srv443940894=19, srv1192494527=0, srv493904687=20, srv2024654638=13, srv1473121620=3, srv280126125=17, srv199886490=11, srv255161211=16, srv519745359=21, srv630277003=23, srv3254931=18, srv2042490404=15, srv933781168=28, srv1835831345=8, srv986749668=29, srv1479728021=4} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-19 00:53:19,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-19 00:53:19,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-19 00:53:19,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-19 00:53:19,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-19 00:53:19,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-19 00:53:19,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-19 00:53:19,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-19 00:53:19,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-19 00:53:19,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-19 00:53:19,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-19 00:53:19,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-19 00:53:19,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-19 00:53:19,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-19 00:53:19,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-19 00:53:19,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-19 00:53:19,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-19 00:53:19,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-19 00:53:19,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-19 00:53:19,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-19 00:53:19,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-19 00:53:19,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-19 00:53:19,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-19 00:53:19,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-19 00:53:19,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-19 00:53:19,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-19 00:53:19,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-19 00:53:19,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-19 00:53:19,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-19 00:53:19,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-19 00:53:19,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-19 00:53:19,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-09-19 00:53:19,414 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1219294947206628, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-19 00:53:19,414 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.991257723912078, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1219294947206628, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-09-19 00:55:19,402 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5680737 different iterations.  Found a solution that moves 1851 regions; Going from a computed imbalance of 0.991257723912078 to a new imbalance of 4.320326340186438E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6855555555555556, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-19 00:55:19,410 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1192494527:90 , srv1433869677:90 , srv1448803218:90 , srv1473121620:90 , srv1479728021:90 , srv1518013972:90 , srv1554840375:90 , srv177076591:90 , srv1835831345:90 , srv1850462698:90 , srv1975155369:90 , srv199886490:90 , srv2010708436:90 , srv2024654638:90 , srv2028880740:90 , srv2042490404:90 , srv255161211:90 , srv280126125:90 , srv3254931:90 , srv443940894:90 , srv493904687:90 , srv519745359:90 , srv620991187:90 , srv630277003:90 , srv653565365:90 , srv683281372:90 , srv692290174:90 , srv814186922:90 , srv933781168:90 , srv986749668:90 }
2023-09-19 00:55:19,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-19 00:55:19,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1518013972=5, srv1433869677=1, srv692290174=26, srv620991187=22, srv814186922=27, srv683281372=25, srv653565365=24, srv1554840375=6, srv1975155369=10, srv2028880740=14, srv1448803218=2, srv177076591=7, srv1850462698=9, srv2010708436=12, srv443940894=19, srv1192494527=0, srv493904687=20, srv2024654638=13, srv1473121620=3, srv280126125=17, srv199886490=11, srv255161211=16, srv519745359=21, srv630277003=23, srv3254931=18, srv2042490404=15, srv933781168=28, srv1835831345=8, srv986749668=29, srv1479728021=4} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-19 00:55:19,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-19 00:55:19,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-19 00:55:19,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-19 00:55:19,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-19 00:55:19,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-19 00:55:19,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-19 00:55:19,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-19 00:55:19,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-19 00:55:19,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-19 00:55:19,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-19 00:55:19,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-19 00:55:19,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-19 00:55:19,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-19 00:55:19,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-19 00:55:19,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-19 00:55:19,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-19 00:55:19,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-19 00:55:19,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-19 00:55:19,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-19 00:55:19,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-19 00:55:19,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-19 00:55:19,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-19 00:55:19,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-19 00:55:19,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-19 00:55:19,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-19 00:55:19,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-19 00:55:19,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-19 00:55:19,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-19 00:55:19,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-19 00:55:19,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-19 00:55:19,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-09-19 00:55:19,431 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-19 00:55:19,431 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1192494527:90 , srv1433869677:90 , srv1448803218:90 , srv1473121620:90 , srv1479728021:90 , srv1518013972:90 , srv1554840375:90 , srv177076591:90 , srv1835831345:90 , srv1850462698:90 , srv1975155369:90 , srv199886490:90 , srv2010708436:90 , srv2024654638:90 , srv2028880740:90 , srv2042490404:90 , srv255161211:90 , srv280126125:90 , srv3254931:90 , srv443940894:90 , srv493904687:90 , srv519745359:90 , srv620991187:90 , srv630277003:90 , srv653565365:90 , srv683281372:90 , srv692290174:90 , srv814186922:90 , srv933781168:90 , srv986749668:90 }
2023-09-19 00:55:19,444 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=143 (was 276), ProcessCount=167 (was 169), AvailableMemoryMB=9206 (was 10123)