2023-05-31 07:52:57,802 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-05-31 07:52:58,092 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-05-31 07:52:58,199 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-05-31 07:52:58,255 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-05-31 07:52:58,261 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-05-31 07:52:58,273 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=264, MaxFileDescriptor=60000, SystemLoadAverage=368, ProcessCount=168, AvailableMemoryMB=9560
2023-05-31 07:52:58,275 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-05-31 07:52:58,275 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-05-31 07:52:58,405 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1006086251:84 , srv1066961739:84 , srv1075357415:84 , srv1096100845:84 , srv1114101912:84 , srv1114184580:84 , srv1117012026:84 , srv1129821418:84 , srv1130714503:84 , srv1144415187:84 , srv1176567211:84 , srv121047160:84 , srv12299284:84 , srv1249696982:84 , srv1293910848:84 , srv1305311321:84 , srv1332559258:84 , srv134379525:84 , srv1357540513:84 , srv1358861018:84 , srv1394617343:84 , srv1406937250:84 , srv1420091477:84 , srv1450389493:84 , srv1451975802:84 , srv147403192:84 , srv1575287071:84 , srv1607118389:84 , srv1617655468:84 , srv1687176766:84 , srv1688385924:84 , srv1769803260:84 , srv1770910541:84 , srv1777022996:84 , srv1778736939:84 , srv1803030283:84 , srv1832902079:84 , srv194304976:84 , srv1963188459:84 , srv1963724322:84 , srv1980022218:84 , srv1980746338:84 , srv2030158450:84 , srv2062670036:84 , srv2065173711:84 , srv2089588977:84 , srv2093158054:84 , srv2108950400:84 , srv2124980703:84 , srv2144996753:84 , srv2145906984:84 , srv220211404:84 , srv228015756:84 , srv241820242:84 , srv242639623:84 , srv247682577:84 , srv302652290:84 , srv316437119:84 , srv322111692:84 , srv330906073:84 , srv33720722:84 , srv362111006:84 , srv36579745:84 , srv402306359:84 , srv417398933:84 , srv420910947:84 , srv470939870:84 , srv478523822:84 , srv493118764:84 , srv497844367:84 , srv550454815:84 , srv551014538:84 , srv558532059:84 , srv573727845:84 , srv624019210:84 , srv635065094:84 , srv656248244:84 , srv667011841:84 , srv692207337:84 , srv69466741:84 , srv715422398:84 , srv716618747:84 , srv750603974:84 , srv760187882:84 , srv766796005:84 , srv793001061:84 , srv796533651:84 , srv820206168:84 , srv823516813:84 , srv826275204:84 , srv828427897:84 , srv846595886:84 , srv846967839:84 , srv850644122:84 , srv861813043:84 , srv870043889:84 , srv902283514:84 , srv941553618:84 , srv946004086:84 , srv1172083476:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-05-31 07:52:58,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-31 07:52:58,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv322111692=59, srv1769803260=32, srv793001061=86, srv493118764=69, srv1963724322=40, srv1357540513=19, srv1172083476=10, srv550454815=71, srv667011841=78, srv1066961739=1, srv1006086251=0, srv1980022218=41, srv1305311321=16, srv134379525=18, srv1394617343=21, srv36579745=63, srv2124980703=49, srv1130714503=8, srv750603974=83, srv1114184580=5, srv823516813=89, srv2108950400=48, srv946004086=99, srv760187882=84, srv624019210=75, srv828427897=91, srv1293910848=15, srv1117012026=6, srv330906073=60, srv302652290=57, srv716618747=82, srv1575287071=27, srv1450389493=24, srv766796005=85, srv656248244=77, srv33720722=61, srv1777022996=34, srv1778736939=35, srv796533651=87, srv715422398=81, srv12299284=13, srv1249696982=14, srv1770910541=33, srv1803030283=36, srv316437119=58, srv417398933=65, srv1963188459=39, srv69466741=80, srv820206168=88, srv1420091477=23, srv1617655468=29, srv1980746338=42, srv558532059=73, srv870043889=96, srv902283514=97, srv1607118389=28, srv1832902079=37, srv1096100845=3, srv1075357415=2, srv1451975802=25, srv635065094=76, srv1688385924=31, srv147403192=26, srv470939870=67, srv2062670036=44, srv362111006=62, srv420910947=66, srv1176567211=11, srv478523822=68, srv121047160=12, srv497844367=70, srv941553618=98, srv194304976=38, srv241820242=54, srv402306359=64, srv1332559258=17, srv1129821418=7, srv228015756=53, srv2089588977=46, srv861813043=95, srv1687176766=30, srv242639623=55, srv846595886=92, srv846967839=93, srv2144996753=50, srv220211404=52, srv247682577=56, srv1114101912=4, srv573727845=74, srv2065173711=45, srv551014538=72, srv850644122=94, srv1358861018=20, srv692207337=79, srv2145906984=51, srv2030158450=43, srv2093158054=47, srv1406937250=22, srv1144415187=9, srv826275204=90} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-31 07:52:58,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-31 07:52:58,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-31 07:52:58,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-31 07:52:58,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-31 07:52:58,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-31 07:52:58,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-31 07:52:58,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-31 07:52:58,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-31 07:52:58,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-31 07:52:58,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-31 07:52:58,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-31 07:52:58,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-31 07:52:58,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-31 07:52:58,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-31 07:52:58,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-31 07:52:58,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-31 07:52:58,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-31 07:52:58,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-31 07:52:58,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-31 07:52:58,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-31 07:52:58,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-31 07:52:58,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-31 07:52:58,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-31 07:52:58,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-31 07:52:58,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-31 07:52:58,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-31 07:52:58,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-31 07:52:58,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-31 07:52:58,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-31 07:52:58,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-31 07:52:58,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-31 07:52:58,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-31 07:52:58,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-31 07:52:58,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-31 07:52:58,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-31 07:52:58,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-31 07:52:58,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-31 07:52:58,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-31 07:52:58,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-31 07:52:58,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-31 07:52:58,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-31 07:52:58,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-31 07:52:58,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-31 07:52:58,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-31 07:52:58,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-31 07:52:58,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-31 07:52:58,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-31 07:52:58,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-31 07:52:58,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-31 07:52:58,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-31 07:52:58,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-31 07:52:58,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-31 07:52:58,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-31 07:52:58,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-31 07:52:58,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-31 07:52:58,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-31 07:52:58,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-31 07:52:58,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-31 07:52:58,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-31 07:52:58,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-31 07:52:58,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-31 07:52:58,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-31 07:52:58,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-31 07:52:58,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-31 07:52:58,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-31 07:52:58,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-31 07:52:58,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-31 07:52:58,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-31 07:52:58,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-31 07:52:58,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-31 07:52:58,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-31 07:52:58,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-31 07:52:58,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-31 07:52:58,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-31 07:52:58,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-31 07:52:58,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-31 07:52:58,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-31 07:52:58,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-31 07:52:58,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-31 07:52:58,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-31 07:52:58,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-31 07:52:58,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-31 07:52:58,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-31 07:52:58,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-31 07:52:58,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-31 07:52:58,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-31 07:52:58,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-31 07:52:58,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-31 07:52:58,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-31 07:52:58,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-31 07:52:58,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-31 07:52:58,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-31 07:52:58,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-31 07:52:58,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-31 07:52:58,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-31 07:52:58,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-31 07:52:58,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-31 07:52:58,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-31 07:52:58,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-31 07:52:58,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-31 07:52:58,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-31 07:52:59,069 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-31 07:52:59,070 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-31 07:52:59,070 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-31 07:52:59,352 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 781 ms to try 5000 different iterations.  Found a solution that moves 4700 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.1801942899897984. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.039257353362034536, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05489915251850688, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5222222222222223, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.039257353362034536, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17558333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.2405, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-31 07:52:59,362 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1114184580:82 , srv2108950400:82 , srv493118764:82 , srv656248244:82 , srv716618747:82 , srv861813043:82 , srv1006086251:83 , srv1114101912:83 , srv1176567211:83 , srv2124980703:83 , srv302652290:83 , srv36579745:83 , srv420910947:83 , srv1129821418:84 , srv12299284:84 , srv228015756:84 , srv242639623:84 , srv823516813:84 , srv1066961739:85 , srv1394617343:85 , srv1420091477:85 , srv1450389493:85 , srv1607118389:85 , srv1617655468:85 , srv1769803260:85 , srv194304976:85 , srv1963188459:85 , srv2065173711:85 , srv2144996753:85 , srv2145906984:85 , srv558532059:85 , srv750603974:85 , srv796533651:85 , srv850644122:85 , srv902283514:85 , srv121047160:86 , srv1688385924:86 , srv1770910541:86 , srv1803030283:86 , srv1832902079:86 , srv1980746338:86 , srv2093158054:86 , srv417398933:86 , srv550454815:86 , srv692207337:86 , srv760187882:86 , srv1130714503:87 , srv1305311321:87 , srv1358861018:87 , srv1406937250:87 , srv1778736939:87 , srv1963724322:87 , srv2030158450:87 , srv2089588977:87 , srv220211404:87 , srv330906073:87 , srv33720722:87 , srv362111006:87 , srv402306359:87 , srv551014538:87 , srv573727845:87 , srv766796005:87 , srv793001061:87 , srv820206168:87 , srv828427897:87 , srv846595886:87 , srv870043889:87 , srv941553618:87 , srv1075357415:88 , srv1096100845:88 , srv1117012026:88 , srv1332559258:88 , srv1451975802:88 , srv1575287071:88 , srv1777022996:88 , srv2062670036:88 , srv247682577:88 , srv470939870:88 , srv478523822:88 , srv69466741:88 , srv715422398:88 , srv846967839:88 , srv1144415187:89 , srv1980022218:89 , srv322111692:89 , srv497844367:89 , srv624019210:89 , srv635065094:89 , srv134379525:90 , srv1357540513:90 , srv147403192:90 , srv1687176766:90 , srv241820242:90 , srv826275204:90 , srv946004086:90 , srv316437119:91 , srv667011841:91 , srv1249696982:92 , srv1293910848:93 , srv1172083476:439 }
2023-05-31 07:52:59,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-31 07:52:59,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv322111692=59, srv1769803260=32, srv793001061=86, srv493118764=69, srv1963724322=40, srv1357540513=19, srv1172083476=10, srv550454815=71, srv667011841=78, srv1066961739=1, srv1006086251=0, srv1980022218=41, srv1305311321=16, srv134379525=18, srv1394617343=21, srv36579745=63, srv2124980703=49, srv1130714503=8, srv750603974=83, srv1114184580=5, srv823516813=89, srv2108950400=48, srv946004086=99, srv760187882=84, srv624019210=75, srv828427897=91, srv1293910848=15, srv1117012026=6, srv330906073=60, srv302652290=57, srv716618747=82, srv1575287071=27, srv1450389493=24, srv766796005=85, srv656248244=77, srv33720722=61, srv1777022996=34, srv1778736939=35, srv796533651=87, srv715422398=81, srv12299284=13, srv1249696982=14, srv1770910541=33, srv1803030283=36, srv316437119=58, srv417398933=65, srv1963188459=39, srv69466741=80, srv820206168=88, srv1420091477=23, srv1617655468=29, srv1980746338=42, srv558532059=73, srv870043889=96, srv902283514=97, srv1607118389=28, srv1832902079=37, srv1096100845=3, srv1075357415=2, srv1451975802=25, srv635065094=76, srv1688385924=31, srv147403192=26, srv470939870=67, srv2062670036=44, srv362111006=62, srv420910947=66, srv1176567211=11, srv478523822=68, srv121047160=12, srv497844367=70, srv941553618=98, srv194304976=38, srv241820242=54, srv402306359=64, srv1332559258=17, srv1129821418=7, srv228015756=53, srv2089588977=46, srv861813043=95, srv1687176766=30, srv242639623=55, srv846595886=92, srv846967839=93, srv2144996753=50, srv220211404=52, srv247682577=56, srv1114101912=4, srv573727845=74, srv2065173711=45, srv551014538=72, srv850644122=94, srv1358861018=20, srv692207337=79, srv2145906984=51, srv2030158450=43, srv2093158054=47, srv1406937250=22, srv1144415187=9, srv826275204=90} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-31 07:52:59,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-31 07:52:59,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-31 07:52:59,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-31 07:52:59,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-31 07:52:59,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-31 07:52:59,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-31 07:52:59,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-31 07:52:59,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-31 07:52:59,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-31 07:52:59,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-31 07:52:59,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-31 07:52:59,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-31 07:52:59,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-31 07:52:59,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-31 07:52:59,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-31 07:52:59,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-31 07:52:59,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-31 07:52:59,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-31 07:52:59,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-31 07:52:59,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-31 07:52:59,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-31 07:52:59,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-31 07:52:59,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-31 07:52:59,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-31 07:52:59,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-31 07:52:59,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-31 07:52:59,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-31 07:52:59,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-31 07:52:59,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-31 07:52:59,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-31 07:52:59,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-31 07:52:59,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-31 07:52:59,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-31 07:52:59,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-31 07:52:59,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-31 07:52:59,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-31 07:52:59,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-31 07:52:59,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-31 07:52:59,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-31 07:52:59,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-31 07:52:59,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-31 07:52:59,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-31 07:52:59,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-31 07:52:59,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-31 07:52:59,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-31 07:52:59,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-31 07:52:59,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-31 07:52:59,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-31 07:52:59,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-31 07:52:59,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-31 07:52:59,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-31 07:52:59,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-31 07:52:59,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-31 07:52:59,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-31 07:52:59,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-31 07:52:59,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-31 07:52:59,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-31 07:52:59,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-31 07:52:59,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-31 07:52:59,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-31 07:52:59,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-31 07:52:59,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-31 07:52:59,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-31 07:52:59,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-31 07:52:59,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-31 07:52:59,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-31 07:52:59,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-31 07:52:59,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-31 07:52:59,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-31 07:52:59,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-31 07:52:59,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-31 07:52:59,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-31 07:52:59,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-31 07:52:59,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-31 07:52:59,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-31 07:52:59,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-31 07:52:59,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-31 07:52:59,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-31 07:52:59,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-31 07:52:59,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-31 07:52:59,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-31 07:52:59,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-31 07:52:59,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-31 07:52:59,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-31 07:52:59,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-31 07:52:59,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-31 07:52:59,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-31 07:52:59,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-31 07:52:59,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-31 07:52:59,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-31 07:52:59,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-31 07:52:59,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-31 07:52:59,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-31 07:52:59,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-31 07:52:59,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-31 07:52:59,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-31 07:52:59,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-31 07:52:59,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-31 07:52:59,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-31 07:52:59,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-31 07:52:59,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-31 07:52:59,504 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.039257353362034536, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05489915251850688, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.039257353362034536, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17558333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.2405, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-31 07:52:59,505 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-31 07:52:59,505 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18016137988639663, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.039257353362034536, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05489915251850688, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.039257353362034536, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17558333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.2405, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-31 07:52:59,740 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 331 ms to try 5000 different iterations.  Found a solution that moves 2628 regions; Going from a computed imbalance of 0.18016137988639663 to a new imbalance of 0.01543694073549547. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.018134743898835286); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.027552622848173502, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.292, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.018134743898835286); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012583333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043083333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-31 07:52:59,752 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1249696982:80 , srv1293910848:80 , srv316437119:80 , srv1687176766:81 , srv1075357415:82 , srv147403192:82 , srv1575287071:82 , srv241820242:82 , srv470939870:82 , srv624019210:82 , srv667011841:82 , srv826275204:82 , srv1144415187:83 , srv1357540513:83 , srv635065094:83 , srv946004086:83 , srv1117012026:84 , srv1305311321:84 , srv134379525:84 , srv1358861018:84 , srv1777022996:84 , srv1778736939:84 , srv2089588977:84 , srv247682577:84 , srv402306359:84 , srv573727845:84 , srv69466741:84 , srv820206168:84 , srv828427897:84 , srv941553618:84 , srv1332559258:85 , srv1451975802:85 , srv1688385924:85 , srv1980022218:85 , srv2062670036:85 , srv220211404:85 , srv322111692:85 , srv33720722:85 , srv478523822:85 , srv692207337:85 , srv715422398:85 , srv750603974:85 , srv760187882:85 , srv766796005:85 , srv846967839:85 , srv1130714503:86 , srv1406937250:86 , srv1770910541:86 , srv1832902079:86 , srv194304976:86 , srv2145906984:86 , srv330906073:86 , srv362111006:86 , srv497844367:86 , srv551014538:86 , srv793001061:86 , srv796533651:86 , srv850644122:86 , srv870043889:86 , srv902283514:86 , srv1096100845:87 , srv1129821418:87 , srv121047160:87 , srv1617655468:87 , srv1963188459:87 , srv1980746338:87 , srv2030158450:87 , srv2144996753:87 , srv36579745:87 , srv1006086251:88 , srv1114101912:88 , srv1176567211:88 , srv12299284:88 , srv1394617343:88 , srv1420091477:88 , srv1769803260:88 , srv1803030283:88 , srv1963724322:88 , srv2065173711:88 , srv2124980703:88 , srv228015756:88 , srv242639623:88 , srv302652290:88 , srv417398933:88 , srv550454815:88 , srv846595886:88 , srv1066961739:89 , srv1114184580:89 , srv1450389493:89 , srv1607118389:89 , srv2093158054:89 , srv420910947:90 , srv493118764:90 , srv558532059:91 , srv656248244:91 , srv716618747:91 , srv823516813:91 , srv861813043:92 , srv2108950400:94 , srv1172083476:496 }
2023-05-31 07:52:59,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-31 07:52:59,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv322111692=59, srv1769803260=32, srv793001061=86, srv493118764=69, srv1963724322=40, srv1357540513=19, srv1172083476=10, srv550454815=71, srv667011841=78, srv1066961739=1, srv1006086251=0, srv1980022218=41, srv1305311321=16, srv134379525=18, srv1394617343=21, srv36579745=63, srv2124980703=49, srv1130714503=8, srv750603974=83, srv1114184580=5, srv823516813=89, srv2108950400=48, srv946004086=99, srv760187882=84, srv624019210=75, srv828427897=91, srv1293910848=15, srv1117012026=6, srv330906073=60, srv302652290=57, srv716618747=82, srv1575287071=27, srv1450389493=24, srv766796005=85, srv656248244=77, srv33720722=61, srv1777022996=34, srv1778736939=35, srv796533651=87, srv715422398=81, srv12299284=13, srv1249696982=14, srv1770910541=33, srv1803030283=36, srv316437119=58, srv417398933=65, srv1963188459=39, srv69466741=80, srv820206168=88, srv1420091477=23, srv1617655468=29, srv1980746338=42, srv558532059=73, srv870043889=96, srv902283514=97, srv1607118389=28, srv1832902079=37, srv1096100845=3, srv1075357415=2, srv1451975802=25, srv635065094=76, srv1688385924=31, srv147403192=26, srv470939870=67, srv2062670036=44, srv362111006=62, srv420910947=66, srv1176567211=11, srv478523822=68, srv121047160=12, srv497844367=70, srv941553618=98, srv194304976=38, srv241820242=54, srv402306359=64, srv1332559258=17, srv1129821418=7, srv228015756=53, srv2089588977=46, srv861813043=95, srv1687176766=30, srv242639623=55, srv846595886=92, srv846967839=93, srv2144996753=50, srv220211404=52, srv247682577=56, srv1114101912=4, srv573727845=74, srv2065173711=45, srv551014538=72, srv850644122=94, srv1358861018=20, srv692207337=79, srv2145906984=51, srv2030158450=43, srv2093158054=47, srv1406937250=22, srv1144415187=9, srv826275204=90} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-31 07:52:59,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-31 07:52:59,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-31 07:52:59,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-31 07:52:59,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-31 07:52:59,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-31 07:52:59,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-31 07:52:59,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-31 07:52:59,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-31 07:52:59,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-31 07:52:59,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-31 07:52:59,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-31 07:52:59,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-31 07:52:59,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-31 07:52:59,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-31 07:52:59,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-31 07:52:59,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-31 07:52:59,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-31 07:52:59,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-31 07:52:59,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-31 07:52:59,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-31 07:52:59,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-31 07:52:59,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-31 07:52:59,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-31 07:52:59,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-31 07:52:59,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-31 07:52:59,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-31 07:52:59,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-31 07:52:59,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-31 07:52:59,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-31 07:52:59,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-31 07:52:59,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-31 07:52:59,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-31 07:52:59,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-31 07:52:59,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-31 07:52:59,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-31 07:52:59,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-31 07:52:59,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-31 07:52:59,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-31 07:52:59,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-31 07:52:59,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-31 07:52:59,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-31 07:52:59,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-31 07:52:59,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-31 07:52:59,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-31 07:52:59,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-31 07:52:59,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-31 07:52:59,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-31 07:52:59,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-31 07:52:59,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-31 07:52:59,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-31 07:52:59,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-31 07:52:59,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-31 07:52:59,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-31 07:52:59,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-31 07:52:59,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-31 07:52:59,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-31 07:52:59,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-31 07:52:59,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-31 07:52:59,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-31 07:52:59,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-31 07:52:59,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-31 07:52:59,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-31 07:52:59,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-31 07:52:59,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-31 07:52:59,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-31 07:52:59,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-31 07:52:59,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-31 07:52:59,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-31 07:52:59,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-31 07:52:59,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-31 07:52:59,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-31 07:52:59,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-31 07:52:59,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-31 07:52:59,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-31 07:52:59,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-31 07:52:59,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-31 07:52:59,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-31 07:52:59,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-31 07:52:59,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-31 07:52:59,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-31 07:52:59,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-31 07:52:59,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-31 07:52:59,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-31 07:52:59,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-31 07:52:59,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-31 07:52:59,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-31 07:52:59,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-31 07:52:59,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-31 07:52:59,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-31 07:52:59,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-31 07:52:59,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-31 07:52:59,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-31 07:52:59,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-31 07:52:59,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-31 07:52:59,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-31 07:52:59,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-31 07:52:59,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-31 07:52:59,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-31 07:52:59,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-31 07:52:59,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-31 07:52:59,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-31 07:52:59,898 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.018134743898835286); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.027552622848173502, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.018134743898835286); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012583333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043083333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-31 07:52:59,898 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-31 07:52:59,898 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.015418539086189134, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.018134743898835286); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.027552622848173502, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.018134743898835286); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012583333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043083333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-31 07:53:00,081 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 277 ms to try 5000 different iterations.  Found a solution that moves 1006 regions; Going from a computed imbalance of 0.015418539086189134 to a new imbalance of 4.1336959654638105E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0052091796918016745); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008026331525381385); MoveCostFunction : (multiplier=7.0, imbalance=0.11177777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0052091796918016745); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-31 07:53:00,084 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1096100845:82 , srv2108950400:82 , srv497844367:82 , srv558532059:82 , srv134379525:83 , srv1803030283:83 , srv1963724322:83 , srv2030158450:83 , srv2093158054:83 , srv417398933:83 , srv823516813:83 , srv861813043:83 , srv1066961739:84 , srv1130714503:84 , srv1332559258:84 , srv1394617343:84 , srv1450389493:84 , srv1451975802:84 , srv1980022218:84 , srv1980746338:84 , srv322111692:84 , srv362111006:84 , srv478523822:84 , srv550454815:84 , srv656248244:84 , srv667011841:84 , srv716618747:84 , srv793001061:84 , srv846595886:84 , srv870043889:84 , srv1117012026:85 , srv1144415187:85 , srv121047160:85 , srv1249696982:85 , srv1293910848:85 , srv1357540513:85 , srv1406937250:85 , srv1420091477:85 , srv1607118389:85 , srv1769803260:85 , srv1777022996:85 , srv2062670036:85 , srv2065173711:85 , srv2144996753:85 , srv241820242:85 , srv302652290:85 , srv330906073:85 , srv33720722:85 , srv493118764:85 , srv551014538:85 , srv635065094:85 , srv826275204:85 , srv846967839:85 , srv850644122:85 , srv946004086:85 , srv1114101912:86 , srv1129821418:86 , srv1176567211:86 , srv12299284:86 , srv1305311321:86 , srv1358861018:86 , srv147403192:86 , srv1617655468:86 , srv1687176766:86 , srv1770910541:86 , srv1778736939:86 , srv1832902079:86 , srv194304976:86 , srv1963188459:86 , srv2089588977:86 , srv2145906984:86 , srv220211404:86 , srv228015756:86 , srv247682577:86 , srv402306359:86 , srv420910947:86 , srv573727845:86 , srv69466741:86 , srv715422398:86 , srv766796005:86 , srv828427897:86 , srv902283514:86 , srv941553618:86 , srv1006086251:87 , srv1075357415:87 , srv1114184580:87 , srv1575287071:87 , srv1688385924:87 , srv2124980703:87 , srv242639623:87 , srv316437119:87 , srv36579745:87 , srv624019210:87 , srv692207337:87 , srv760187882:87 , srv796533651:87 , srv820206168:87 , srv470939870:88 , srv750603974:88 , srv1172083476:569 }
2023-05-31 07:53:00,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-31 07:53:00,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv322111692=59, srv1769803260=32, srv793001061=86, srv493118764=69, srv1963724322=40, srv1357540513=19, srv1172083476=10, srv550454815=71, srv667011841=78, srv1066961739=1, srv1006086251=0, srv1980022218=41, srv1305311321=16, srv134379525=18, srv1394617343=21, srv36579745=63, srv2124980703=49, srv1130714503=8, srv750603974=83, srv1114184580=5, srv823516813=89, srv2108950400=48, srv946004086=99, srv760187882=84, srv624019210=75, srv828427897=91, srv1293910848=15, srv1117012026=6, srv330906073=60, srv302652290=57, srv716618747=82, srv1575287071=27, srv1450389493=24, srv766796005=85, srv656248244=77, srv33720722=61, srv1777022996=34, srv1778736939=35, srv796533651=87, srv715422398=81, srv12299284=13, srv1249696982=14, srv1770910541=33, srv1803030283=36, srv316437119=58, srv417398933=65, srv1963188459=39, srv69466741=80, srv820206168=88, srv1420091477=23, srv1617655468=29, srv1980746338=42, srv558532059=73, srv870043889=96, srv902283514=97, srv1607118389=28, srv1832902079=37, srv1096100845=3, srv1075357415=2, srv1451975802=25, srv635065094=76, srv1688385924=31, srv147403192=26, srv470939870=67, srv2062670036=44, srv362111006=62, srv420910947=66, srv1176567211=11, srv478523822=68, srv121047160=12, srv497844367=70, srv941553618=98, srv194304976=38, srv241820242=54, srv402306359=64, srv1332559258=17, srv1129821418=7, srv228015756=53, srv2089588977=46, srv861813043=95, srv1687176766=30, srv242639623=55, srv846595886=92, srv846967839=93, srv2144996753=50, srv220211404=52, srv247682577=56, srv1114101912=4, srv573727845=74, srv2065173711=45, srv551014538=72, srv850644122=94, srv1358861018=20, srv692207337=79, srv2145906984=51, srv2030158450=43, srv2093158054=47, srv1406937250=22, srv1144415187=9, srv826275204=90} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-31 07:53:00,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-31 07:53:00,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-31 07:53:00,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-31 07:53:00,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-31 07:53:00,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-31 07:53:00,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-31 07:53:00,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-31 07:53:00,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-31 07:53:00,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-31 07:53:00,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-31 07:53:00,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-31 07:53:00,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-31 07:53:00,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-31 07:53:00,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-31 07:53:00,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-31 07:53:00,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-31 07:53:00,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-31 07:53:00,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-31 07:53:00,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-31 07:53:00,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-31 07:53:00,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-31 07:53:00,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-31 07:53:00,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-31 07:53:00,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-31 07:53:00,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-31 07:53:00,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-31 07:53:00,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-31 07:53:00,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-31 07:53:00,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-31 07:53:00,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-31 07:53:00,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-31 07:53:00,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-31 07:53:00,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-31 07:53:00,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-31 07:53:00,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-31 07:53:00,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-31 07:53:00,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-31 07:53:00,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-31 07:53:00,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-31 07:53:00,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-31 07:53:00,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-31 07:53:00,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-31 07:53:00,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-31 07:53:00,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-31 07:53:00,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-31 07:53:00,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-31 07:53:00,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-31 07:53:00,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-31 07:53:00,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-31 07:53:00,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-31 07:53:00,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-31 07:53:00,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-31 07:53:00,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-31 07:53:00,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-31 07:53:00,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-31 07:53:00,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-31 07:53:00,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-31 07:53:00,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-31 07:53:00,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-31 07:53:00,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-31 07:53:00,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-31 07:53:00,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-31 07:53:00,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-31 07:53:00,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-31 07:53:00,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-31 07:53:00,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-31 07:53:00,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-31 07:53:00,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-31 07:53:00,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-31 07:53:00,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-31 07:53:00,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-31 07:53:00,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-31 07:53:00,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-31 07:53:00,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-31 07:53:00,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-31 07:53:00,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-31 07:53:00,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-31 07:53:00,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-31 07:53:00,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-31 07:53:00,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-31 07:53:00,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-31 07:53:00,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-31 07:53:00,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-31 07:53:00,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-31 07:53:00,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-31 07:53:00,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-31 07:53:00,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-31 07:53:00,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-31 07:53:00,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-31 07:53:00,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-31 07:53:00,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-31 07:53:00,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-31 07:53:00,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-31 07:53:00,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-31 07:53:00,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-31 07:53:00,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-31 07:53:00,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-31 07:53:00,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-31 07:53:00,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-31 07:53:00,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-31 07:53:00,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-31 07:53:00,246 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0052091796918016745); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008026331525381385); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0052091796918016745); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-31 07:53:00,247 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-31 07:53:00,247 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=4.0632543398847577E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0052091796918016745); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008026331525381385); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0052091796918016745); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-31 07:53:00,580 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 454 ms to try 5000 different iterations.  Found a solution that moves 196 regions; Going from a computed imbalance of 4.0632543398847577E-4 to a new imbalance of 1.174015876777509E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.5313429231318235E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0020651563939657444); MoveCostFunction : (multiplier=7.0, imbalance=0.021777777777777778); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.5313429231318235E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-31 07:53:00,581 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv147403192:83 , srv242639623:83 , srv420910947:83 , srv715422398:83 , srv846595886:83 , srv1006086251:84 , srv1066961739:84 , srv1075357415:84 , srv1114184580:84 , srv121047160:84 , srv12299284:84 , srv1293910848:84 , srv1357540513:84 , srv1406937250:84 , srv1420091477:84 , srv1450389493:84 , srv1607118389:84 , srv1617655468:84 , srv1688385924:84 , srv1770910541:84 , srv1778736939:84 , srv1832902079:84 , srv1963188459:84 , srv1963724322:84 , srv1980022218:84 , srv2062670036:84 , srv2065173711:84 , srv2093158054:84 , srv2108950400:84 , srv2124980703:84 , srv220211404:84 , srv228015756:84 , srv247682577:84 , srv316437119:84 , srv322111692:84 , srv330906073:84 , srv470939870:84 , srv550454815:84 , srv551014538:84 , srv624019210:84 , srv667011841:84 , srv692207337:84 , srv69466741:84 , srv750603974:84 , srv766796005:84 , srv796533651:84 , srv820206168:84 , srv823516813:84 , srv826275204:84 , srv846967839:84 , srv1096100845:85 , srv1114101912:85 , srv1117012026:85 , srv1129821418:85 , srv1130714503:85 , srv1144415187:85 , srv1176567211:85 , srv1249696982:85 , srv1305311321:85 , srv1332559258:85 , srv134379525:85 , srv1358861018:85 , srv1394617343:85 , srv1451975802:85 , srv1575287071:85 , srv1687176766:85 , srv1769803260:85 , srv1777022996:85 , srv1803030283:85 , srv194304976:85 , srv1980746338:85 , srv2030158450:85 , srv2089588977:85 , srv2144996753:85 , srv2145906984:85 , srv241820242:85 , srv33720722:85 , srv362111006:85 , srv36579745:85 , srv402306359:85 , srv417398933:85 , srv478523822:85 , srv493118764:85 , srv497844367:85 , srv558532059:85 , srv573727845:85 , srv635065094:85 , srv656248244:85 , srv716618747:85 , srv760187882:85 , srv793001061:85 , srv828427897:85 , srv861813043:85 , srv870043889:85 , srv902283514:85 , srv941553618:85 , srv946004086:85 , srv302652290:86 , srv850644122:86 , srv1172083476:638 }
2023-05-31 07:53:00,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-31 07:53:00,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv322111692=59, srv1769803260=32, srv793001061=86, srv493118764=69, srv1963724322=40, srv1357540513=19, srv1172083476=10, srv550454815=71, srv667011841=78, srv1066961739=1, srv1006086251=0, srv1980022218=41, srv1305311321=16, srv134379525=18, srv1394617343=21, srv36579745=63, srv2124980703=49, srv1130714503=8, srv750603974=83, srv1114184580=5, srv823516813=89, srv2108950400=48, srv946004086=99, srv760187882=84, srv624019210=75, srv828427897=91, srv1293910848=15, srv1117012026=6, srv330906073=60, srv302652290=57, srv716618747=82, srv1575287071=27, srv1450389493=24, srv766796005=85, srv656248244=77, srv33720722=61, srv1777022996=34, srv1778736939=35, srv796533651=87, srv715422398=81, srv12299284=13, srv1249696982=14, srv1770910541=33, srv1803030283=36, srv316437119=58, srv417398933=65, srv1963188459=39, srv69466741=80, srv820206168=88, srv1420091477=23, srv1617655468=29, srv1980746338=42, srv558532059=73, srv870043889=96, srv902283514=97, srv1607118389=28, srv1832902079=37, srv1096100845=3, srv1075357415=2, srv1451975802=25, srv635065094=76, srv1688385924=31, srv147403192=26, srv470939870=67, srv2062670036=44, srv362111006=62, srv420910947=66, srv1176567211=11, srv478523822=68, srv121047160=12, srv497844367=70, srv941553618=98, srv194304976=38, srv241820242=54, srv402306359=64, srv1332559258=17, srv1129821418=7, srv228015756=53, srv2089588977=46, srv861813043=95, srv1687176766=30, srv242639623=55, srv846595886=92, srv846967839=93, srv2144996753=50, srv220211404=52, srv247682577=56, srv1114101912=4, srv573727845=74, srv2065173711=45, srv551014538=72, srv850644122=94, srv1358861018=20, srv692207337=79, srv2145906984=51, srv2030158450=43, srv2093158054=47, srv1406937250=22, srv1144415187=9, srv826275204=90} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-31 07:53:00,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-31 07:53:00,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-31 07:53:00,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-31 07:53:00,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-31 07:53:00,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-31 07:53:00,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-31 07:53:00,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-31 07:53:00,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-31 07:53:00,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-31 07:53:00,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-31 07:53:00,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-31 07:53:00,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-31 07:53:00,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-31 07:53:00,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-31 07:53:00,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-31 07:53:00,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-31 07:53:00,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-31 07:53:00,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-31 07:53:00,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-31 07:53:00,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-31 07:53:00,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-31 07:53:00,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-31 07:53:00,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-31 07:53:00,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-31 07:53:00,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-31 07:53:00,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-31 07:53:00,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-31 07:53:00,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-31 07:53:00,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-31 07:53:00,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-31 07:53:00,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-31 07:53:00,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-31 07:53:00,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-31 07:53:00,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-31 07:53:00,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-31 07:53:00,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-31 07:53:00,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-31 07:53:00,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-31 07:53:00,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-31 07:53:00,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-31 07:53:00,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-31 07:53:00,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-31 07:53:00,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-31 07:53:00,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-31 07:53:00,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-31 07:53:00,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-31 07:53:00,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-31 07:53:00,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-31 07:53:00,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-31 07:53:00,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-31 07:53:00,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-31 07:53:00,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-31 07:53:00,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-31 07:53:00,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-31 07:53:00,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-31 07:53:00,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-31 07:53:00,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-31 07:53:00,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-31 07:53:00,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-31 07:53:00,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-31 07:53:00,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-31 07:53:00,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-31 07:53:00,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-31 07:53:00,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-31 07:53:00,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-31 07:53:00,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-31 07:53:00,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-31 07:53:00,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-31 07:53:00,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-31 07:53:00,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-31 07:53:00,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-31 07:53:00,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-31 07:53:00,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-31 07:53:00,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-31 07:53:00,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-31 07:53:00,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-31 07:53:00,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-31 07:53:00,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-31 07:53:00,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-31 07:53:00,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-31 07:53:00,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-31 07:53:00,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-31 07:53:00,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-31 07:53:00,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-31 07:53:00,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-31 07:53:00,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-31 07:53:00,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-31 07:53:00,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-31 07:53:00,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-31 07:53:00,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-31 07:53:00,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-31 07:53:00,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-31 07:53:00,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-31 07:53:00,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-31 07:53:00,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-31 07:53:00,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-31 07:53:00,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-31 07:53:00,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-31 07:53:00,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-31 07:53:00,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-31 07:53:00,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-31 07:53:00,705 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.5313429231318235E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0020651563939657444); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.5313429231318235E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-31 07:53:00,705 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-31 07:53:00,705 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=1.1602916634440156E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.5313429231318235E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0020651563939657444); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.5313429231318235E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-31 07:53:00,868 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 247 ms to try 5000 different iterations.  Found a solution that moves 31 regions; Going from a computed imbalance of 1.1602916634440156E-4 to a new imbalance of 7.290305935787761E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0034444444444444444); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-31 07:53:00,869 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1607118389:83 , srv1769803260:83 , srv558532059:83 , srv760187882:83 , srv946004086:83 , srv1006086251:84 , srv1066961739:84 , srv1096100845:84 , srv1114101912:84 , srv1114184580:84 , srv1117012026:84 , srv1129821418:84 , srv1130714503:84 , srv1144415187:84 , srv1176567211:84 , srv121047160:84 , srv12299284:84 , srv1249696982:84 , srv1293910848:84 , srv1305311321:84 , srv1332559258:84 , srv134379525:84 , srv1357540513:84 , srv1358861018:84 , srv1394617343:84 , srv1406937250:84 , srv1420091477:84 , srv1450389493:84 , srv1451975802:84 , srv1575287071:84 , srv1617655468:84 , srv1687176766:84 , srv1688385924:84 , srv1770910541:84 , srv1777022996:84 , srv1803030283:84 , srv1832902079:84 , srv194304976:84 , srv1963188459:84 , srv1963724322:84 , srv1980022218:84 , srv1980746338:84 , srv2030158450:84 , srv2062670036:84 , srv2065173711:84 , srv2089588977:84 , srv2093158054:84 , srv2108950400:84 , srv2124980703:84 , srv2144996753:84 , srv2145906984:84 , srv220211404:84 , srv228015756:84 , srv241820242:84 , srv242639623:84 , srv247682577:84 , srv302652290:84 , srv316437119:84 , srv322111692:84 , srv330906073:84 , srv33720722:84 , srv362111006:84 , srv36579745:84 , srv402306359:84 , srv417398933:84 , srv420910947:84 , srv470939870:84 , srv478523822:84 , srv493118764:84 , srv497844367:84 , srv550454815:84 , srv551014538:84 , srv573727845:84 , srv624019210:84 , srv635065094:84 , srv656248244:84 , srv692207337:84 , srv69466741:84 , srv715422398:84 , srv716618747:84 , srv750603974:84 , srv766796005:84 , srv793001061:84 , srv796533651:84 , srv820206168:84 , srv823516813:84 , srv828427897:84 , srv846595886:84 , srv846967839:84 , srv850644122:84 , srv861813043:84 , srv870043889:84 , srv902283514:84 , srv941553618:84 , srv1075357415:85 , srv147403192:85 , srv1778736939:85 , srv667011841:85 , srv826275204:85 , srv1172083476:684 }
2023-05-31 07:53:00,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-31 07:53:00,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv322111692=59, srv1769803260=32, srv793001061=86, srv493118764=69, srv1963724322=40, srv1357540513=19, srv1172083476=10, srv550454815=71, srv667011841=78, srv1066961739=1, srv1006086251=0, srv1980022218=41, srv1305311321=16, srv134379525=18, srv1394617343=21, srv36579745=63, srv2124980703=49, srv1130714503=8, srv750603974=83, srv1114184580=5, srv823516813=89, srv2108950400=48, srv946004086=99, srv760187882=84, srv624019210=75, srv828427897=91, srv1293910848=15, srv1117012026=6, srv330906073=60, srv302652290=57, srv716618747=82, srv1575287071=27, srv1450389493=24, srv766796005=85, srv656248244=77, srv33720722=61, srv1777022996=34, srv1778736939=35, srv796533651=87, srv715422398=81, srv12299284=13, srv1249696982=14, srv1770910541=33, srv1803030283=36, srv316437119=58, srv417398933=65, srv1963188459=39, srv69466741=80, srv820206168=88, srv1420091477=23, srv1617655468=29, srv1980746338=42, srv558532059=73, srv870043889=96, srv902283514=97, srv1607118389=28, srv1832902079=37, srv1096100845=3, srv1075357415=2, srv1451975802=25, srv635065094=76, srv1688385924=31, srv147403192=26, srv470939870=67, srv2062670036=44, srv362111006=62, srv420910947=66, srv1176567211=11, srv478523822=68, srv121047160=12, srv497844367=70, srv941553618=98, srv194304976=38, srv241820242=54, srv402306359=64, srv1332559258=17, srv1129821418=7, srv228015756=53, srv2089588977=46, srv861813043=95, srv1687176766=30, srv242639623=55, srv846595886=92, srv846967839=93, srv2144996753=50, srv220211404=52, srv247682577=56, srv1114101912=4, srv573727845=74, srv2065173711=45, srv551014538=72, srv850644122=94, srv1358861018=20, srv692207337=79, srv2145906984=51, srv2030158450=43, srv2093158054=47, srv1406937250=22, srv1144415187=9, srv826275204=90} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-31 07:53:00,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-31 07:53:00,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-31 07:53:00,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-31 07:53:00,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-31 07:53:00,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-31 07:53:00,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-31 07:53:00,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-31 07:53:00,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-31 07:53:00,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-31 07:53:00,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-31 07:53:00,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-31 07:53:00,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-31 07:53:00,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-31 07:53:00,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-31 07:53:00,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-31 07:53:00,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-31 07:53:00,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-31 07:53:00,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-31 07:53:00,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-31 07:53:00,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-31 07:53:00,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-31 07:53:00,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-31 07:53:00,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-31 07:53:00,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-31 07:53:00,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-31 07:53:00,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-31 07:53:00,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-31 07:53:00,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-31 07:53:00,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-31 07:53:00,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-31 07:53:00,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-31 07:53:00,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-31 07:53:00,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-31 07:53:00,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-31 07:53:00,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-31 07:53:00,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-31 07:53:00,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-31 07:53:00,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-31 07:53:00,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-31 07:53:00,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-31 07:53:00,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-31 07:53:00,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-31 07:53:00,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-31 07:53:00,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-31 07:53:00,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-31 07:53:00,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-31 07:53:00,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-31 07:53:00,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-31 07:53:00,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-31 07:53:00,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-31 07:53:00,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-31 07:53:00,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-31 07:53:00,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-31 07:53:00,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-31 07:53:00,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-31 07:53:00,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-31 07:53:00,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-31 07:53:00,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-31 07:53:00,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-31 07:53:00,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-31 07:53:00,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-31 07:53:00,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-31 07:53:00,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-31 07:53:00,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-31 07:53:00,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-31 07:53:00,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-31 07:53:00,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-31 07:53:00,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-31 07:53:00,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-31 07:53:00,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-31 07:53:00,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-31 07:53:00,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-31 07:53:00,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-31 07:53:00,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-31 07:53:00,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-31 07:53:00,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-31 07:53:00,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-31 07:53:00,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-31 07:53:00,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-31 07:53:00,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-31 07:53:00,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-31 07:53:00,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-31 07:53:00,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-31 07:53:00,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-31 07:53:00,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-31 07:53:00,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-31 07:53:00,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-31 07:53:00,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-31 07:53:00,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-31 07:53:00,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-31 07:53:00,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-31 07:53:00,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-31 07:53:00,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-31 07:53:00,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-31 07:53:00,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-31 07:53:00,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-31 07:53:00,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-31 07:53:00,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-31 07:53:00,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-31 07:53:00,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-31 07:53:00,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-31 07:53:00,986 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.073239296329447E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-31 07:53:00,986 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1607118389:83 , srv1769803260:83 , srv558532059:83 , srv760187882:83 , srv946004086:83 , srv1006086251:84 , srv1066961739:84 , srv1096100845:84 , srv1114101912:84 , srv1114184580:84 , srv1117012026:84 , srv1129821418:84 , srv1130714503:84 , srv1144415187:84 , srv1176567211:84 , srv121047160:84 , srv12299284:84 , srv1249696982:84 , srv1293910848:84 , srv1305311321:84 , srv1332559258:84 , srv134379525:84 , srv1357540513:84 , srv1358861018:84 , srv1394617343:84 , srv1406937250:84 , srv1420091477:84 , srv1450389493:84 , srv1451975802:84 , srv1575287071:84 , srv1617655468:84 , srv1687176766:84 , srv1688385924:84 , srv1770910541:84 , srv1777022996:84 , srv1803030283:84 , srv1832902079:84 , srv194304976:84 , srv1963188459:84 , srv1963724322:84 , srv1980022218:84 , srv1980746338:84 , srv2030158450:84 , srv2062670036:84 , srv2065173711:84 , srv2089588977:84 , srv2093158054:84 , srv2108950400:84 , srv2124980703:84 , srv2144996753:84 , srv2145906984:84 , srv220211404:84 , srv228015756:84 , srv241820242:84 , srv242639623:84 , srv247682577:84 , srv302652290:84 , srv316437119:84 , srv322111692:84 , srv330906073:84 , srv33720722:84 , srv362111006:84 , srv36579745:84 , srv402306359:84 , srv417398933:84 , srv420910947:84 , srv470939870:84 , srv478523822:84 , srv493118764:84 , srv497844367:84 , srv550454815:84 , srv551014538:84 , srv573727845:84 , srv624019210:84 , srv635065094:84 , srv656248244:84 , srv692207337:84 , srv69466741:84 , srv715422398:84 , srv716618747:84 , srv750603974:84 , srv766796005:84 , srv793001061:84 , srv796533651:84 , srv820206168:84 , srv823516813:84 , srv828427897:84 , srv846595886:84 , srv846967839:84 , srv850644122:84 , srv861813043:84 , srv870043889:84 , srv902283514:84 , srv941553618:84 , srv1075357415:85 , srv147403192:85 , srv1778736939:85 , srv667011841:85 , srv826275204:85 , srv1172083476:684 }
2023-05-31 07:53:01,011 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=264 (was 264), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=368 (was 368), ProcessCount=168 (was 168), AvailableMemoryMB=8957 (was 9560)
2023-05-31 07:53:01,018 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=264, MaxFileDescriptor=60000, SystemLoadAverage=368, ProcessCount=168, AvailableMemoryMB=8957
2023-05-31 07:53:01,019 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-05-31 07:53:01,019 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-05-31 07:53:01,031 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv109665958:84 , srv1148187619:84 , srv1155424651:84 , srv1183606544:84 , srv1230365745:84 , srv1411205754:84 , srv1512326272:84 , srv160212554:84 , srv1611321018:84 , srv1613280843:84 , srv162103756:84 , srv163058637:84 , srv1719440020:84 , srv1752898348:84 , srv1786461633:84 , srv1823621340:84 , srv1885583827:84 , srv1955279415:84 , srv1979185925:84 , srv2103471361:84 , srv35907953:84 , srv430481424:84 , srv612686923:84 , srv704224615:84 , srv780812712:84 , srv866045353:84 , srv872715924:84 , srv932176519:84 , srv991132622:84 , srv1819727581:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-05-31 07:53:01,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-31 07:53:01,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1819727581=15, srv932176519=28, srv866045353=26, srv1183606544=3, srv1823621340=16, srv1611321018=8, srv872715924=27, srv780812712=25, srv704224615=24, srv162103756=10, srv1979185925=19, srv991132622=29, srv1230365745=4, srv612686923=23, srv1885583827=17, srv2103471361=20, srv163058637=11, srv1613280843=9, srv1786461633=14, srv109665958=0, srv1411205754=5, srv160212554=7, srv1955279415=18, srv1719440020=12, srv1155424651=2, srv35907953=21, srv430481424=22, srv1148187619=1, srv1752898348=13, srv1512326272=6} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-31 07:53:01,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-31 07:53:01,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-31 07:53:01,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-31 07:53:01,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-31 07:53:01,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-31 07:53:01,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-31 07:53:01,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-31 07:53:01,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-31 07:53:01,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-31 07:53:01,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-31 07:53:01,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-31 07:53:01,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-31 07:53:01,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-31 07:53:01,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-31 07:53:01,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-31 07:53:01,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-31 07:53:01,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-31 07:53:01,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-31 07:53:01,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-31 07:53:01,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-31 07:53:01,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-31 07:53:01,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-31 07:53:01,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-31 07:53:01,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-31 07:53:01,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-31 07:53:01,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-31 07:53:01,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-31 07:53:01,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-31 07:53:01,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-31 07:53:01,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-31 07:53:01,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-05-31 07:53:01,072 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0804023776313043, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-31 07:53:01,072 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912446388530818, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0804023776313043, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-05-31 07:55:01,054 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 9264374 different iterations.  Found a solution that moves 1829 regions; Going from a computed imbalance of 0.9912446388530818 to a new imbalance of 4.26897724268017E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6774074074074075, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-31 07:55:01,059 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv109665958:90 , srv1148187619:90 , srv1155424651:90 , srv1183606544:90 , srv1230365745:90 , srv1411205754:90 , srv1512326272:90 , srv160212554:90 , srv1611321018:90 , srv1613280843:90 , srv162103756:90 , srv163058637:90 , srv1719440020:90 , srv1752898348:90 , srv1786461633:90 , srv1819727581:90 , srv1823621340:90 , srv1885583827:90 , srv1955279415:90 , srv1979185925:90 , srv2103471361:90 , srv35907953:90 , srv430481424:90 , srv612686923:90 , srv704224615:90 , srv780812712:90 , srv866045353:90 , srv872715924:90 , srv932176519:90 , srv991132622:90 }
2023-05-31 07:55:01,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-31 07:55:01,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1819727581=15, srv932176519=28, srv866045353=26, srv1183606544=3, srv1823621340=16, srv1611321018=8, srv872715924=27, srv780812712=25, srv704224615=24, srv162103756=10, srv1979185925=19, srv991132622=29, srv1230365745=4, srv612686923=23, srv1885583827=17, srv2103471361=20, srv163058637=11, srv1613280843=9, srv1786461633=14, srv109665958=0, srv1411205754=5, srv160212554=7, srv1955279415=18, srv1719440020=12, srv1155424651=2, srv35907953=21, srv430481424=22, srv1148187619=1, srv1752898348=13, srv1512326272=6} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-31 07:55:01,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-31 07:55:01,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-31 07:55:01,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-31 07:55:01,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-31 07:55:01,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-31 07:55:01,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-31 07:55:01,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-31 07:55:01,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-31 07:55:01,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-31 07:55:01,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-31 07:55:01,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-31 07:55:01,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-31 07:55:01,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-31 07:55:01,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-31 07:55:01,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-31 07:55:01,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-31 07:55:01,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-31 07:55:01,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-31 07:55:01,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-31 07:55:01,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-31 07:55:01,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-31 07:55:01,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-31 07:55:01,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-31 07:55:01,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-31 07:55:01,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-31 07:55:01,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-31 07:55:01,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-31 07:55:01,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-31 07:55:01,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-31 07:55:01,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-31 07:55:01,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-05-31 07:55:01,073 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-31 07:55:01,073 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv109665958:90 , srv1148187619:90 , srv1155424651:90 , srv1183606544:90 , srv1230365745:90 , srv1411205754:90 , srv1512326272:90 , srv160212554:90 , srv1611321018:90 , srv1613280843:90 , srv162103756:90 , srv163058637:90 , srv1719440020:90 , srv1752898348:90 , srv1786461633:90 , srv1819727581:90 , srv1823621340:90 , srv1885583827:90 , srv1955279415:90 , srv1979185925:90 , srv2103471361:90 , srv35907953:90 , srv430481424:90 , srv612686923:90 , srv704224615:90 , srv780812712:90 , srv866045353:90 , srv872715924:90 , srv932176519:90 , srv991132622:90 }
2023-05-31 07:55:01,084 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=264 (was 264), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=256 (was 368), ProcessCount=169 (was 168) - ProcessCount LEAK? -, AvailableMemoryMB=8712 (was 8957)