2023-08-10 20:53:07,618 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-08-10 20:53:07,929 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-08-10 20:53:08,048 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-08-10 20:53:08,123 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-08-10 20:53:08,133 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-08-10 20:53:08,151 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=285, ProcessCount=174, AvailableMemoryMB=8571
2023-08-10 20:53:08,153 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-08-10 20:53:08,153 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-08-10 20:53:08,305 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1005702918:84 , srv1053169187:84 , srv1067580575:84 , srv1077254945:84 , srv1084079704:84 , srv108451741:84 , srv1129327964:84 , srv1152547920:84 , srv1163195946:84 , srv1180049712:84 , srv1195869043:84 , srv1198854635:84 , srv1253454079:84 , srv1266058084:84 , srv1285207781:84 , srv129658901:84 , srv1311129500:84 , srv1349923177:84 , srv1365385226:84 , srv1399888538:84 , srv1431552706:84 , srv1452913251:84 , srv1464203322:84 , srv1468978538:84 , srv1474052620:84 , srv1491125706:84 , srv150412933:84 , srv1512484670:84 , srv1526368175:84 , srv1533762130:84 , srv1542415942:84 , srv1551577058:84 , srv1656201040:84 , srv1670238319:84 , srv169012507:84 , srv1693411341:84 , srv1711871093:84 , srv1718389648:84 , srv1729209848:84 , srv1776685036:84 , srv1797997173:84 , srv1802961601:84 , srv1813094105:84 , srv1856966056:84 , srv1885237991:84 , srv1901508183:84 , srv190830483:84 , srv1919985256:84 , srv1923774330:84 , srv1937445844:84 , srv1946590143:84 , srv1953931675:84 , srv2017405501:84 , srv2017431875:84 , srv2038083601:84 , srv2051010370:84 , srv2065106514:84 , srv2098256374:84 , srv2123319253:84 , srv2137059849:84 , srv216661054:84 , srv218153868:84 , srv230383543:84 , srv239344518:84 , srv243119611:84 , srv300974422:84 , srv322132841:84 , srv330660961:84 , srv334150848:84 , srv336463706:84 , srv348286419:84 , srv3548560:84 , srv392606286:84 , srv409270071:84 , srv411805481:84 , srv450913664:84 , srv46630663:84 , srv483624562:84 , srv484070105:84 , srv513395678:84 , srv521530848:84 , srv523561517:84 , srv543088892:84 , srv545513373:84 , srv573589665:84 , srv581128579:84 , srv5923578:84 , srv626140200:84 , srv626231653:84 , srv634968657:84 , srv663205674:84 , srv735162742:84 , srv778095069:84 , srv7998345:84 , srv812343295:84 , srv855747606:84 , srv892752761:84 , srv907129420:84 , srv992831594:84 , srv813594763:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-08-10 20:53:08,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-10 20:53:08,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1551577058=31, srv1953931675=51, srv523561517=81, srv334150848=68, srv300974422=65, srv483624562=77, srv2098256374=57, srv626231653=88, srv1937445844=49, srv484070105=78, srv1474052620=24, srv2038083601=54, srv1005702918=0, srv543088892=82, srv129658901=15, srv46630663=76, srv1084079704=4, srv1365385226=18, srv190830483=46, srv573589665=84, srv3548560=71, srv1491125706=25, srv1670238319=33, srv1053169187=1, srv1468978538=23, srv1901508183=45, srv1656201040=32, srv521530848=80, srv2123319253=58, srv735162742=91, srv1813094105=42, srv1431552706=20, srv409270071=73, srv322132841=66, srv2137059849=59, srv1526368175=28, srv1718389648=37, srv1919985256=47, srv1856966056=43, srv1885237991=44, srv1266058084=13, srv1349923177=17, srv2051010370=55, srv1163195946=8, srv1285207781=14, srv1797997173=40, srv1452913251=21, srv336463706=69, srv1152547920=7, srv1693411341=35, srv892752761=97, srv778095069=92, srv992831594=99, srv1311129500=16, srv216661054=60, srv626140200=87, srv1711871093=36, srv1198854635=11, srv513395678=79, srv1512484670=27, srv1802961601=41, srv1776685036=39, srv243119611=64, srv634968657=89, srv812343295=94, srv2017431875=53, srv2017405501=52, srv330660961=67, srv1923774330=48, srv169012507=34, srv2065106514=56, srv1399888538=19, srv108451741=5, srv1542415942=30, srv239344518=63, srv1533762130=29, srv1195869043=10, srv150412933=26, srv907129420=98, srv663205674=90, srv1180049712=9, srv1067580575=2, srv7998345=93, srv450913664=75, srv1077254945=3, srv411805481=74, srv855747606=96, srv1253454079=12, srv1464203322=22, srv1946590143=50, srv581128579=85, srv230383543=62, srv348286419=70, srv5923578=86, srv1129327964=6, srv1729209848=38, srv392606286=72, srv545513373=83, srv813594763=95, srv218153868=61} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-10 20:53:08,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-10 20:53:08,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-10 20:53:08,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-10 20:53:08,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-10 20:53:08,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-10 20:53:08,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-10 20:53:08,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-10 20:53:08,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-10 20:53:08,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-10 20:53:08,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-10 20:53:08,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-10 20:53:08,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-10 20:53:08,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-10 20:53:08,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-10 20:53:08,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-10 20:53:08,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-10 20:53:08,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-10 20:53:08,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-10 20:53:08,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-10 20:53:08,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-10 20:53:08,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-10 20:53:08,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-10 20:53:08,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-10 20:53:08,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-10 20:53:08,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-10 20:53:08,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-10 20:53:08,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-10 20:53:08,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-10 20:53:08,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-10 20:53:08,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-10 20:53:08,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-10 20:53:08,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-10 20:53:08,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-10 20:53:08,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-10 20:53:08,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-10 20:53:08,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-10 20:53:08,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-10 20:53:08,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-10 20:53:08,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-10 20:53:08,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-10 20:53:08,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-10 20:53:08,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-10 20:53:08,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-10 20:53:08,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-10 20:53:08,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-10 20:53:08,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-10 20:53:08,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-10 20:53:08,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-10 20:53:08,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-10 20:53:08,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-10 20:53:08,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-10 20:53:08,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-10 20:53:08,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-10 20:53:08,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-10 20:53:08,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-10 20:53:08,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-10 20:53:08,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-10 20:53:08,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-10 20:53:08,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-10 20:53:08,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-10 20:53:08,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-10 20:53:08,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-10 20:53:08,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-10 20:53:08,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-10 20:53:08,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-10 20:53:08,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-10 20:53:08,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-10 20:53:08,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-10 20:53:08,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-10 20:53:08,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-10 20:53:08,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-10 20:53:08,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-10 20:53:08,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-10 20:53:08,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-10 20:53:08,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-10 20:53:08,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-10 20:53:08,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-10 20:53:08,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-10 20:53:08,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-10 20:53:08,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-10 20:53:08,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-10 20:53:08,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-10 20:53:08,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-10 20:53:08,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-10 20:53:08,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-10 20:53:08,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-10 20:53:08,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-10 20:53:08,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-10 20:53:08,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-10 20:53:08,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-10 20:53:08,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-10 20:53:08,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-10 20:53:08,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-10 20:53:08,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-10 20:53:08,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-10 20:53:08,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-10 20:53:08,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-10 20:53:08,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-10 20:53:08,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-10 20:53:08,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-10 20:53:08,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-10 20:53:08,674 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-10 20:53:08,675 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-10 20:53:08,675 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-10 20:53:09,067 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 602 ms to try 5000 different iterations.  Found a solution that moves 4708 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.1765378030941347. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03987447569807075, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05858986402190655, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5231111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03987447569807075, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17158333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23966666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-10 20:53:09,084 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1491125706:82 , srv2017431875:82 , srv322132841:82 , srv812343295:82 , srv1053169187:83 , srv1198854635:83 , srv1551577058:83 , srv1670238319:83 , srv1776685036:83 , srv2051010370:83 , srv230383543:83 , srv409270071:83 , srv735162742:83 , srv7998345:83 , srv1005702918:84 , srv1195869043:84 , srv1266058084:84 , srv1349923177:84 , srv1464203322:84 , srv150412933:84 , srv1813094105:84 , srv1901508183:84 , srv1919985256:84 , srv336463706:84 , srv3548560:84 , srv450913664:84 , srv523561517:84 , srv626231653:84 , srv1077254945:85 , srv108451741:85 , srv1163195946:85 , srv1311129500:85 , srv1468978538:85 , srv1512484670:85 , srv1533762130:85 , srv1542415942:85 , srv218153868:85 , srv330660961:85 , srv483624562:85 , srv892752761:85 , srv1067580575:86 , srv1084079704:86 , srv1129327964:86 , srv1152547920:86 , srv1180049712:86 , srv1431552706:86 , srv1452913251:86 , srv1656201040:86 , srv1797997173:86 , srv190830483:86 , srv216661054:86 , srv300974422:86 , srv334150848:86 , srv484070105:86 , srv513395678:86 , srv581128579:86 , srv634968657:86 , srv663205674:86 , srv992831594:86 , srv1253454079:87 , srv1399888538:87 , srv1526368175:87 , srv1718389648:87 , srv239344518:87 , srv348286419:87 , srv392606286:87 , srv411805481:87 , srv521530848:87 , srv543088892:87 , srv5923578:87 , srv778095069:87 , srv907129420:87 , srv1474052620:88 , srv169012507:88 , srv1693411341:88 , srv1711871093:88 , srv1923774330:88 , srv1937445844:88 , srv2038083601:88 , srv2065106514:88 , srv2098256374:88 , srv1365385226:89 , srv1729209848:89 , srv573589665:89 , srv1285207781:90 , srv2017405501:90 , srv2137059849:90 , srv243119611:90 , srv46630663:90 , srv545513373:90 , srv626140200:90 , srv855747606:90 , srv1946590143:91 , srv1802961601:92 , srv1885237991:92 , srv2123319253:92 , srv1856966056:95 , srv1953931675:96 , srv129658901:100 , srv813594763:444 }
2023-08-10 20:53:09,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-10 20:53:09,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1551577058=31, srv1953931675=51, srv523561517=81, srv334150848=68, srv300974422=65, srv483624562=77, srv2098256374=57, srv626231653=88, srv1937445844=49, srv484070105=78, srv1474052620=24, srv2038083601=54, srv1005702918=0, srv543088892=82, srv129658901=15, srv46630663=76, srv1084079704=4, srv1365385226=18, srv190830483=46, srv573589665=84, srv3548560=71, srv1491125706=25, srv1670238319=33, srv1053169187=1, srv1468978538=23, srv1901508183=45, srv1656201040=32, srv521530848=80, srv2123319253=58, srv735162742=91, srv1813094105=42, srv1431552706=20, srv409270071=73, srv322132841=66, srv2137059849=59, srv1526368175=28, srv1718389648=37, srv1919985256=47, srv1856966056=43, srv1885237991=44, srv1266058084=13, srv1349923177=17, srv2051010370=55, srv1163195946=8, srv1285207781=14, srv1797997173=40, srv1452913251=21, srv336463706=69, srv1152547920=7, srv1693411341=35, srv892752761=97, srv778095069=92, srv992831594=99, srv1311129500=16, srv216661054=60, srv626140200=87, srv1711871093=36, srv1198854635=11, srv513395678=79, srv1512484670=27, srv1802961601=41, srv1776685036=39, srv243119611=64, srv634968657=89, srv812343295=94, srv2017431875=53, srv2017405501=52, srv330660961=67, srv1923774330=48, srv169012507=34, srv2065106514=56, srv1399888538=19, srv108451741=5, srv1542415942=30, srv239344518=63, srv1533762130=29, srv1195869043=10, srv150412933=26, srv907129420=98, srv663205674=90, srv1180049712=9, srv1067580575=2, srv7998345=93, srv450913664=75, srv1077254945=3, srv411805481=74, srv855747606=96, srv1253454079=12, srv1464203322=22, srv1946590143=50, srv581128579=85, srv230383543=62, srv348286419=70, srv5923578=86, srv1129327964=6, srv1729209848=38, srv392606286=72, srv545513373=83, srv813594763=95, srv218153868=61} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-10 20:53:09,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-10 20:53:09,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-10 20:53:09,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-10 20:53:09,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-10 20:53:09,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-10 20:53:09,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-10 20:53:09,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-10 20:53:09,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-10 20:53:09,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-10 20:53:09,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-10 20:53:09,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-10 20:53:09,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-10 20:53:09,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-10 20:53:09,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-10 20:53:09,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-10 20:53:09,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-10 20:53:09,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-10 20:53:09,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-10 20:53:09,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-10 20:53:09,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-10 20:53:09,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-10 20:53:09,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-10 20:53:09,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-10 20:53:09,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-10 20:53:09,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-10 20:53:09,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-10 20:53:09,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-10 20:53:09,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-10 20:53:09,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-10 20:53:09,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-10 20:53:09,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-10 20:53:09,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-10 20:53:09,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-10 20:53:09,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-10 20:53:09,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-10 20:53:09,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-10 20:53:09,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-10 20:53:09,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-10 20:53:09,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-10 20:53:09,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-10 20:53:09,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-10 20:53:09,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-10 20:53:09,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-10 20:53:09,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-10 20:53:09,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-10 20:53:09,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-10 20:53:09,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-10 20:53:09,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-10 20:53:09,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-10 20:53:09,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-10 20:53:09,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-10 20:53:09,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-10 20:53:09,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-10 20:53:09,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-10 20:53:09,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-10 20:53:09,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-10 20:53:09,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-10 20:53:09,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-10 20:53:09,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-10 20:53:09,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-10 20:53:09,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-10 20:53:09,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-10 20:53:09,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-10 20:53:09,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-10 20:53:09,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-10 20:53:09,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-10 20:53:09,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-10 20:53:09,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-10 20:53:09,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-10 20:53:09,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-10 20:53:09,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-10 20:53:09,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-10 20:53:09,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-10 20:53:09,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-10 20:53:09,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-10 20:53:09,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-10 20:53:09,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-10 20:53:09,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-10 20:53:09,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-10 20:53:09,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-10 20:53:09,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-10 20:53:09,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-10 20:53:09,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-10 20:53:09,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-10 20:53:09,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-10 20:53:09,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-10 20:53:09,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-10 20:53:09,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-10 20:53:09,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-10 20:53:09,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-10 20:53:09,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-10 20:53:09,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-10 20:53:09,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-10 20:53:09,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-10 20:53:09,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-10 20:53:09,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-10 20:53:09,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-10 20:53:09,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-10 20:53:09,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-10 20:53:09,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-10 20:53:09,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-10 20:53:09,310 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03987447569807075, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05858986402190655, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03987447569807075, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17158333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23966666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-10 20:53:09,310 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-10 20:53:09,310 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17650483697353567, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03987447569807075, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05858986402190655, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03987447569807075, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17158333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23966666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-10 20:53:09,647 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 488 ms to try 5000 different iterations.  Found a solution that moves 2515 regions; Going from a computed imbalance of 0.17650483697353567 to a new imbalance of 0.01678934098608233. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021827013218673225); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0358854643892652, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.27944444444444444, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021827013218673225); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01375); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04583333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-10 20:53:09,659 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv129658901:73 , srv1856966056:77 , srv1953931675:78 , srv2123319253:78 , srv1946590143:80 , srv1885237991:81 , srv243119611:81 , srv573589665:81 , srv626140200:81 , srv1729209848:82 , srv1802961601:82 , srv855747606:82 , srv1285207781:83 , srv1365385226:83 , srv1474052620:83 , srv169012507:83 , srv2065106514:83 , srv334150848:83 , srv46630663:83 , srv545513373:83 , srv1067580575:84 , srv1253454079:84 , srv1399888538:84 , srv1526368175:84 , srv1656201040:84 , srv1693411341:84 , srv1711871093:84 , srv1923774330:84 , srv2038083601:84 , srv2098256374:84 , srv239344518:84 , srv484070105:84 , srv543088892:84 , srv907129420:84 , srv992831594:84 , srv1077254945:85 , srv1152547920:85 , srv2017405501:85 , srv2137059849:85 , srv300974422:85 , srv392606286:85 , srv411805481:85 , srv521530848:85 , srv581128579:85 , srv778095069:85 , srv892752761:85 , srv1266058084:86 , srv1431552706:86 , srv1452913251:86 , srv1468978538:86 , srv1718389648:86 , srv1937445844:86 , srv348286419:86 , srv3548560:86 , srv513395678:86 , srv5923578:86 , srv663205674:86 , srv1005702918:87 , srv1053169187:87 , srv1084079704:87 , srv108451741:87 , srv1180049712:87 , srv1512484670:87 , srv1533762130:87 , srv1670238319:87 , srv216661054:87 , srv218153868:87 , srv330660961:87 , srv336463706:87 , srv409270071:87 , srv483624562:87 , srv1129327964:88 , srv1163195946:88 , srv1311129500:88 , srv1464203322:88 , srv1542415942:88 , srv1776685036:88 , srv1797997173:88 , srv190830483:88 , srv1919985256:88 , srv450913664:88 , srv523561517:88 , srv634968657:88 , srv1195869043:89 , srv1349923177:89 , srv150412933:89 , srv1813094105:89 , srv1901508183:89 , srv2051010370:89 , srv735162742:89 , srv7998345:89 , srv1198854635:90 , srv1551577058:90 , srv2017431875:90 , srv322132841:91 , srv626231653:91 , srv812343295:91 , srv1491125706:92 , srv230383543:94 , srv813594763:524 }
2023-08-10 20:53:09,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-10 20:53:09,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1551577058=31, srv1953931675=51, srv523561517=81, srv334150848=68, srv300974422=65, srv483624562=77, srv2098256374=57, srv626231653=88, srv1937445844=49, srv484070105=78, srv1474052620=24, srv2038083601=54, srv1005702918=0, srv543088892=82, srv129658901=15, srv46630663=76, srv1084079704=4, srv1365385226=18, srv190830483=46, srv573589665=84, srv3548560=71, srv1491125706=25, srv1670238319=33, srv1053169187=1, srv1468978538=23, srv1901508183=45, srv1656201040=32, srv521530848=80, srv2123319253=58, srv735162742=91, srv1813094105=42, srv1431552706=20, srv409270071=73, srv322132841=66, srv2137059849=59, srv1526368175=28, srv1718389648=37, srv1919985256=47, srv1856966056=43, srv1885237991=44, srv1266058084=13, srv1349923177=17, srv2051010370=55, srv1163195946=8, srv1285207781=14, srv1797997173=40, srv1452913251=21, srv336463706=69, srv1152547920=7, srv1693411341=35, srv892752761=97, srv778095069=92, srv992831594=99, srv1311129500=16, srv216661054=60, srv626140200=87, srv1711871093=36, srv1198854635=11, srv513395678=79, srv1512484670=27, srv1802961601=41, srv1776685036=39, srv243119611=64, srv634968657=89, srv812343295=94, srv2017431875=53, srv2017405501=52, srv330660961=67, srv1923774330=48, srv169012507=34, srv2065106514=56, srv1399888538=19, srv108451741=5, srv1542415942=30, srv239344518=63, srv1533762130=29, srv1195869043=10, srv150412933=26, srv907129420=98, srv663205674=90, srv1180049712=9, srv1067580575=2, srv7998345=93, srv450913664=75, srv1077254945=3, srv411805481=74, srv855747606=96, srv1253454079=12, srv1464203322=22, srv1946590143=50, srv581128579=85, srv230383543=62, srv348286419=70, srv5923578=86, srv1129327964=6, srv1729209848=38, srv392606286=72, srv545513373=83, srv813594763=95, srv218153868=61} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-10 20:53:09,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-10 20:53:09,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-10 20:53:09,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-10 20:53:09,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-10 20:53:09,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-10 20:53:09,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-10 20:53:09,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-10 20:53:09,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-10 20:53:09,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-10 20:53:09,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-10 20:53:09,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-10 20:53:09,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-10 20:53:09,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-10 20:53:09,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-10 20:53:09,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-10 20:53:09,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-10 20:53:09,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-10 20:53:09,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-10 20:53:09,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-10 20:53:09,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-10 20:53:09,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-10 20:53:09,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-10 20:53:09,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-10 20:53:09,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-10 20:53:09,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-10 20:53:09,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-10 20:53:09,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-10 20:53:09,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-10 20:53:09,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-10 20:53:09,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-10 20:53:09,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-10 20:53:09,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-10 20:53:09,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-10 20:53:09,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-10 20:53:09,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-10 20:53:09,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-10 20:53:09,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-10 20:53:09,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-10 20:53:09,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-10 20:53:09,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-10 20:53:09,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-10 20:53:09,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-10 20:53:09,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-10 20:53:09,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-10 20:53:09,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-10 20:53:09,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-10 20:53:09,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-10 20:53:09,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-10 20:53:09,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-10 20:53:09,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-10 20:53:09,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-10 20:53:09,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-10 20:53:09,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-10 20:53:09,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-10 20:53:09,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-10 20:53:09,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-10 20:53:09,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-10 20:53:09,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-10 20:53:09,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-10 20:53:09,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-10 20:53:09,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-10 20:53:09,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-10 20:53:09,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-10 20:53:09,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-10 20:53:09,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-10 20:53:09,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-10 20:53:09,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-10 20:53:09,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-10 20:53:09,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-10 20:53:09,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-10 20:53:09,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-10 20:53:09,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-10 20:53:09,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-10 20:53:09,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-10 20:53:09,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-10 20:53:09,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-10 20:53:09,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-10 20:53:09,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-10 20:53:09,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-10 20:53:09,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-10 20:53:09,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-10 20:53:09,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-10 20:53:09,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-10 20:53:09,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-10 20:53:09,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-10 20:53:09,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-10 20:53:09,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-10 20:53:09,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-10 20:53:09,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-10 20:53:09,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-10 20:53:09,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-10 20:53:09,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-10 20:53:09,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-10 20:53:09,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-10 20:53:09,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-10 20:53:09,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-10 20:53:09,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-10 20:53:09,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-10 20:53:09,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-10 20:53:09,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-10 20:53:09,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-10 20:53:09,854 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021827013218673225); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0358854643892652, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021827013218673225); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01375); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04583333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-10 20:53:09,854 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-10 20:53:09,854 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.016771730579687567, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021827013218673225); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0358854643892652, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021827013218673225); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01375); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04583333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-10 20:53:10,140 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 425 ms to try 5000 different iterations.  Found a solution that moves 1015 regions; Going from a computed imbalance of 0.016771730579687567 to a new imbalance of 7.221420912469167E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005311120972618093); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008164965809277261); MoveCostFunction : (multiplier=7.0, imbalance=0.11277777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005311120972618093); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0030833333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-10 20:53:10,142 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv230383543:80 , srv2137059849:82 , srv1129327964:83 , srv1491125706:83 , srv1797997173:83 , srv190830483:83 , srv2017405501:83 , srv626231653:83 , srv1084079704:84 , srv129658901:84 , srv1311129500:84 , srv1542415942:84 , srv1802961601:84 , srv1813094105:84 , srv1901508183:84 , srv1937445844:84 , srv1953931675:84 , srv322132841:84 , srv348286419:84 , srv5923578:84 , srv634968657:84 , srv108451741:85 , srv1163195946:85 , srv1180049712:85 , srv1198854635:85 , srv1285207781:85 , srv1349923177:85 , srv1365385226:85 , srv1431552706:85 , srv1452913251:85 , srv1464203322:85 , srv150412933:85 , srv1533762130:85 , srv1551577058:85 , srv1693411341:85 , srv1856966056:85 , srv1885237991:85 , srv1919985256:85 , srv2038083601:85 , srv2051010370:85 , srv216661054:85 , srv330660961:85 , srv411805481:85 , srv450913664:85 , srv46630663:85 , srv483624562:85 , srv513395678:85 , srv545513373:85 , srv7998345:85 , srv812343295:85 , srv1005702918:86 , srv1152547920:86 , srv1195869043:86 , srv1253454079:86 , srv1468978538:86 , srv1512484670:86 , srv169012507:86 , srv1711871093:86 , srv1718389648:86 , srv1729209848:86 , srv1776685036:86 , srv1923774330:86 , srv1946590143:86 , srv2017431875:86 , srv2098256374:86 , srv239344518:86 , srv300974422:86 , srv392606286:86 , srv521530848:86 , srv523561517:86 , srv663205674:86 , srv735162742:86 , srv778095069:86 , srv855747606:86 , srv907129420:86 , srv1053169187:87 , srv1067580575:87 , srv1077254945:87 , srv1266058084:87 , srv1399888538:87 , srv1474052620:87 , srv1526368175:87 , srv1670238319:87 , srv2065106514:87 , srv218153868:87 , srv243119611:87 , srv336463706:87 , srv543088892:87 , srv581128579:87 , srv626140200:87 , srv892752761:87 , srv992831594:87 , srv1656201040:88 , srv2123319253:88 , srv3548560:88 , srv409270071:88 , srv484070105:88 , srv573589665:88 , srv334150848:89 , srv813594763:537 }
2023-08-10 20:53:10,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-10 20:53:10,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1551577058=31, srv1953931675=51, srv523561517=81, srv334150848=68, srv300974422=65, srv483624562=77, srv2098256374=57, srv626231653=88, srv1937445844=49, srv484070105=78, srv1474052620=24, srv2038083601=54, srv1005702918=0, srv543088892=82, srv129658901=15, srv46630663=76, srv1084079704=4, srv1365385226=18, srv190830483=46, srv573589665=84, srv3548560=71, srv1491125706=25, srv1670238319=33, srv1053169187=1, srv1468978538=23, srv1901508183=45, srv1656201040=32, srv521530848=80, srv2123319253=58, srv735162742=91, srv1813094105=42, srv1431552706=20, srv409270071=73, srv322132841=66, srv2137059849=59, srv1526368175=28, srv1718389648=37, srv1919985256=47, srv1856966056=43, srv1885237991=44, srv1266058084=13, srv1349923177=17, srv2051010370=55, srv1163195946=8, srv1285207781=14, srv1797997173=40, srv1452913251=21, srv336463706=69, srv1152547920=7, srv1693411341=35, srv892752761=97, srv778095069=92, srv992831594=99, srv1311129500=16, srv216661054=60, srv626140200=87, srv1711871093=36, srv1198854635=11, srv513395678=79, srv1512484670=27, srv1802961601=41, srv1776685036=39, srv243119611=64, srv634968657=89, srv812343295=94, srv2017431875=53, srv2017405501=52, srv330660961=67, srv1923774330=48, srv169012507=34, srv2065106514=56, srv1399888538=19, srv108451741=5, srv1542415942=30, srv239344518=63, srv1533762130=29, srv1195869043=10, srv150412933=26, srv907129420=98, srv663205674=90, srv1180049712=9, srv1067580575=2, srv7998345=93, srv450913664=75, srv1077254945=3, srv411805481=74, srv855747606=96, srv1253454079=12, srv1464203322=22, srv1946590143=50, srv581128579=85, srv230383543=62, srv348286419=70, srv5923578=86, srv1129327964=6, srv1729209848=38, srv392606286=72, srv545513373=83, srv813594763=95, srv218153868=61} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-10 20:53:10,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-10 20:53:10,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-10 20:53:10,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-10 20:53:10,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-10 20:53:10,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-10 20:53:10,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-10 20:53:10,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-10 20:53:10,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-10 20:53:10,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-10 20:53:10,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-10 20:53:10,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-10 20:53:10,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-10 20:53:10,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-10 20:53:10,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-10 20:53:10,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-10 20:53:10,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-10 20:53:10,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-10 20:53:10,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-10 20:53:10,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-10 20:53:10,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-10 20:53:10,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-10 20:53:10,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-10 20:53:10,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-10 20:53:10,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-10 20:53:10,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-10 20:53:10,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-10 20:53:10,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-10 20:53:10,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-10 20:53:10,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-10 20:53:10,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-10 20:53:10,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-10 20:53:10,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-10 20:53:10,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-10 20:53:10,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-10 20:53:10,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-10 20:53:10,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-10 20:53:10,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-10 20:53:10,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-10 20:53:10,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-10 20:53:10,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-10 20:53:10,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-10 20:53:10,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-10 20:53:10,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-10 20:53:10,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-10 20:53:10,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-10 20:53:10,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-10 20:53:10,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-10 20:53:10,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-10 20:53:10,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-10 20:53:10,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-10 20:53:10,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-10 20:53:10,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-10 20:53:10,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-10 20:53:10,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-10 20:53:10,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-10 20:53:10,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-10 20:53:10,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-10 20:53:10,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-10 20:53:10,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-10 20:53:10,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-10 20:53:10,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-10 20:53:10,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-10 20:53:10,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-10 20:53:10,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-10 20:53:10,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-10 20:53:10,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-10 20:53:10,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-10 20:53:10,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-10 20:53:10,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-10 20:53:10,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-10 20:53:10,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-10 20:53:10,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-10 20:53:10,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-10 20:53:10,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-10 20:53:10,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-10 20:53:10,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-10 20:53:10,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-10 20:53:10,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-10 20:53:10,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-10 20:53:10,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-10 20:53:10,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-10 20:53:10,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-10 20:53:10,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-10 20:53:10,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-10 20:53:10,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-10 20:53:10,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-10 20:53:10,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-10 20:53:10,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-10 20:53:10,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-10 20:53:10,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-10 20:53:10,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-10 20:53:10,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-10 20:53:10,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-10 20:53:10,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-10 20:53:10,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-10 20:53:10,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-10 20:53:10,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-10 20:53:10,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-10 20:53:10,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-10 20:53:10,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-10 20:53:10,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-10 20:53:10,324 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005311120972618093); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008164965809277261); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005311120972618093); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0030833333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-10 20:53:10,325 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-10 20:53:10,327 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=7.150349093420719E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005311120972618093); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008164965809277261); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005311120972618093); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0030833333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-10 20:53:10,640 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 436 ms to try 5000 different iterations.  Found a solution that moves 243 regions; Going from a computed imbalance of 7.150349093420719E-4 to a new imbalance of 2.0148457230939936E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0019534423844256277); MoveCostFunction : (multiplier=7.0, imbalance=0.027, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-10 20:53:10,641 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1195869043:83 , srv1399888538:83 , srv1718389648:83 , srv218153868:83 , srv1077254945:84 , srv1152547920:84 , srv1163195946:84 , srv1198854635:84 , srv1285207781:84 , srv1349923177:84 , srv1452913251:84 , srv1468978538:84 , srv1474052620:84 , srv150412933:84 , srv1512484670:84 , srv1526368175:84 , srv1551577058:84 , srv1656201040:84 , srv1802961601:84 , srv1885237991:84 , srv1901508183:84 , srv1923774330:84 , srv1937445844:84 , srv2017405501:84 , srv2017431875:84 , srv2065106514:84 , srv2098256374:84 , srv2123319253:84 , srv216661054:84 , srv330660961:84 , srv334150848:84 , srv336463706:84 , srv3548560:84 , srv392606286:84 , srv409270071:84 , srv411805481:84 , srv46630663:84 , srv484070105:84 , srv521530848:84 , srv523561517:84 , srv543088892:84 , srv545513373:84 , srv573589665:84 , srv581128579:84 , srv626140200:84 , srv626231653:84 , srv634968657:84 , srv663205674:84 , srv735162742:84 , srv778095069:84 , srv812343295:84 , srv1005702918:85 , srv1053169187:85 , srv1067580575:85 , srv1084079704:85 , srv108451741:85 , srv1180049712:85 , srv1253454079:85 , srv1266058084:85 , srv129658901:85 , srv1311129500:85 , srv1365385226:85 , srv1431552706:85 , srv1464203322:85 , srv1491125706:85 , srv1542415942:85 , srv1670238319:85 , srv169012507:85 , srv1693411341:85 , srv1711871093:85 , srv1729209848:85 , srv1776685036:85 , srv1797997173:85 , srv1813094105:85 , srv1856966056:85 , srv190830483:85 , srv1919985256:85 , srv1946590143:85 , srv1953931675:85 , srv2038083601:85 , srv2051010370:85 , srv2137059849:85 , srv230383543:85 , srv239344518:85 , srv243119611:85 , srv300974422:85 , srv322132841:85 , srv348286419:85 , srv483624562:85 , srv513395678:85 , srv5923578:85 , srv7998345:85 , srv855747606:85 , srv892752761:85 , srv907129420:85 , srv992831594:85 , srv1129327964:86 , srv1533762130:86 , srv450913664:86 , srv813594763:637 }
2023-08-10 20:53:10,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-10 20:53:10,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1551577058=31, srv1953931675=51, srv523561517=81, srv334150848=68, srv300974422=65, srv483624562=77, srv2098256374=57, srv626231653=88, srv1937445844=49, srv484070105=78, srv1474052620=24, srv2038083601=54, srv1005702918=0, srv543088892=82, srv129658901=15, srv46630663=76, srv1084079704=4, srv1365385226=18, srv190830483=46, srv573589665=84, srv3548560=71, srv1491125706=25, srv1670238319=33, srv1053169187=1, srv1468978538=23, srv1901508183=45, srv1656201040=32, srv521530848=80, srv2123319253=58, srv735162742=91, srv1813094105=42, srv1431552706=20, srv409270071=73, srv322132841=66, srv2137059849=59, srv1526368175=28, srv1718389648=37, srv1919985256=47, srv1856966056=43, srv1885237991=44, srv1266058084=13, srv1349923177=17, srv2051010370=55, srv1163195946=8, srv1285207781=14, srv1797997173=40, srv1452913251=21, srv336463706=69, srv1152547920=7, srv1693411341=35, srv892752761=97, srv778095069=92, srv992831594=99, srv1311129500=16, srv216661054=60, srv626140200=87, srv1711871093=36, srv1198854635=11, srv513395678=79, srv1512484670=27, srv1802961601=41, srv1776685036=39, srv243119611=64, srv634968657=89, srv812343295=94, srv2017431875=53, srv2017405501=52, srv330660961=67, srv1923774330=48, srv169012507=34, srv2065106514=56, srv1399888538=19, srv108451741=5, srv1542415942=30, srv239344518=63, srv1533762130=29, srv1195869043=10, srv150412933=26, srv907129420=98, srv663205674=90, srv1180049712=9, srv1067580575=2, srv7998345=93, srv450913664=75, srv1077254945=3, srv411805481=74, srv855747606=96, srv1253454079=12, srv1464203322=22, srv1946590143=50, srv581128579=85, srv230383543=62, srv348286419=70, srv5923578=86, srv1129327964=6, srv1729209848=38, srv392606286=72, srv545513373=83, srv813594763=95, srv218153868=61} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-10 20:53:10,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-10 20:53:10,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-10 20:53:10,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-10 20:53:10,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-10 20:53:10,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-10 20:53:10,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-10 20:53:10,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-10 20:53:10,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-10 20:53:10,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-10 20:53:10,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-10 20:53:10,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-10 20:53:10,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-10 20:53:10,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-10 20:53:10,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-10 20:53:10,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-10 20:53:10,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-10 20:53:10,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-10 20:53:10,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-10 20:53:10,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-10 20:53:10,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-10 20:53:10,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-10 20:53:10,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-10 20:53:10,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-10 20:53:10,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-10 20:53:10,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-10 20:53:10,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-10 20:53:10,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-10 20:53:10,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-10 20:53:10,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-10 20:53:10,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-10 20:53:10,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-10 20:53:10,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-10 20:53:10,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-10 20:53:10,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-10 20:53:10,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-10 20:53:10,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-10 20:53:10,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-10 20:53:10,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-10 20:53:10,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-10 20:53:10,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-10 20:53:10,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-10 20:53:10,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-10 20:53:10,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-10 20:53:10,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-10 20:53:10,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-10 20:53:10,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-10 20:53:10,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-10 20:53:10,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-10 20:53:10,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-10 20:53:10,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-10 20:53:10,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-10 20:53:10,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-10 20:53:10,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-10 20:53:10,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-10 20:53:10,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-10 20:53:10,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-10 20:53:10,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-10 20:53:10,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-10 20:53:10,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-10 20:53:10,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-10 20:53:10,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-10 20:53:10,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-10 20:53:10,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-10 20:53:10,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-10 20:53:10,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-10 20:53:10,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-10 20:53:10,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-10 20:53:10,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-10 20:53:10,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-10 20:53:10,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-10 20:53:10,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-10 20:53:10,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-10 20:53:10,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-10 20:53:10,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-10 20:53:10,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-10 20:53:10,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-10 20:53:10,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-10 20:53:10,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-10 20:53:10,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-10 20:53:10,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-10 20:53:10,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-10 20:53:10,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-10 20:53:10,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-10 20:53:10,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-10 20:53:10,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-10 20:53:10,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-10 20:53:10,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-10 20:53:10,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-10 20:53:10,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-10 20:53:10,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-10 20:53:10,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-10 20:53:10,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-10 20:53:10,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-10 20:53:10,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-10 20:53:10,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-10 20:53:10,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-10 20:53:10,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-10 20:53:10,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-10 20:53:10,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-10 20:53:10,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-10 20:53:10,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-10 20:53:10,778 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=1.8446934863573154E-5 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0019534423844256277); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-10 20:53:10,779 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1195869043:83 , srv1399888538:83 , srv1718389648:83 , srv218153868:83 , srv1077254945:84 , srv1152547920:84 , srv1163195946:84 , srv1198854635:84 , srv1285207781:84 , srv1349923177:84 , srv1452913251:84 , srv1468978538:84 , srv1474052620:84 , srv150412933:84 , srv1512484670:84 , srv1526368175:84 , srv1551577058:84 , srv1656201040:84 , srv1802961601:84 , srv1885237991:84 , srv1901508183:84 , srv1923774330:84 , srv1937445844:84 , srv2017405501:84 , srv2017431875:84 , srv2065106514:84 , srv2098256374:84 , srv2123319253:84 , srv216661054:84 , srv330660961:84 , srv334150848:84 , srv336463706:84 , srv3548560:84 , srv392606286:84 , srv409270071:84 , srv411805481:84 , srv46630663:84 , srv484070105:84 , srv521530848:84 , srv523561517:84 , srv543088892:84 , srv545513373:84 , srv573589665:84 , srv581128579:84 , srv626140200:84 , srv626231653:84 , srv634968657:84 , srv663205674:84 , srv735162742:84 , srv778095069:84 , srv812343295:84 , srv1005702918:85 , srv1053169187:85 , srv1067580575:85 , srv1084079704:85 , srv108451741:85 , srv1180049712:85 , srv1253454079:85 , srv1266058084:85 , srv129658901:85 , srv1311129500:85 , srv1365385226:85 , srv1431552706:85 , srv1464203322:85 , srv1491125706:85 , srv1542415942:85 , srv1670238319:85 , srv169012507:85 , srv1693411341:85 , srv1711871093:85 , srv1729209848:85 , srv1776685036:85 , srv1797997173:85 , srv1813094105:85 , srv1856966056:85 , srv190830483:85 , srv1919985256:85 , srv1946590143:85 , srv1953931675:85 , srv2038083601:85 , srv2051010370:85 , srv2137059849:85 , srv230383543:85 , srv239344518:85 , srv243119611:85 , srv300974422:85 , srv322132841:85 , srv348286419:85 , srv483624562:85 , srv513395678:85 , srv5923578:85 , srv7998345:85 , srv855747606:85 , srv892752761:85 , srv907129420:85 , srv992831594:85 , srv1129327964:86 , srv1533762130:86 , srv450913664:86 , srv813594763:637 }
2023-08-10 20:53:10,824 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=334 (was 285) - SystemLoadAverage LEAK? -, ProcessCount=174 (was 174), AvailableMemoryMB=7762 (was 8571)
2023-08-10 20:53:10,838 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=334, ProcessCount=174, AvailableMemoryMB=7760
2023-08-10 20:53:10,839 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-08-10 20:53:10,840 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-08-10 20:53:10,867 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1029794498:84 , srv1044118236:84 , srv1171121859:84 , srv1209529567:84 , srv1521391524:84 , srv1764894413:84 , srv1776776483:84 , srv1824395257:84 , srv1849343933:84 , srv1850064532:84 , srv187972811:84 , srv1954986741:84 , srv2046006957:84 , srv2108407217:84 , srv2125293073:84 , srv240786609:84 , srv252731781:84 , srv336532548:84 , srv601170265:84 , srv685419120:84 , srv700539036:84 , srv724110396:84 , srv735151034:84 , srv769994809:84 , srv774840071:84 , srv779610440:84 , srv819616214:84 , srv825486797:84 , srv864368528:84 , srv16087062:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-08-10 20:53:10,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-10 20:53:10,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv336532548=18, srv252731781=17, srv825486797=28, srv16087062=5, srv1776776483=7, srv1029794498=0, srv700539036=21, srv774840071=25, srv240786609=16, srv685419120=20, srv1209529567=3, srv1764894413=6, srv1521391524=4, srv864368528=29, srv1954986741=12, srv2108407217=14, srv2046006957=13, srv1044118236=1, srv769994809=24, srv819616214=27, srv1171121859=2, srv187972811=11, srv1824395257=8, srv1849343933=9, srv1850064532=10, srv601170265=19, srv779610440=26, srv724110396=22, srv2125293073=15, srv735151034=23} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-10 20:53:10,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-10 20:53:10,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-10 20:53:10,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-10 20:53:10,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-10 20:53:10,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-10 20:53:10,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-10 20:53:10,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-10 20:53:10,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-10 20:53:10,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-10 20:53:10,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-10 20:53:10,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-10 20:53:10,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-10 20:53:10,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-10 20:53:10,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-10 20:53:10,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-10 20:53:10,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-10 20:53:10,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-10 20:53:10,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-10 20:53:10,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-10 20:53:10,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-10 20:53:10,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-10 20:53:10,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-10 20:53:10,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-10 20:53:10,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-10 20:53:10,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-10 20:53:10,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-10 20:53:10,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-10 20:53:10,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-10 20:53:10,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-10 20:53:10,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-10 20:53:10,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-08-10 20:53:10,931 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.11960913541971, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-10 20:53:10,932 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.991256992774439, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.11960913541971, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-08-10 20:55:10,900 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6113031 different iterations.  Found a solution that moves 1861 regions; Going from a computed imbalance of 0.991256992774439 to a new imbalance of 4.3436668390529226E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6892592592592592, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-10 20:55:10,908 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1029794498:90 , srv1044118236:90 , srv1171121859:90 , srv1209529567:90 , srv1521391524:90 , srv16087062:90 , srv1764894413:90 , srv1776776483:90 , srv1824395257:90 , srv1849343933:90 , srv1850064532:90 , srv187972811:90 , srv1954986741:90 , srv2046006957:90 , srv2108407217:90 , srv2125293073:90 , srv240786609:90 , srv252731781:90 , srv336532548:90 , srv601170265:90 , srv685419120:90 , srv700539036:90 , srv724110396:90 , srv735151034:90 , srv769994809:90 , srv774840071:90 , srv779610440:90 , srv819616214:90 , srv825486797:90 , srv864368528:90 }
2023-08-10 20:55:10,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-10 20:55:10,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv336532548=18, srv252731781=17, srv825486797=28, srv16087062=5, srv1776776483=7, srv1029794498=0, srv700539036=21, srv774840071=25, srv240786609=16, srv685419120=20, srv1209529567=3, srv1764894413=6, srv1521391524=4, srv864368528=29, srv1954986741=12, srv2108407217=14, srv2046006957=13, srv1044118236=1, srv769994809=24, srv819616214=27, srv1171121859=2, srv187972811=11, srv1824395257=8, srv1849343933=9, srv1850064532=10, srv601170265=19, srv779610440=26, srv724110396=22, srv2125293073=15, srv735151034=23} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-10 20:55:10,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-10 20:55:10,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-10 20:55:10,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-10 20:55:10,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-10 20:55:10,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-10 20:55:10,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-10 20:55:10,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-10 20:55:10,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-10 20:55:10,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-10 20:55:10,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-10 20:55:10,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-10 20:55:10,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-10 20:55:10,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-10 20:55:10,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-10 20:55:10,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-10 20:55:10,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-10 20:55:10,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-10 20:55:10,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-10 20:55:10,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-10 20:55:10,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-10 20:55:10,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-10 20:55:10,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-10 20:55:10,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-10 20:55:10,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-10 20:55:10,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-10 20:55:10,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-10 20:55:10,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-10 20:55:10,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-10 20:55:10,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-10 20:55:10,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-10 20:55:10,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-08-10 20:55:10,933 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-10 20:55:10,934 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1029794498:90 , srv1044118236:90 , srv1171121859:90 , srv1209529567:90 , srv1521391524:90 , srv16087062:90 , srv1764894413:90 , srv1776776483:90 , srv1824395257:90 , srv1849343933:90 , srv1850064532:90 , srv187972811:90 , srv1954986741:90 , srv2046006957:90 , srv2108407217:90 , srv2125293073:90 , srv240786609:90 , srv252731781:90 , srv336532548:90 , srv601170265:90 , srv685419120:90 , srv700539036:90 , srv724110396:90 , srv735151034:90 , srv769994809:90 , srv774840071:90 , srv779610440:90 , srv819616214:90 , srv825486797:90 , srv864368528:90 }
2023-08-10 20:55:10,952 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=208 (was 334), ProcessCount=170 (was 174), AvailableMemoryMB=7748 (was 7760)