2023-05-31 13:54:20,089 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-05-31 13:54:20,335 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-05-31 13:54:20,442 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-05-31 13:54:20,497 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-05-31 13:54:20,503 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-05-31 13:54:20,516 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=264, MaxFileDescriptor=60000, SystemLoadAverage=222, ProcessCount=170, AvailableMemoryMB=8234
2023-05-31 13:54:20,519 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-05-31 13:54:20,519 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-05-31 13:54:20,645 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1060800684:84 , srv1108511170:84 , srv1111707099:84 , srv1112741305:84 , srv1113964059:84 , srv1148997663:84 , srv1150482646:84 , srv1156078966:84 , srv1204082647:84 , srv1212459667:84 , srv1237396993:84 , srv126929140:84 , srv1300408976:84 , srv1320110108:84 , srv1344970150:84 , srv1395309932:84 , srv1395731924:84 , srv141245176:84 , srv1443963885:84 , srv1475223872:84 , srv148240658:84 , srv1484507338:84 , srv1498152912:84 , srv150285283:84 , srv1520962778:84 , srv1535474904:84 , srv1539190243:84 , srv1563210101:84 , srv1573650195:84 , srv1618033279:84 , srv1638334387:84 , srv1642251664:84 , srv1644125172:84 , srv1665857359:84 , srv1697607316:84 , srv1707950740:84 , srv1721023368:84 , srv1732551193:84 , srv1781011602:84 , srv1793069743:84 , srv179686616:84 , srv1797866322:84 , srv181961646:84 , srv1836271713:84 , srv1853905208:84 , srv186198013:84 , srv1875484241:84 , srv1888982507:84 , srv1896100401:84 , srv1910724127:84 , srv1920954490:84 , srv1984221413:84 , srv2033662118:84 , srv2053595500:84 , srv2055848294:84 , srv2102156649:84 , srv2129777358:84 , srv27079457:84 , srv273558633:84 , srv292764929:84 , srv311939560:84 , srv329045703:84 , srv371757248:84 , srv373741002:84 , srv389497188:84 , srv391130445:84 , srv406333090:84 , srv414860576:84 , srv459288993:84 , srv499782623:84 , srv503224575:84 , srv514443032:84 , srv545688390:84 , srv596252955:84 , srv628195422:84 , srv652844785:84 , srv667718001:84 , srv674396270:84 , srv715621749:84 , srv726240028:84 , srv734370006:84 , srv759245043:84 , srv785738988:84 , srv8156799:84 , srv835621637:84 , srv836768670:84 , srv836976330:84 , srv838975787:84 , srv839119061:84 , srv893252082:84 , srv898324480:84 , srv900121904:84 , srv927501638:84 , srv949047344:84 , srv955651167:84 , srv966250820:84 , srv984437681:84 , srv993551917:84 , srv999514302:84 , srv903998497:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-05-31 13:54:20,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-31 13:54:20,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv391130445=65, srv838975787=87, srv1638334387=30, srv785738988=82, srv1707950740=35, srv1395731924=16, srv1443963885=18, srv389497188=64, srv1642251664=31, srv459288993=68, srv1896100401=48, srv406333090=66, srv836768670=85, srv1644125172=32, srv1060800684=0, srv628195422=74, srv839119061=88, srv141245176=17, srv1793069743=39, srv1732551193=37, srv759245043=81, srv1484507338=21, srv414860576=67, srv1665857359=33, srv2033662118=52, srv1836271713=43, srv903998497=92, srv1573650195=28, srv984437681=97, srv311939560=60, srv927501638=93, srv1237396993=10, srv1113964059=4, srv2053595500=53, srv674396270=77, srv1618033279=29, srv8156799=83, srv181961646=42, srv1721023368=36, srv329045703=61, srv1498152912=22, srv1475223872=19, srv1535474904=25, srv836976330=86, srv1395309932=15, srv27079457=57, srv667718001=76, srv900121904=91, srv898324480=90, srv371757248=62, srv1156078966=7, srv1300408976=12, srv993551917=98, srv1520962778=24, srv545688390=72, srv373741002=63, srv1853905208=44, srv1320110108=13, srv186198013=45, srv1344970150=14, srv503224575=70, srv1108511170=1, srv652844785=75, srv179686616=40, srv292764929=59, srv1910724127=49, srv999514302=99, srv1111707099=2, srv2102156649=55, srv514443032=71, srv1150482646=6, srv126929140=11, srv955651167=95, srv1920954490=50, srv1204082647=8, srv1563210101=27, srv2129777358=56, srv1112741305=3, srv1781011602=38, srv596252955=73, srv734370006=80, srv949047344=94, srv715621749=78, srv273558633=58, srv1875484241=46, srv1697607316=34, srv1797866322=41, srv726240028=79, srv148240658=20, srv499782623=69, srv1148997663=5, srv150285283=23, srv835621637=84, srv966250820=96, srv1212459667=9, srv893252082=89, srv1539190243=26, srv2055848294=54, srv1984221413=51, srv1888982507=47} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-31 13:54:20,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-31 13:54:20,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-31 13:54:20,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-31 13:54:20,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-31 13:54:20,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-31 13:54:20,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-31 13:54:20,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-31 13:54:20,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-31 13:54:20,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-31 13:54:20,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-31 13:54:20,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-31 13:54:20,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-31 13:54:20,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-31 13:54:20,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-31 13:54:20,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-31 13:54:20,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-31 13:54:20,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-31 13:54:20,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-31 13:54:20,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-31 13:54:20,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-31 13:54:20,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-31 13:54:20,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-31 13:54:20,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-31 13:54:20,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-31 13:54:20,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-31 13:54:20,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-31 13:54:20,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-31 13:54:20,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-31 13:54:20,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-31 13:54:20,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-31 13:54:20,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-31 13:54:20,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-31 13:54:20,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-31 13:54:20,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-31 13:54:20,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-31 13:54:20,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-31 13:54:20,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-31 13:54:20,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-31 13:54:20,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-31 13:54:20,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-31 13:54:20,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-31 13:54:20,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-31 13:54:20,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-31 13:54:20,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-31 13:54:20,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-31 13:54:20,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-31 13:54:20,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-31 13:54:20,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-31 13:54:20,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-31 13:54:20,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-31 13:54:20,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-31 13:54:20,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-31 13:54:20,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-31 13:54:20,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-31 13:54:20,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-31 13:54:20,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-31 13:54:20,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-31 13:54:20,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-31 13:54:20,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-31 13:54:20,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-31 13:54:20,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-31 13:54:20,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-31 13:54:20,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-31 13:54:20,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-31 13:54:20,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-31 13:54:20,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-31 13:54:20,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-31 13:54:20,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-31 13:54:20,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-31 13:54:20,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-31 13:54:20,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-31 13:54:20,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-31 13:54:20,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-31 13:54:20,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-31 13:54:20,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-31 13:54:20,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-31 13:54:20,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-31 13:54:20,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-31 13:54:20,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-31 13:54:20,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-31 13:54:20,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-31 13:54:20,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-31 13:54:20,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-31 13:54:20,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-31 13:54:20,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-31 13:54:20,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-31 13:54:20,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-31 13:54:20,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-31 13:54:20,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-31 13:54:20,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-31 13:54:20,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-31 13:54:20,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-31 13:54:20,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-31 13:54:20,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-31 13:54:20,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-31 13:54:20,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-31 13:54:20,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-31 13:54:20,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-31 13:54:20,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-31 13:54:20,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-31 13:54:20,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-31 13:54:20,987 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-31 13:54:20,987 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-31 13:54:20,987 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-31 13:54:21,375 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 618 ms to try 5000 different iterations.  Found a solution that moves 4651 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18542368929624575. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03955198662319159, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.058058757342477084, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5167777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03955198662319159, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.18091666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24508333333333332, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-31 13:54:21,389 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv715621749:80 , srv999514302:80 , srv1697607316:81 , srv1836271713:81 , srv993551917:81 , srv1156078966:82 , srv1920954490:82 , srv2102156649:82 , srv27079457:82 , srv1344970150:83 , srv1539190243:83 , srv179686616:83 , srv186198013:83 , srv1875484241:83 , srv1888982507:83 , srv1108511170:84 , srv1443963885:84 , srv1535474904:84 , srv1618033279:84 , srv2033662118:84 , srv2055848294:84 , srv2129777358:84 , srv273558633:84 , srv785738988:84 , srv949047344:84 , srv955651167:84 , srv1111707099:85 , srv1237396993:85 , srv1395731924:85 , srv1484507338:85 , srv150285283:85 , srv1721023368:85 , srv2053595500:85 , srv406333090:85 , srv503224575:85 , srv759245043:85 , srv838975787:85 , srv1113964059:86 , srv1148997663:86 , srv1395309932:86 , srv141245176:86 , srv1520962778:86 , srv1573650195:86 , srv1732551193:86 , srv1781011602:86 , srv181961646:86 , srv373741002:86 , srv389497188:86 , srv545688390:86 , srv596252955:86 , srv628195422:86 , srv839119061:86 , srv893252082:86 , srv898324480:86 , srv966250820:86 , srv984437681:86 , srv1112741305:87 , srv1204082647:87 , srv126929140:87 , srv1320110108:87 , srv1475223872:87 , srv1563210101:87 , srv1644125172:87 , srv1665857359:87 , srv1984221413:87 , srv329045703:87 , srv391130445:87 , srv414860576:87 , srv652844785:87 , srv836976330:87 , srv1150482646:88 , srv1212459667:88 , srv1498152912:88 , srv292764929:88 , srv726240028:88 , srv734370006:88 , srv900121904:88 , srv1638334387:89 , srv1642251664:89 , srv1896100401:89 , srv1910724127:89 , srv371757248:89 , srv514443032:89 , srv8156799:89 , srv1300408976:90 , srv1707950740:90 , srv836768670:90 , srv1797866322:91 , srv499782623:91 , srv667718001:91 , srv674396270:91 , srv835621637:91 , srv148240658:92 , srv1793069743:92 , srv459288993:92 , srv311939560:93 , srv1060800684:94 , srv1853905208:95 , srv927501638:97 , srv903998497:441 }
2023-05-31 13:54:21,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-31 13:54:21,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv391130445=65, srv838975787=87, srv1638334387=30, srv785738988=82, srv1707950740=35, srv1395731924=16, srv1443963885=18, srv389497188=64, srv1642251664=31, srv459288993=68, srv1896100401=48, srv406333090=66, srv836768670=85, srv1644125172=32, srv1060800684=0, srv628195422=74, srv839119061=88, srv141245176=17, srv1793069743=39, srv1732551193=37, srv759245043=81, srv1484507338=21, srv414860576=67, srv1665857359=33, srv2033662118=52, srv1836271713=43, srv903998497=92, srv1573650195=28, srv984437681=97, srv311939560=60, srv927501638=93, srv1237396993=10, srv1113964059=4, srv2053595500=53, srv674396270=77, srv1618033279=29, srv8156799=83, srv181961646=42, srv1721023368=36, srv329045703=61, srv1498152912=22, srv1475223872=19, srv1535474904=25, srv836976330=86, srv1395309932=15, srv27079457=57, srv667718001=76, srv900121904=91, srv898324480=90, srv371757248=62, srv1156078966=7, srv1300408976=12, srv993551917=98, srv1520962778=24, srv545688390=72, srv373741002=63, srv1853905208=44, srv1320110108=13, srv186198013=45, srv1344970150=14, srv503224575=70, srv1108511170=1, srv652844785=75, srv179686616=40, srv292764929=59, srv1910724127=49, srv999514302=99, srv1111707099=2, srv2102156649=55, srv514443032=71, srv1150482646=6, srv126929140=11, srv955651167=95, srv1920954490=50, srv1204082647=8, srv1563210101=27, srv2129777358=56, srv1112741305=3, srv1781011602=38, srv596252955=73, srv734370006=80, srv949047344=94, srv715621749=78, srv273558633=58, srv1875484241=46, srv1697607316=34, srv1797866322=41, srv726240028=79, srv148240658=20, srv499782623=69, srv1148997663=5, srv150285283=23, srv835621637=84, srv966250820=96, srv1212459667=9, srv893252082=89, srv1539190243=26, srv2055848294=54, srv1984221413=51, srv1888982507=47} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-31 13:54:21,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-31 13:54:21,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-31 13:54:21,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-31 13:54:21,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-31 13:54:21,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-31 13:54:21,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-31 13:54:21,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-31 13:54:21,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-31 13:54:21,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-31 13:54:21,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-31 13:54:21,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-31 13:54:21,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-31 13:54:21,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-31 13:54:21,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-31 13:54:21,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-31 13:54:21,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-31 13:54:21,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-31 13:54:21,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-31 13:54:21,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-31 13:54:21,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-31 13:54:21,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-31 13:54:21,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-31 13:54:21,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-31 13:54:21,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-31 13:54:21,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-31 13:54:21,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-31 13:54:21,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-31 13:54:21,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-31 13:54:21,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-31 13:54:21,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-31 13:54:21,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-31 13:54:21,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-31 13:54:21,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-31 13:54:21,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-31 13:54:21,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-31 13:54:21,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-31 13:54:21,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-31 13:54:21,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-31 13:54:21,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-31 13:54:21,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-31 13:54:21,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-31 13:54:21,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-31 13:54:21,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-31 13:54:21,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-31 13:54:21,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-31 13:54:21,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-31 13:54:21,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-31 13:54:21,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-31 13:54:21,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-31 13:54:21,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-31 13:54:21,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-31 13:54:21,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-31 13:54:21,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-31 13:54:21,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-31 13:54:21,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-31 13:54:21,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-31 13:54:21,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-31 13:54:21,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-31 13:54:21,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-31 13:54:21,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-31 13:54:21,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-31 13:54:21,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-31 13:54:21,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-31 13:54:21,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-31 13:54:21,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-31 13:54:21,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-31 13:54:21,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-31 13:54:21,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-31 13:54:21,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-31 13:54:21,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-31 13:54:21,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-31 13:54:21,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-31 13:54:21,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-31 13:54:21,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-31 13:54:21,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-31 13:54:21,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-31 13:54:21,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-31 13:54:21,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-31 13:54:21,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-31 13:54:21,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-31 13:54:21,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-31 13:54:21,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-31 13:54:21,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-31 13:54:21,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-31 13:54:21,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-31 13:54:21,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-31 13:54:21,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-31 13:54:21,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-31 13:54:21,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-31 13:54:21,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-31 13:54:21,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-31 13:54:21,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-31 13:54:21,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-31 13:54:21,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-31 13:54:21,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-31 13:54:21,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-31 13:54:21,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-31 13:54:21,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-31 13:54:21,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-31 13:54:21,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-31 13:54:21,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-31 13:54:21,528 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03955198662319159, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.058058757342477084, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03955198662319159, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.18091666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24508333333333332, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-31 13:54:21,528 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-31 13:54:21,528 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18539112229817736, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03955198662319159, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.058058757342477084, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03955198662319159, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.18091666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24508333333333332, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-31 13:54:21,736 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 297 ms to try 5000 different iterations.  Found a solution that moves 2613 regions; Going from a computed imbalance of 0.18539112229817736 to a new imbalance of 0.014535689264621334. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021055215743106898); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03590109871423003, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29033333333333333, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021055215743106898); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011333333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.045, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-31 13:54:21,745 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1853905208:76 , srv311939560:77 , srv927501638:77 , srv1793069743:79 , srv1060800684:80 , srv148240658:80 , srv459288993:80 , srv667718001:80 , srv1707950740:81 , srv1300408976:82 , srv1638334387:82 , srv499782623:82 , srv835621637:82 , srv1212459667:83 , srv1642251664:83 , srv1797866322:83 , srv292764929:83 , srv373741002:83 , srv514443032:83 , srv674396270:83 , srv726240028:83 , srv1475223872:84 , srv1665857359:84 , srv181961646:84 , srv1984221413:84 , srv371757248:84 , srv389497188:84 , srv734370006:84 , srv836768670:84 , srv1113964059:85 , srv1204082647:85 , srv1237396993:85 , srv141245176:85 , srv1563210101:85 , srv1573650195:85 , srv1644125172:85 , srv1732551193:85 , srv1781011602:85 , srv329045703:85 , srv414860576:85 , srv545688390:85 , srv652844785:85 , srv836976330:85 , srv984437681:85 , srv1112741305:86 , srv1148997663:86 , srv126929140:86 , srv1395309932:86 , srv150285283:86 , srv1520962778:86 , srv1896100401:86 , srv2055848294:86 , srv391130445:86 , srv628195422:86 , srv785738988:86 , srv893252082:86 , srv898324480:86 , srv1108511170:87 , srv1150482646:87 , srv1320110108:87 , srv1498152912:87 , srv1875484241:87 , srv2053595500:87 , srv273558633:87 , srv406333090:87 , srv503224575:87 , srv596252955:87 , srv759245043:87 , srv8156799:87 , srv900121904:87 , srv955651167:87 , srv966250820:87 , srv1443963885:88 , srv1484507338:88 , srv1535474904:88 , srv1721023368:88 , srv186198013:88 , srv1910724127:88 , srv1920954490:88 , srv2033662118:88 , srv2102156649:88 , srv2129777358:88 , srv838975787:88 , srv839119061:88 , srv949047344:88 , srv1111707099:89 , srv1156078966:89 , srv1395731924:89 , srv1618033279:89 , srv1836271713:89 , srv1888982507:89 , srv999514302:90 , srv1539190243:91 , srv179686616:91 , srv27079457:91 , srv715621749:91 , srv993551917:91 , srv1697607316:92 , srv1344970150:93 , srv903998497:520 }
2023-05-31 13:54:21,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-31 13:54:21,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv391130445=65, srv838975787=87, srv1638334387=30, srv785738988=82, srv1707950740=35, srv1395731924=16, srv1443963885=18, srv389497188=64, srv1642251664=31, srv459288993=68, srv1896100401=48, srv406333090=66, srv836768670=85, srv1644125172=32, srv1060800684=0, srv628195422=74, srv839119061=88, srv141245176=17, srv1793069743=39, srv1732551193=37, srv759245043=81, srv1484507338=21, srv414860576=67, srv1665857359=33, srv2033662118=52, srv1836271713=43, srv903998497=92, srv1573650195=28, srv984437681=97, srv311939560=60, srv927501638=93, srv1237396993=10, srv1113964059=4, srv2053595500=53, srv674396270=77, srv1618033279=29, srv8156799=83, srv181961646=42, srv1721023368=36, srv329045703=61, srv1498152912=22, srv1475223872=19, srv1535474904=25, srv836976330=86, srv1395309932=15, srv27079457=57, srv667718001=76, srv900121904=91, srv898324480=90, srv371757248=62, srv1156078966=7, srv1300408976=12, srv993551917=98, srv1520962778=24, srv545688390=72, srv373741002=63, srv1853905208=44, srv1320110108=13, srv186198013=45, srv1344970150=14, srv503224575=70, srv1108511170=1, srv652844785=75, srv179686616=40, srv292764929=59, srv1910724127=49, srv999514302=99, srv1111707099=2, srv2102156649=55, srv514443032=71, srv1150482646=6, srv126929140=11, srv955651167=95, srv1920954490=50, srv1204082647=8, srv1563210101=27, srv2129777358=56, srv1112741305=3, srv1781011602=38, srv596252955=73, srv734370006=80, srv949047344=94, srv715621749=78, srv273558633=58, srv1875484241=46, srv1697607316=34, srv1797866322=41, srv726240028=79, srv148240658=20, srv499782623=69, srv1148997663=5, srv150285283=23, srv835621637=84, srv966250820=96, srv1212459667=9, srv893252082=89, srv1539190243=26, srv2055848294=54, srv1984221413=51, srv1888982507=47} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-31 13:54:21,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-31 13:54:21,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-31 13:54:21,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-31 13:54:21,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-31 13:54:21,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-31 13:54:21,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-31 13:54:21,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-31 13:54:21,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-31 13:54:21,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-31 13:54:21,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-31 13:54:21,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-31 13:54:21,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-31 13:54:21,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-31 13:54:21,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-31 13:54:21,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-31 13:54:21,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-31 13:54:21,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-31 13:54:21,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-31 13:54:21,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-31 13:54:21,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-31 13:54:21,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-31 13:54:21,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-31 13:54:21,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-31 13:54:21,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-31 13:54:21,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-31 13:54:21,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-31 13:54:21,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-31 13:54:21,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-31 13:54:21,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-31 13:54:21,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-31 13:54:21,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-31 13:54:21,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-31 13:54:21,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-31 13:54:21,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-31 13:54:21,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-31 13:54:21,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-31 13:54:21,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-31 13:54:21,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-31 13:54:21,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-31 13:54:21,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-31 13:54:21,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-31 13:54:21,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-31 13:54:21,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-31 13:54:21,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-31 13:54:21,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-31 13:54:21,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-31 13:54:21,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-31 13:54:21,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-31 13:54:21,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-31 13:54:21,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-31 13:54:21,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-31 13:54:21,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-31 13:54:21,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-31 13:54:21,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-31 13:54:21,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-31 13:54:21,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-31 13:54:21,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-31 13:54:21,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-31 13:54:21,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-31 13:54:21,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-31 13:54:21,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-31 13:54:21,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-31 13:54:21,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-31 13:54:21,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-31 13:54:21,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-31 13:54:21,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-31 13:54:21,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-31 13:54:21,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-31 13:54:21,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-31 13:54:21,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-31 13:54:21,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-31 13:54:21,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-31 13:54:21,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-31 13:54:21,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-31 13:54:21,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-31 13:54:21,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-31 13:54:21,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-31 13:54:21,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-31 13:54:21,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-31 13:54:21,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-31 13:54:21,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-31 13:54:21,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-31 13:54:21,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-31 13:54:21,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-31 13:54:21,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-31 13:54:21,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-31 13:54:21,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-31 13:54:21,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-31 13:54:21,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-31 13:54:21,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-31 13:54:21,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-31 13:54:21,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-31 13:54:21,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-31 13:54:21,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-31 13:54:21,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-31 13:54:21,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-31 13:54:21,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-31 13:54:21,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-31 13:54:21,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-31 13:54:21,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-31 13:54:21,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-31 13:54:21,871 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021055215743106898); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03590109871423003, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021055215743106898); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011333333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.045, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-31 13:54:21,871 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-31 13:54:21,871 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.014517392647559897, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021055215743106898); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03590109871423003, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021055215743106898); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011333333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.045, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-31 13:54:22,039 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 242 ms to try 5000 different iterations.  Found a solution that moves 963 regions; Going from a computed imbalance of 0.014517392647559897 to a new imbalance of 7.88438866560643E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006880230611214945); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009628334541246444); MoveCostFunction : (multiplier=7.0, imbalance=0.107, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006880230611214945); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0045); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-31 13:54:22,040 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1910724127:80 , srv1344970150:81 , srv1150482646:82 , srv1896100401:82 , srv8156799:82 , srv1060800684:83 , srv1111707099:83 , srv1320110108:83 , srv1498152912:83 , srv1539190243:83 , srv900121904:83 , srv126929140:84 , srv1395731924:84 , srv1618033279:84 , srv1697607316:84 , srv179686616:84 , srv1797866322:84 , srv371757248:84 , srv391130445:84 , srv499782623:84 , srv674396270:84 , srv835621637:84 , srv836768670:84 , srv838975787:84 , srv839119061:84 , srv927501638:84 , srv966250820:84 , srv1204082647:85 , srv1300408976:85 , srv1484507338:85 , srv1520962778:85 , srv1535474904:85 , srv1563210101:85 , srv1665857359:85 , srv1721023368:85 , srv186198013:85 , srv1888982507:85 , srv2033662118:85 , srv27079457:85 , srv329045703:85 , srv596252955:85 , srv628195422:85 , srv652844785:85 , srv734370006:85 , srv836976330:85 , srv893252082:85 , srv898324480:85 , srv949047344:85 , srv993551917:85 , srv1108511170:86 , srv1112741305:86 , srv1148997663:86 , srv1212459667:86 , srv1395309932:86 , srv1443963885:86 , srv148240658:86 , srv150285283:86 , srv1573650195:86 , srv1642251664:86 , srv1644125172:86 , srv1707950740:86 , srv1732551193:86 , srv1793069743:86 , srv181961646:86 , srv1853905208:86 , srv1875484241:86 , srv1920954490:86 , srv2053595500:86 , srv2129777358:86 , srv273558633:86 , srv292764929:86 , srv406333090:86 , srv414860576:86 , srv503224575:86 , srv514443032:86 , srv715621749:86 , srv726240028:86 , srv759245043:86 , srv984437681:86 , srv1113964059:87 , srv1156078966:87 , srv1237396993:87 , srv141245176:87 , srv1475223872:87 , srv1638334387:87 , srv1781011602:87 , srv1836271713:87 , srv1984221413:87 , srv2055848294:87 , srv2102156649:87 , srv311939560:87 , srv389497188:87 , srv459288993:87 , srv545688390:87 , srv667718001:87 , srv785738988:87 , srv955651167:87 , srv999514302:88 , srv373741002:89 , srv903998497:558 }
2023-05-31 13:54:22,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-31 13:54:22,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv391130445=65, srv838975787=87, srv1638334387=30, srv785738988=82, srv1707950740=35, srv1395731924=16, srv1443963885=18, srv389497188=64, srv1642251664=31, srv459288993=68, srv1896100401=48, srv406333090=66, srv836768670=85, srv1644125172=32, srv1060800684=0, srv628195422=74, srv839119061=88, srv141245176=17, srv1793069743=39, srv1732551193=37, srv759245043=81, srv1484507338=21, srv414860576=67, srv1665857359=33, srv2033662118=52, srv1836271713=43, srv903998497=92, srv1573650195=28, srv984437681=97, srv311939560=60, srv927501638=93, srv1237396993=10, srv1113964059=4, srv2053595500=53, srv674396270=77, srv1618033279=29, srv8156799=83, srv181961646=42, srv1721023368=36, srv329045703=61, srv1498152912=22, srv1475223872=19, srv1535474904=25, srv836976330=86, srv1395309932=15, srv27079457=57, srv667718001=76, srv900121904=91, srv898324480=90, srv371757248=62, srv1156078966=7, srv1300408976=12, srv993551917=98, srv1520962778=24, srv545688390=72, srv373741002=63, srv1853905208=44, srv1320110108=13, srv186198013=45, srv1344970150=14, srv503224575=70, srv1108511170=1, srv652844785=75, srv179686616=40, srv292764929=59, srv1910724127=49, srv999514302=99, srv1111707099=2, srv2102156649=55, srv514443032=71, srv1150482646=6, srv126929140=11, srv955651167=95, srv1920954490=50, srv1204082647=8, srv1563210101=27, srv2129777358=56, srv1112741305=3, srv1781011602=38, srv596252955=73, srv734370006=80, srv949047344=94, srv715621749=78, srv273558633=58, srv1875484241=46, srv1697607316=34, srv1797866322=41, srv726240028=79, srv148240658=20, srv499782623=69, srv1148997663=5, srv150285283=23, srv835621637=84, srv966250820=96, srv1212459667=9, srv893252082=89, srv1539190243=26, srv2055848294=54, srv1984221413=51, srv1888982507=47} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-31 13:54:22,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-31 13:54:22,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-31 13:54:22,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-31 13:54:22,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-31 13:54:22,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-31 13:54:22,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-31 13:54:22,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-31 13:54:22,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-31 13:54:22,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-31 13:54:22,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-31 13:54:22,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-31 13:54:22,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-31 13:54:22,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-31 13:54:22,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-31 13:54:22,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-31 13:54:22,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-31 13:54:22,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-31 13:54:22,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-31 13:54:22,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-31 13:54:22,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-31 13:54:22,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-31 13:54:22,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-31 13:54:22,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-31 13:54:22,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-31 13:54:22,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-31 13:54:22,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-31 13:54:22,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-31 13:54:22,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-31 13:54:22,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-31 13:54:22,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-31 13:54:22,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-31 13:54:22,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-31 13:54:22,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-31 13:54:22,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-31 13:54:22,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-31 13:54:22,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-31 13:54:22,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-31 13:54:22,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-31 13:54:22,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-31 13:54:22,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-31 13:54:22,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-31 13:54:22,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-31 13:54:22,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-31 13:54:22,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-31 13:54:22,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-31 13:54:22,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-31 13:54:22,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-31 13:54:22,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-31 13:54:22,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-31 13:54:22,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-31 13:54:22,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-31 13:54:22,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-31 13:54:22,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-31 13:54:22,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-31 13:54:22,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-31 13:54:22,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-31 13:54:22,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-31 13:54:22,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-31 13:54:22,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-31 13:54:22,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-31 13:54:22,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-31 13:54:22,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-31 13:54:22,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-31 13:54:22,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-31 13:54:22,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-31 13:54:22,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-31 13:54:22,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-31 13:54:22,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-31 13:54:22,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-31 13:54:22,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-31 13:54:22,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-31 13:54:22,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-31 13:54:22,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-31 13:54:22,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-31 13:54:22,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-31 13:54:22,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-31 13:54:22,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-31 13:54:22,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-31 13:54:22,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-31 13:54:22,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-31 13:54:22,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-31 13:54:22,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-31 13:54:22,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-31 13:54:22,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-31 13:54:22,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-31 13:54:22,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-31 13:54:22,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-31 13:54:22,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-31 13:54:22,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-31 13:54:22,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-31 13:54:22,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-31 13:54:22,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-31 13:54:22,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-31 13:54:22,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-31 13:54:22,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-31 13:54:22,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-31 13:54:22,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-31 13:54:22,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-31 13:54:22,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-31 13:54:22,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-31 13:54:22,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-31 13:54:22,166 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006880230611214945); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009628334541246444); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006880230611214945); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0045); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-31 13:54:22,166 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-31 13:54:22,167 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=7.816957964381155E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006880230611214945); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009628334541246444); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006880230611214945); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0045); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-31 13:54:22,439 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 362 ms to try 5000 different iterations.  Found a solution that moves 273 regions; Going from a computed imbalance of 7.816957964381155E-4 to a new imbalance of 3.5691704483570256E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.694119368783758E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.030333333333333334, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.694119368783758E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-31 13:54:22,440 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1112741305:83 , srv1896100401:83 , srv2129777358:83 , srv459288993:83 , srv927501638:83 , srv1113964059:84 , srv1148997663:84 , srv1150482646:84 , srv1156078966:84 , srv1204082647:84 , srv1320110108:84 , srv1395309932:84 , srv1395731924:84 , srv141245176:84 , srv1443963885:84 , srv148240658:84 , srv1484507338:84 , srv1498152912:84 , srv1638334387:84 , srv1642251664:84 , srv1644125172:84 , srv1721023368:84 , srv1781011602:84 , srv179686616:84 , srv1797866322:84 , srv1836271713:84 , srv1984221413:84 , srv2033662118:84 , srv2053595500:84 , srv27079457:84 , srv373741002:84 , srv391130445:84 , srv406333090:84 , srv414860576:84 , srv503224575:84 , srv514443032:84 , srv545688390:84 , srv667718001:84 , srv785738988:84 , srv8156799:84 , srv835621637:84 , srv836768670:84 , srv839119061:84 , srv900121904:84 , srv955651167:84 , srv999514302:84 , srv1060800684:85 , srv1212459667:85 , srv126929140:85 , srv1300408976:85 , srv1344970150:85 , srv1475223872:85 , srv1520962778:85 , srv1535474904:85 , srv1539190243:85 , srv1563210101:85 , srv1573650195:85 , srv1618033279:85 , srv1697607316:85 , srv1707950740:85 , srv1732551193:85 , srv1793069743:85 , srv1853905208:85 , srv1888982507:85 , srv1910724127:85 , srv2055848294:85 , srv2102156649:85 , srv273558633:85 , srv292764929:85 , srv311939560:85 , srv329045703:85 , srv389497188:85 , srv499782623:85 , srv596252955:85 , srv652844785:85 , srv674396270:85 , srv715621749:85 , srv726240028:85 , srv734370006:85 , srv759245043:85 , srv836976330:85 , srv838975787:85 , srv893252082:85 , srv898324480:85 , srv949047344:85 , srv966250820:85 , srv984437681:85 , srv993551917:85 , srv1108511170:86 , srv1111707099:86 , srv1237396993:86 , srv150285283:86 , srv1665857359:86 , srv181961646:86 , srv1875484241:86 , srv1920954490:86 , srv371757248:86 , srv628195422:86 , srv186198013:87 , srv903998497:624 }
2023-05-31 13:54:22,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-31 13:54:22,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv391130445=65, srv838975787=87, srv1638334387=30, srv785738988=82, srv1707950740=35, srv1395731924=16, srv1443963885=18, srv389497188=64, srv1642251664=31, srv459288993=68, srv1896100401=48, srv406333090=66, srv836768670=85, srv1644125172=32, srv1060800684=0, srv628195422=74, srv839119061=88, srv141245176=17, srv1793069743=39, srv1732551193=37, srv759245043=81, srv1484507338=21, srv414860576=67, srv1665857359=33, srv2033662118=52, srv1836271713=43, srv903998497=92, srv1573650195=28, srv984437681=97, srv311939560=60, srv927501638=93, srv1237396993=10, srv1113964059=4, srv2053595500=53, srv674396270=77, srv1618033279=29, srv8156799=83, srv181961646=42, srv1721023368=36, srv329045703=61, srv1498152912=22, srv1475223872=19, srv1535474904=25, srv836976330=86, srv1395309932=15, srv27079457=57, srv667718001=76, srv900121904=91, srv898324480=90, srv371757248=62, srv1156078966=7, srv1300408976=12, srv993551917=98, srv1520962778=24, srv545688390=72, srv373741002=63, srv1853905208=44, srv1320110108=13, srv186198013=45, srv1344970150=14, srv503224575=70, srv1108511170=1, srv652844785=75, srv179686616=40, srv292764929=59, srv1910724127=49, srv999514302=99, srv1111707099=2, srv2102156649=55, srv514443032=71, srv1150482646=6, srv126929140=11, srv955651167=95, srv1920954490=50, srv1204082647=8, srv1563210101=27, srv2129777358=56, srv1112741305=3, srv1781011602=38, srv596252955=73, srv734370006=80, srv949047344=94, srv715621749=78, srv273558633=58, srv1875484241=46, srv1697607316=34, srv1797866322=41, srv726240028=79, srv148240658=20, srv499782623=69, srv1148997663=5, srv150285283=23, srv835621637=84, srv966250820=96, srv1212459667=9, srv893252082=89, srv1539190243=26, srv2055848294=54, srv1984221413=51, srv1888982507=47} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-31 13:54:22,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-31 13:54:22,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-31 13:54:22,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-31 13:54:22,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-31 13:54:22,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-31 13:54:22,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-31 13:54:22,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-31 13:54:22,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-31 13:54:22,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-31 13:54:22,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-31 13:54:22,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-31 13:54:22,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-31 13:54:22,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-31 13:54:22,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-31 13:54:22,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-31 13:54:22,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-31 13:54:22,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-31 13:54:22,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-31 13:54:22,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-31 13:54:22,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-31 13:54:22,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-31 13:54:22,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-31 13:54:22,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-31 13:54:22,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-31 13:54:22,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-31 13:54:22,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-31 13:54:22,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-31 13:54:22,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-31 13:54:22,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-31 13:54:22,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-31 13:54:22,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-31 13:54:22,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-31 13:54:22,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-31 13:54:22,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-31 13:54:22,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-31 13:54:22,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-31 13:54:22,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-31 13:54:22,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-31 13:54:22,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-31 13:54:22,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-31 13:54:22,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-31 13:54:22,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-31 13:54:22,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-31 13:54:22,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-31 13:54:22,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-31 13:54:22,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-31 13:54:22,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-31 13:54:22,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-31 13:54:22,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-31 13:54:22,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-31 13:54:22,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-31 13:54:22,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-31 13:54:22,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-31 13:54:22,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-31 13:54:22,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-31 13:54:22,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-31 13:54:22,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-31 13:54:22,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-31 13:54:22,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-31 13:54:22,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-31 13:54:22,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-31 13:54:22,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-31 13:54:22,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-31 13:54:22,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-31 13:54:22,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-31 13:54:22,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-31 13:54:22,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-31 13:54:22,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-31 13:54:22,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-31 13:54:22,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-31 13:54:22,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-31 13:54:22,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-31 13:54:22,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-31 13:54:22,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-31 13:54:22,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-31 13:54:22,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-31 13:54:22,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-31 13:54:22,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-31 13:54:22,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-31 13:54:22,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-31 13:54:22,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-31 13:54:22,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-31 13:54:22,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-31 13:54:22,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-31 13:54:22,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-31 13:54:22,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-31 13:54:22,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-31 13:54:22,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-31 13:54:22,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-31 13:54:22,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-31 13:54:22,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-31 13:54:22,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-31 13:54:22,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-31 13:54:22,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-31 13:54:22,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-31 13:54:22,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-31 13:54:22,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-31 13:54:22,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-31 13:54:22,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-31 13:54:22,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-31 13:54:22,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-31 13:54:22,558 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.694119368783758E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.694119368783758E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-31 13:54:22,558 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-31 13:54:22,559 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=3.37801176264051E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.694119368783758E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.694119368783758E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-31 13:54:22,718 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 242 ms to try 5000 different iterations.  Found a solution that moves 36 regions; Going from a computed imbalance of 3.37801176264051E-5 to a new imbalance of 5.894570381284716E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0012535023884839248); MoveCostFunction : (multiplier=7.0, imbalance=0.004); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-31 13:54:22,718 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1108511170:83 , srv1111707099:83 , srv1237396993:83 , srv1475223872:83 , srv150285283:83 , srv186198013:83 , srv371757248:83 , srv596252955:83 , srv628195422:83 , srv674396270:83 , srv759245043:83 , srv1060800684:84 , srv1112741305:84 , srv1113964059:84 , srv1148997663:84 , srv1156078966:84 , srv1212459667:84 , srv126929140:84 , srv1300408976:84 , srv1344970150:84 , srv1395309932:84 , srv1395731924:84 , srv141245176:84 , srv1443963885:84 , srv148240658:84 , srv1484507338:84 , srv1498152912:84 , srv1520962778:84 , srv1535474904:84 , srv1539190243:84 , srv1563210101:84 , srv1573650195:84 , srv1618033279:84 , srv1638334387:84 , srv1642251664:84 , srv1644125172:84 , srv1665857359:84 , srv1697607316:84 , srv1707950740:84 , srv1721023368:84 , srv1732551193:84 , srv1781011602:84 , srv1793069743:84 , srv179686616:84 , srv1797866322:84 , srv181961646:84 , srv1853905208:84 , srv1875484241:84 , srv1888982507:84 , srv1910724127:84 , srv1920954490:84 , srv1984221413:84 , srv2053595500:84 , srv2055848294:84 , srv2102156649:84 , srv27079457:84 , srv273558633:84 , srv292764929:84 , srv311939560:84 , srv329045703:84 , srv373741002:84 , srv389497188:84 , srv406333090:84 , srv414860576:84 , srv459288993:84 , srv499782623:84 , srv503224575:84 , srv514443032:84 , srv545688390:84 , srv652844785:84 , srv667718001:84 , srv715621749:84 , srv726240028:84 , srv734370006:84 , srv8156799:84 , srv836768670:84 , srv836976330:84 , srv838975787:84 , srv839119061:84 , srv893252082:84 , srv898324480:84 , srv900121904:84 , srv949047344:84 , srv955651167:84 , srv966250820:84 , srv984437681:84 , srv993551917:84 , srv999514302:84 , srv1150482646:85 , srv1204082647:85 , srv1320110108:85 , srv1836271713:85 , srv2033662118:85 , srv2129777358:85 , srv391130445:85 , srv785738988:85 , srv835621637:85 , srv927501638:85 , srv1896100401:86 , srv903998497:683 }
2023-05-31 13:54:22,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-31 13:54:22,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv391130445=65, srv838975787=87, srv1638334387=30, srv785738988=82, srv1707950740=35, srv1395731924=16, srv1443963885=18, srv389497188=64, srv1642251664=31, srv459288993=68, srv1896100401=48, srv406333090=66, srv836768670=85, srv1644125172=32, srv1060800684=0, srv628195422=74, srv839119061=88, srv141245176=17, srv1793069743=39, srv1732551193=37, srv759245043=81, srv1484507338=21, srv414860576=67, srv1665857359=33, srv2033662118=52, srv1836271713=43, srv903998497=92, srv1573650195=28, srv984437681=97, srv311939560=60, srv927501638=93, srv1237396993=10, srv1113964059=4, srv2053595500=53, srv674396270=77, srv1618033279=29, srv8156799=83, srv181961646=42, srv1721023368=36, srv329045703=61, srv1498152912=22, srv1475223872=19, srv1535474904=25, srv836976330=86, srv1395309932=15, srv27079457=57, srv667718001=76, srv900121904=91, srv898324480=90, srv371757248=62, srv1156078966=7, srv1300408976=12, srv993551917=98, srv1520962778=24, srv545688390=72, srv373741002=63, srv1853905208=44, srv1320110108=13, srv186198013=45, srv1344970150=14, srv503224575=70, srv1108511170=1, srv652844785=75, srv179686616=40, srv292764929=59, srv1910724127=49, srv999514302=99, srv1111707099=2, srv2102156649=55, srv514443032=71, srv1150482646=6, srv126929140=11, srv955651167=95, srv1920954490=50, srv1204082647=8, srv1563210101=27, srv2129777358=56, srv1112741305=3, srv1781011602=38, srv596252955=73, srv734370006=80, srv949047344=94, srv715621749=78, srv273558633=58, srv1875484241=46, srv1697607316=34, srv1797866322=41, srv726240028=79, srv148240658=20, srv499782623=69, srv1148997663=5, srv150285283=23, srv835621637=84, srv966250820=96, srv1212459667=9, srv893252082=89, srv1539190243=26, srv2055848294=54, srv1984221413=51, srv1888982507=47} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-31 13:54:22,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-31 13:54:22,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-31 13:54:22,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-31 13:54:22,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-31 13:54:22,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-31 13:54:22,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-31 13:54:22,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-31 13:54:22,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-31 13:54:22,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-31 13:54:22,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-31 13:54:22,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-31 13:54:22,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-31 13:54:22,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-31 13:54:22,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-31 13:54:22,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-31 13:54:22,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-31 13:54:22,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-31 13:54:22,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-31 13:54:22,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-31 13:54:22,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-31 13:54:22,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-31 13:54:22,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-31 13:54:22,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-31 13:54:22,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-31 13:54:22,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-31 13:54:22,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-31 13:54:22,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-31 13:54:22,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-31 13:54:22,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-31 13:54:22,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-31 13:54:22,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-31 13:54:22,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-31 13:54:22,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-31 13:54:22,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-31 13:54:22,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-31 13:54:22,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-31 13:54:22,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-31 13:54:22,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-31 13:54:22,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-31 13:54:22,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-31 13:54:22,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-31 13:54:22,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-31 13:54:22,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-31 13:54:22,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-31 13:54:22,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-31 13:54:22,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-31 13:54:22,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-31 13:54:22,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-31 13:54:22,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-31 13:54:22,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-31 13:54:22,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-31 13:54:22,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-31 13:54:22,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-31 13:54:22,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-31 13:54:22,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-31 13:54:22,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-31 13:54:22,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-31 13:54:22,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-31 13:54:22,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-31 13:54:22,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-31 13:54:22,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-31 13:54:22,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-31 13:54:22,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-31 13:54:22,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-31 13:54:22,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-31 13:54:22,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-31 13:54:22,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-31 13:54:22,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-31 13:54:22,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-31 13:54:22,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-31 13:54:22,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-31 13:54:22,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-31 13:54:22,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-31 13:54:22,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-31 13:54:22,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-31 13:54:22,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-31 13:54:22,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-31 13:54:22,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-31 13:54:22,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-31 13:54:22,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-31 13:54:22,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-31 13:54:22,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-31 13:54:22,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-31 13:54:22,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-31 13:54:22,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-31 13:54:22,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-31 13:54:22,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-31 13:54:22,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-31 13:54:22,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-31 13:54:22,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-31 13:54:22,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-31 13:54:22,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-31 13:54:22,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-31 13:54:22,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-31 13:54:22,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-31 13:54:22,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-31 13:54:22,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-31 13:54:22,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-31 13:54:22,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-31 13:54:22,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-31 13:54:22,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-31 13:54:22,831 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=5.642492993526674E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0012535023884839248); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-31 13:54:22,831 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1108511170:83 , srv1111707099:83 , srv1237396993:83 , srv1475223872:83 , srv150285283:83 , srv186198013:83 , srv371757248:83 , srv596252955:83 , srv628195422:83 , srv674396270:83 , srv759245043:83 , srv1060800684:84 , srv1112741305:84 , srv1113964059:84 , srv1148997663:84 , srv1156078966:84 , srv1212459667:84 , srv126929140:84 , srv1300408976:84 , srv1344970150:84 , srv1395309932:84 , srv1395731924:84 , srv141245176:84 , srv1443963885:84 , srv148240658:84 , srv1484507338:84 , srv1498152912:84 , srv1520962778:84 , srv1535474904:84 , srv1539190243:84 , srv1563210101:84 , srv1573650195:84 , srv1618033279:84 , srv1638334387:84 , srv1642251664:84 , srv1644125172:84 , srv1665857359:84 , srv1697607316:84 , srv1707950740:84 , srv1721023368:84 , srv1732551193:84 , srv1781011602:84 , srv1793069743:84 , srv179686616:84 , srv1797866322:84 , srv181961646:84 , srv1853905208:84 , srv1875484241:84 , srv1888982507:84 , srv1910724127:84 , srv1920954490:84 , srv1984221413:84 , srv2053595500:84 , srv2055848294:84 , srv2102156649:84 , srv27079457:84 , srv273558633:84 , srv292764929:84 , srv311939560:84 , srv329045703:84 , srv373741002:84 , srv389497188:84 , srv406333090:84 , srv414860576:84 , srv459288993:84 , srv499782623:84 , srv503224575:84 , srv514443032:84 , srv545688390:84 , srv652844785:84 , srv667718001:84 , srv715621749:84 , srv726240028:84 , srv734370006:84 , srv8156799:84 , srv836768670:84 , srv836976330:84 , srv838975787:84 , srv839119061:84 , srv893252082:84 , srv898324480:84 , srv900121904:84 , srv949047344:84 , srv955651167:84 , srv966250820:84 , srv984437681:84 , srv993551917:84 , srv999514302:84 , srv1150482646:85 , srv1204082647:85 , srv1320110108:85 , srv1836271713:85 , srv2033662118:85 , srv2129777358:85 , srv391130445:85 , srv785738988:85 , srv835621637:85 , srv927501638:85 , srv1896100401:86 , srv903998497:683 }
2023-05-31 13:54:22,851 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=264 (was 264), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=222 (was 222), ProcessCount=170 (was 170), AvailableMemoryMB=7606 (was 8234)
2023-05-31 13:54:22,860 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=264, MaxFileDescriptor=60000, SystemLoadAverage=222, ProcessCount=170, AvailableMemoryMB=7606
2023-05-31 13:54:22,861 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-05-31 13:54:22,861 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-05-31 13:54:22,870 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv122217950:84 , srv1312201248:84 , srv1353301721:84 , srv1648841679:84 , srv1677232074:84 , srv1698852058:84 , srv1762663439:84 , srv1794231652:84 , srv184391599:84 , srv1859808024:84 , srv2008844158:84 , srv2037433377:84 , srv2123033931:84 , srv216527634:84 , srv243154973:84 , srv273448035:84 , srv346876999:84 , srv379562301:84 , srv419873610:84 , srv464423912:84 , srv509050473:84 , srv562271698:84 , srv590145989:84 , srv643696343:84 , srv656690985:84 , srv760915853:84 , srv808314346:84 , srv89678396:84 , srv917738364:84 , srv1173454276:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-05-31 13:54:22,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-31 13:54:22,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv509050473=21, srv2123033931=13, srv243154973=15, srv216527634=14, srv917738364=29, srv1173454276=0, srv808314346=27, srv89678396=28, srv2037433377=12, srv464423912=20, srv1648841679=4, srv346876999=17, srv760915853=26, srv184391599=9, srv273448035=16, srv379562301=18, srv1353301721=3, srv1698852058=6, srv1312201248=2, srv1859808024=10, srv2008844158=11, srv1762663439=7, srv562271698=22, srv656690985=25, srv419873610=19, srv590145989=23, srv643696343=24, srv1677232074=5, srv1794231652=8, srv122217950=1} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-31 13:54:22,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-31 13:54:22,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-31 13:54:22,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-31 13:54:22,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-31 13:54:22,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-31 13:54:22,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-31 13:54:22,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-31 13:54:22,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-31 13:54:22,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-31 13:54:22,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-31 13:54:22,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-31 13:54:22,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-31 13:54:22,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-31 13:54:22,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-31 13:54:22,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-31 13:54:22,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-31 13:54:22,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-31 13:54:22,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-31 13:54:22,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-31 13:54:22,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-31 13:54:22,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-31 13:54:22,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-31 13:54:22,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-31 13:54:22,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-31 13:54:22,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-31 13:54:22,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-31 13:54:22,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-31 13:54:22,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-31 13:54:22,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-31 13:54:22,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-31 13:54:22,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-05-31 13:54:22,898 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1163048808778957, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-31 13:54:22,898 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912559516146223, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1163048808778957, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-05-31 13:56:22,886 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 10004343 different iterations.  Found a solution that moves 1850 regions; Going from a computed imbalance of 0.9912559516146223 to a new imbalance of 4.317992290299789E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6851851851851852, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-31 13:56:22,891 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1173454276:90 , srv122217950:90 , srv1312201248:90 , srv1353301721:90 , srv1648841679:90 , srv1677232074:90 , srv1698852058:90 , srv1762663439:90 , srv1794231652:90 , srv184391599:90 , srv1859808024:90 , srv2008844158:90 , srv2037433377:90 , srv2123033931:90 , srv216527634:90 , srv243154973:90 , srv273448035:90 , srv346876999:90 , srv379562301:90 , srv419873610:90 , srv464423912:90 , srv509050473:90 , srv562271698:90 , srv590145989:90 , srv643696343:90 , srv656690985:90 , srv760915853:90 , srv808314346:90 , srv89678396:90 , srv917738364:90 }
2023-05-31 13:56:22,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-31 13:56:22,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv509050473=21, srv2123033931=13, srv243154973=15, srv216527634=14, srv917738364=29, srv1173454276=0, srv808314346=27, srv89678396=28, srv2037433377=12, srv464423912=20, srv1648841679=4, srv346876999=17, srv760915853=26, srv184391599=9, srv273448035=16, srv379562301=18, srv1353301721=3, srv1698852058=6, srv1312201248=2, srv1859808024=10, srv2008844158=11, srv1762663439=7, srv562271698=22, srv656690985=25, srv419873610=19, srv590145989=23, srv643696343=24, srv1677232074=5, srv1794231652=8, srv122217950=1} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-31 13:56:22,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-31 13:56:22,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-31 13:56:22,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-31 13:56:22,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-31 13:56:22,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-31 13:56:22,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-31 13:56:22,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-31 13:56:22,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-31 13:56:22,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-31 13:56:22,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-31 13:56:22,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-31 13:56:22,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-31 13:56:22,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-31 13:56:22,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-31 13:56:22,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-31 13:56:22,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-31 13:56:22,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-31 13:56:22,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-31 13:56:22,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-31 13:56:22,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-31 13:56:22,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-31 13:56:22,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-31 13:56:22,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-31 13:56:22,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-31 13:56:22,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-31 13:56:22,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-31 13:56:22,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-31 13:56:22,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-31 13:56:22,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-31 13:56:22,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-31 13:56:22,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-05-31 13:56:22,906 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-31 13:56:22,906 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1173454276:90 , srv122217950:90 , srv1312201248:90 , srv1353301721:90 , srv1648841679:90 , srv1677232074:90 , srv1698852058:90 , srv1762663439:90 , srv1794231652:90 , srv184391599:90 , srv1859808024:90 , srv2008844158:90 , srv2037433377:90 , srv2123033931:90 , srv216527634:90 , srv243154973:90 , srv273448035:90 , srv346876999:90 , srv379562301:90 , srv419873610:90 , srv464423912:90 , srv509050473:90 , srv562271698:90 , srv590145989:90 , srv643696343:90 , srv656690985:90 , srv760915853:90 , srv808314346:90 , srv89678396:90 , srv917738364:90 }
2023-05-31 13:56:22,916 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=264 (was 264), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=121 (was 222), ProcessCount=168 (was 170), AvailableMemoryMB=7358 (was 7606)