2023-04-20 23:55:45,812 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-04-20 23:55:46,173 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-04-20 23:55:46,300 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-04-20 23:55:46,371 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-20 23:55:46,379 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-04-20 23:55:46,394 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=498, ProcessCount=169, AvailableMemoryMB=9595
2023-04-20 23:55:46,396 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-20 23:55:46,397 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-04-20 23:55:46,563 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1015775020:84 , srv1053707374:84 , srv1057080864:84 , srv1067272688:84 , srv1078700519:84 , srv1121480074:84 , srv1121484936:84 , srv1146012017:84 , srv1180816939:84 , srv1214200323:84 , srv1226801706:84 , srv1234892910:84 , srv1236928351:84 , srv1280271542:84 , srv1297089383:84 , srv130734819:84 , srv1343266496:84 , srv1347755160:84 , srv1353434439:84 , srv1384808613:84 , srv1392283774:84 , srv1400278727:84 , srv1402076803:84 , srv1406302676:84 , srv1427845570:84 , srv1434810999:84 , srv1442285127:84 , srv1502249773:84 , srv1517444031:84 , srv156944604:84 , srv1571638435:84 , srv1612106164:84 , srv1637831853:84 , srv1682384932:84 , srv169695519:84 , srv1733693680:84 , srv1737924011:84 , srv174116001:84 , srv1776206094:84 , srv1802433437:84 , srv1815420194:84 , srv1845144540:84 , srv1846489891:84 , srv1860110795:84 , srv1868090907:84 , srv1932246107:84 , srv1984059848:84 , srv1987540435:84 , srv1998921584:84 , srv1999271383:84 , srv2010163507:84 , srv203138020:84 , srv2045370051:84 , srv2060435394:84 , srv2074197177:84 , srv2086036440:84 , srv2086635984:84 , srv210849912:84 , srv2112567570:84 , srv2114900379:84 , srv251026403:84 , srv263378850:84 , srv316343459:84 , srv40634499:84 , srv436915301:84 , srv476671669:84 , srv487414976:84 , srv510385682:84 , srv542414212:84 , srv608688169:84 , srv611568835:84 , srv61768269:84 , srv63759580:84 , srv651611585:84 , srv656222501:84 , srv667732456:84 , srv670929214:84 , srv697080721:84 , srv709084836:84 , srv717643552:84 , srv722775964:84 , srv781517859:84 , srv784120408:84 , srv802747342:84 , srv83482618:84 , srv836459564:84 , srv847507864:84 , srv851920756:84 , srv852847819:84 , srv855499272:84 , srv871620645:84 , srv888975951:84 , srv91667680:84 , srv920620583:84 , srv927605564:84 , srv942861433:84 , srv946697654:84 , srv975052898:84 , srv990807071:84 , srv1798375626:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-04-20 23:55:46,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-20 23:55:46,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2086036440=56, srv1406302676=23, srv847507864=87, srv888975951=92, srv1932246107=46, srv1682384932=33, srv1434810999=25, srv1297089383=14, srv169695519=34, srv1234892910=11, srv1427845570=24, srv1280271542=13, srv1845144540=42, srv510385682=68, srv802747342=84, srv1078700519=4, srv1343266496=16, srv1057080864=2, srv2045370051=53, srv990807071=99, srv1146012017=7, srv1402076803=22, srv2060435394=54, srv476671669=66, srv1214200323=9, srv2112567570=59, srv946697654=97, srv1571638435=30, srv203138020=52, srv852847819=89, srv670929214=77, srv487414976=67, srv1612106164=31, srv975052898=98, srv130734819=15, srv1802433437=40, srv611568835=71, srv1860110795=44, srv1737924011=36, srv1984059848=47, srv1999271383=50, srv1180816939=8, srv1815420194=41, srv2010163507=51, srv784120408=83, srv1987540435=48, srv1353434439=18, srv1015775020=0, srv61768269=72, srv263378850=62, srv2074197177=55, srv851920756=88, srv920620583=94, srv656222501=75, srv1517444031=28, srv1384808613=19, srv1502249773=27, srv1400278727=21, srv1798375626=39, srv91667680=93, srv1392283774=20, srv436915301=65, srv651611585=74, srv156944604=29, srv709084836=79, srv1868090907=45, srv210849912=58, srv40634499=64, srv1733693680=35, srv2114900379=60, srv83482618=85, srv1776206094=38, srv927605564=95, srv1236928351=12, srv174116001=37, srv251026403=61, srv836459564=86, srv608688169=70, srv722775964=81, srv1998921584=49, srv2086635984=57, srv855499272=90, srv1121480074=5, srv1067272688=3, srv697080721=78, srv871620645=91, srv1053707374=1, srv542414212=69, srv717643552=80, srv63759580=73, srv316343459=63, srv1226801706=10, srv1637831853=32, srv942861433=96, srv1442285127=26, srv1347755160=17, srv1846489891=43, srv781517859=82, srv667732456=76, srv1121484936=6} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-20 23:55:46,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-20 23:55:46,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-20 23:55:46,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-20 23:55:46,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-20 23:55:46,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-20 23:55:46,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-20 23:55:46,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-20 23:55:46,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-20 23:55:46,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-20 23:55:46,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-20 23:55:46,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-20 23:55:46,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-20 23:55:46,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-20 23:55:46,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-20 23:55:46,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-20 23:55:46,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-20 23:55:46,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-20 23:55:46,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-20 23:55:46,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-20 23:55:46,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-20 23:55:46,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-20 23:55:46,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-20 23:55:46,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-20 23:55:46,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-20 23:55:46,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-20 23:55:46,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-20 23:55:46,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-20 23:55:46,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-20 23:55:46,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-20 23:55:46,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-20 23:55:46,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-20 23:55:46,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-20 23:55:46,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-20 23:55:46,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-20 23:55:46,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-20 23:55:46,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-20 23:55:46,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-20 23:55:46,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-20 23:55:46,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-20 23:55:46,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-20 23:55:46,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-20 23:55:46,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-20 23:55:46,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-20 23:55:46,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-20 23:55:46,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-20 23:55:46,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-20 23:55:46,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-20 23:55:46,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-20 23:55:46,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-20 23:55:46,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-20 23:55:46,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-20 23:55:46,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-20 23:55:46,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-20 23:55:46,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-20 23:55:46,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-20 23:55:46,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-20 23:55:46,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-20 23:55:46,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-20 23:55:46,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-20 23:55:46,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-20 23:55:46,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-20 23:55:46,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-20 23:55:46,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-20 23:55:46,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-20 23:55:46,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-20 23:55:46,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-20 23:55:46,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-20 23:55:46,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-20 23:55:46,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-20 23:55:46,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-20 23:55:46,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-20 23:55:46,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-20 23:55:46,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-20 23:55:46,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-20 23:55:46,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-20 23:55:46,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-20 23:55:46,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-20 23:55:46,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-20 23:55:46,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-20 23:55:46,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-20 23:55:46,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-20 23:55:46,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-20 23:55:46,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-20 23:55:46,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-20 23:55:46,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-20 23:55:46,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-20 23:55:46,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-20 23:55:46,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-20 23:55:46,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-20 23:55:46,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-20 23:55:46,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-20 23:55:46,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-20 23:55:46,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-20 23:55:46,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-20 23:55:46,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-20 23:55:46,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-20 23:55:46,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-20 23:55:46,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-20 23:55:46,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-20 23:55:46,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-20 23:55:46,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-20 23:55:47,266 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-20 23:55:47,266 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-20 23:55:47,267 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-20 23:55:47,808 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 1048 ms to try 5000 different iterations.  Found a solution that moves 4675 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18455016670743501. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04305893147765636, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0585457891535286, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5194444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04305893147765636, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17991666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24516666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-20 23:55:47,880 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1845144540:82 , srv1400278727:83 , srv1442285127:83 , srv1612106164:83 , srv203138020:83 , srv2045370051:83 , srv436915301:83 , srv510385682:83 , srv942861433:83 , srv1057080864:84 , srv1121484936:84 , srv1297089383:84 , srv1733693680:84 , srv174116001:84 , srv1860110795:84 , srv1868090907:84 , srv210849912:84 , srv263378850:84 , srv40634499:84 , srv476671669:84 , srv61768269:84 , srv784120408:84 , srv836459564:84 , srv851920756:84 , srv91667680:84 , srv1053707374:85 , srv1067272688:85 , srv1121480074:85 , srv1226801706:85 , srv1815420194:85 , srv1846489891:85 , srv1932246107:85 , srv2074197177:85 , srv2086635984:85 , srv251026403:85 , srv608688169:85 , srv651611585:85 , srv667732456:85 , srv670929214:85 , srv709084836:85 , srv722775964:85 , srv802747342:85 , srv1015775020:86 , srv1078700519:86 , srv1146012017:86 , srv1214200323:86 , srv1236928351:86 , srv1347755160:86 , srv1402076803:86 , srv1434810999:86 , srv1502249773:86 , srv1984059848:86 , srv1998921584:86 , srv2086036440:86 , srv2112567570:86 , srv316343459:86 , srv487414976:86 , srv717643552:86 , srv781517859:86 , srv927605564:86 , srv975052898:86 , srv1234892910:87 , srv1343266496:87 , srv1392283774:87 , srv1406302676:87 , srv1427845570:87 , srv1517444031:87 , srv156944604:87 , srv1637831853:87 , srv169695519:87 , srv1737924011:87 , srv1776206094:87 , srv1802433437:87 , srv1987540435:87 , srv2010163507:87 , srv656222501:87 , srv855499272:87 , srv871620645:87 , srv946697654:87 , srv1280271542:88 , srv1353434439:88 , srv1571638435:88 , srv2060435394:88 , srv697080721:88 , srv83482618:88 , srv852847819:88 , srv990807071:88 , srv1999271383:89 , srv920620583:89 , srv1180816939:90 , srv130734819:90 , srv2114900379:90 , srv542414212:90 , srv63759580:90 , srv1384808613:91 , srv847507864:91 , srv888975951:91 , srv611568835:92 , srv1682384932:95 , srv1798375626:473 }
2023-04-20 23:55:47,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-20 23:55:47,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2086036440=56, srv1406302676=23, srv847507864=87, srv888975951=92, srv1932246107=46, srv1682384932=33, srv1434810999=25, srv1297089383=14, srv169695519=34, srv1234892910=11, srv1427845570=24, srv1280271542=13, srv1845144540=42, srv510385682=68, srv802747342=84, srv1078700519=4, srv1343266496=16, srv1057080864=2, srv2045370051=53, srv990807071=99, srv1146012017=7, srv1402076803=22, srv2060435394=54, srv476671669=66, srv1214200323=9, srv2112567570=59, srv946697654=97, srv1571638435=30, srv203138020=52, srv852847819=89, srv670929214=77, srv487414976=67, srv1612106164=31, srv975052898=98, srv130734819=15, srv1802433437=40, srv611568835=71, srv1860110795=44, srv1737924011=36, srv1984059848=47, srv1999271383=50, srv1180816939=8, srv1815420194=41, srv2010163507=51, srv784120408=83, srv1987540435=48, srv1353434439=18, srv1015775020=0, srv61768269=72, srv263378850=62, srv2074197177=55, srv851920756=88, srv920620583=94, srv656222501=75, srv1517444031=28, srv1384808613=19, srv1502249773=27, srv1400278727=21, srv1798375626=39, srv91667680=93, srv1392283774=20, srv436915301=65, srv651611585=74, srv156944604=29, srv709084836=79, srv1868090907=45, srv210849912=58, srv40634499=64, srv1733693680=35, srv2114900379=60, srv83482618=85, srv1776206094=38, srv927605564=95, srv1236928351=12, srv174116001=37, srv251026403=61, srv836459564=86, srv608688169=70, srv722775964=81, srv1998921584=49, srv2086635984=57, srv855499272=90, srv1121480074=5, srv1067272688=3, srv697080721=78, srv871620645=91, srv1053707374=1, srv542414212=69, srv717643552=80, srv63759580=73, srv316343459=63, srv1226801706=10, srv1637831853=32, srv942861433=96, srv1442285127=26, srv1347755160=17, srv1846489891=43, srv781517859=82, srv667732456=76, srv1121484936=6} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-20 23:55:47,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-20 23:55:47,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-20 23:55:47,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-20 23:55:47,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-20 23:55:47,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-20 23:55:47,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-20 23:55:47,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-20 23:55:47,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-20 23:55:47,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-20 23:55:47,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-20 23:55:47,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-20 23:55:47,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-20 23:55:47,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-20 23:55:47,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-20 23:55:47,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-20 23:55:47,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-20 23:55:47,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-20 23:55:47,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-20 23:55:47,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-20 23:55:47,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-20 23:55:47,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-20 23:55:47,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-20 23:55:47,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-20 23:55:47,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-20 23:55:47,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-20 23:55:47,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-20 23:55:47,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-20 23:55:47,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-20 23:55:47,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-20 23:55:47,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-20 23:55:47,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-20 23:55:47,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-20 23:55:47,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-20 23:55:47,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-20 23:55:47,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-20 23:55:47,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-20 23:55:47,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-20 23:55:47,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-20 23:55:47,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-20 23:55:47,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-20 23:55:47,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-20 23:55:47,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-20 23:55:47,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-20 23:55:47,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-20 23:55:47,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-20 23:55:47,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-20 23:55:47,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-20 23:55:47,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-20 23:55:47,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-20 23:55:47,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-20 23:55:47,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-20 23:55:47,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-20 23:55:47,955 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-20 23:55:47,955 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-20 23:55:47,955 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-20 23:55:47,955 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-20 23:55:47,956 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-20 23:55:47,956 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-20 23:55:47,956 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-20 23:55:47,956 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-20 23:55:47,956 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-20 23:55:47,956 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-20 23:55:47,956 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-20 23:55:47,956 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-20 23:55:47,956 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-20 23:55:47,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-20 23:55:47,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-20 23:55:47,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-20 23:55:47,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-20 23:55:47,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-20 23:55:47,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-20 23:55:47,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-20 23:55:47,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-20 23:55:47,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-20 23:55:47,958 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-20 23:55:47,958 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-20 23:55:47,958 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-20 23:55:47,958 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-20 23:55:47,959 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-20 23:55:47,959 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-20 23:55:47,959 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-20 23:55:47,959 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-20 23:55:47,959 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-20 23:55:47,959 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-20 23:55:47,959 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-20 23:55:47,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-20 23:55:47,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-20 23:55:47,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-20 23:55:47,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-20 23:55:47,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-20 23:55:47,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-20 23:55:47,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-20 23:55:47,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-20 23:55:47,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-20 23:55:47,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-20 23:55:47,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-20 23:55:47,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-20 23:55:47,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-20 23:55:47,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-20 23:55:47,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-20 23:55:47,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-20 23:55:48,272 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04305893147765636, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0585457891535286, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04305893147765636, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17991666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24516666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-20 23:55:48,272 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-20 23:55:48,273 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18451743165777476, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04305893147765636, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0585457891535286, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04305893147765636, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17991666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24516666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-20 23:55:48,715 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 634 ms to try 5000 different iterations.  Found a solution that moves 2677 regions; Going from a computed imbalance of 0.18451743165777476 to a new imbalance of 0.012745758750382877. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02216378399242671); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.035308485005105784, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29744444444444446, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02216378399242671); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.00925); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04591666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-20 23:55:48,736 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv611568835:78 , srv1384808613:79 , srv1682384932:79 , srv542414212:81 , srv1180816939:82 , srv130734819:82 , srv847507864:82 , srv852847819:82 , srv888975951:82 , srv1571638435:83 , srv1776206094:83 , srv2114900379:83 , srv1343266496:84 , srv1392283774:84 , srv1427845570:84 , srv1737924011:84 , srv1999271383:84 , srv2010163507:84 , srv2060435394:84 , srv2112567570:84 , srv83482618:84 , srv920620583:84 , srv1067272688:85 , srv1146012017:85 , srv1214200323:85 , srv1280271542:85 , srv1406302676:85 , srv156944604:85 , srv169695519:85 , srv1802433437:85 , srv1846489891:85 , srv2074197177:85 , srv2086036440:85 , srv251026403:85 , srv316343459:85 , srv656222501:85 , srv697080721:85 , srv722775964:85 , srv781517859:85 , srv871620645:85 , srv927605564:85 , srv990807071:85 , srv1015775020:86 , srv1053707374:86 , srv1057080864:86 , srv1078700519:86 , srv1234892910:86 , srv1236928351:86 , srv1297089383:86 , srv1353434439:86 , srv1402076803:86 , srv1637831853:86 , srv1733693680:86 , srv1987540435:86 , srv476671669:86 , srv63759580:86 , srv651611585:86 , srv667732456:86 , srv670929214:86 , srv946697654:86 , srv1121480074:87 , srv1121484936:87 , srv1226801706:87 , srv1347755160:87 , srv1400278727:87 , srv1517444031:87 , srv1868090907:87 , srv1932246107:87 , srv1998921584:87 , srv717643552:87 , srv802747342:87 , srv975052898:87 , srv1434810999:88 , srv1502249773:88 , srv1612106164:88 , srv1815420194:88 , srv1860110795:88 , srv1984059848:88 , srv2045370051:88 , srv2086635984:88 , srv263378850:88 , srv40634499:88 , srv510385682:88 , srv608688169:88 , srv61768269:88 , srv784120408:88 , srv836459564:88 , srv855499272:88 , srv942861433:88 , srv174116001:89 , srv203138020:89 , srv487414976:89 , srv709084836:89 , srv1442285127:90 , srv1845144540:90 , srv210849912:90 , srv436915301:90 , srv851920756:90 , srv91667680:92 , srv1798375626:498 }
2023-04-20 23:55:48,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-20 23:55:48,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2086036440=56, srv1406302676=23, srv847507864=87, srv888975951=92, srv1932246107=46, srv1682384932=33, srv1434810999=25, srv1297089383=14, srv169695519=34, srv1234892910=11, srv1427845570=24, srv1280271542=13, srv1845144540=42, srv510385682=68, srv802747342=84, srv1078700519=4, srv1343266496=16, srv1057080864=2, srv2045370051=53, srv990807071=99, srv1146012017=7, srv1402076803=22, srv2060435394=54, srv476671669=66, srv1214200323=9, srv2112567570=59, srv946697654=97, srv1571638435=30, srv203138020=52, srv852847819=89, srv670929214=77, srv487414976=67, srv1612106164=31, srv975052898=98, srv130734819=15, srv1802433437=40, srv611568835=71, srv1860110795=44, srv1737924011=36, srv1984059848=47, srv1999271383=50, srv1180816939=8, srv1815420194=41, srv2010163507=51, srv784120408=83, srv1987540435=48, srv1353434439=18, srv1015775020=0, srv61768269=72, srv263378850=62, srv2074197177=55, srv851920756=88, srv920620583=94, srv656222501=75, srv1517444031=28, srv1384808613=19, srv1502249773=27, srv1400278727=21, srv1798375626=39, srv91667680=93, srv1392283774=20, srv436915301=65, srv651611585=74, srv156944604=29, srv709084836=79, srv1868090907=45, srv210849912=58, srv40634499=64, srv1733693680=35, srv2114900379=60, srv83482618=85, srv1776206094=38, srv927605564=95, srv1236928351=12, srv174116001=37, srv251026403=61, srv836459564=86, srv608688169=70, srv722775964=81, srv1998921584=49, srv2086635984=57, srv855499272=90, srv1121480074=5, srv1067272688=3, srv697080721=78, srv871620645=91, srv1053707374=1, srv542414212=69, srv717643552=80, srv63759580=73, srv316343459=63, srv1226801706=10, srv1637831853=32, srv942861433=96, srv1442285127=26, srv1347755160=17, srv1846489891=43, srv781517859=82, srv667732456=76, srv1121484936=6} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-20 23:55:48,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-20 23:55:48,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-20 23:55:48,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-20 23:55:48,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-20 23:55:48,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-20 23:55:48,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-20 23:55:48,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-20 23:55:48,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-20 23:55:48,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-20 23:55:48,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-20 23:55:48,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-20 23:55:48,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-20 23:55:48,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-20 23:55:48,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-20 23:55:48,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-20 23:55:48,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-20 23:55:48,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-20 23:55:48,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-20 23:55:48,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-20 23:55:48,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-20 23:55:48,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-20 23:55:48,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-20 23:55:48,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-20 23:55:48,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-20 23:55:48,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-20 23:55:48,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-20 23:55:48,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-20 23:55:48,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-20 23:55:48,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-20 23:55:48,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-20 23:55:48,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-20 23:55:48,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-20 23:55:48,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-20 23:55:48,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-20 23:55:48,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-20 23:55:48,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-20 23:55:48,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-20 23:55:48,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-20 23:55:48,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-20 23:55:48,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-20 23:55:48,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-20 23:55:48,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-20 23:55:48,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-20 23:55:48,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-20 23:55:48,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-20 23:55:48,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-20 23:55:48,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-20 23:55:48,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-20 23:55:48,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-20 23:55:48,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-20 23:55:48,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-20 23:55:48,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-20 23:55:48,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-20 23:55:48,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-20 23:55:48,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-20 23:55:48,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-20 23:55:48,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-20 23:55:48,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-20 23:55:48,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-20 23:55:48,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-20 23:55:48,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-20 23:55:48,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-20 23:55:48,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-20 23:55:48,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-20 23:55:48,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-20 23:55:48,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-20 23:55:48,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-20 23:55:48,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-20 23:55:48,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-20 23:55:48,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-20 23:55:48,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-20 23:55:48,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-20 23:55:48,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-20 23:55:48,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-20 23:55:48,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-20 23:55:48,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-20 23:55:48,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-20 23:55:48,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-20 23:55:48,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-20 23:55:48,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-20 23:55:48,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-20 23:55:48,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-20 23:55:48,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-20 23:55:48,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-20 23:55:48,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-20 23:55:48,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-20 23:55:48,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-20 23:55:48,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-20 23:55:48,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-20 23:55:48,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-20 23:55:48,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-20 23:55:48,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-20 23:55:48,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-20 23:55:48,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-20 23:55:48,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-20 23:55:48,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-20 23:55:48,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-20 23:55:48,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-20 23:55:48,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-20 23:55:48,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-20 23:55:48,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-20 23:55:48,984 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02216378399242671); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.035308485005105784, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02216378399242671); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.00925); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04591666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-20 23:55:48,985 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-20 23:55:48,985 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.012727013995743204, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02216378399242671); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.035308485005105784, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02216378399242671); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.00925); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04591666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-20 23:55:49,372 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 552 ms to try 5000 different iterations.  Found a solution that moves 1009 regions; Going from a computed imbalance of 0.012727013995743204 to a new imbalance of 7.471492804587213E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005661173367839546); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008355190191882916); MoveCostFunction : (multiplier=7.0, imbalance=0.1121111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005661173367839546); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004166666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-20 23:55:49,375 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv63759580:81 , srv855499272:82 , srv91667680:82 , srv1353434439:83 , srv1502249773:83 , srv1517444031:83 , srv1984059848:83 , srv487414976:83 , srv1015775020:84 , srv1121480074:84 , srv1347755160:84 , srv1434810999:84 , srv1637831853:84 , srv1682384932:84 , srv174116001:84 , srv1815420194:84 , srv1998921584:84 , srv1999271383:84 , srv2086635984:84 , srv436915301:84 , srv697080721:84 , srv709084836:84 , srv717643552:84 , srv784120408:84 , srv851920756:84 , srv888975951:84 , srv946697654:84 , srv975052898:84 , srv1078700519:85 , srv1234892910:85 , srv1280271542:85 , srv130734819:85 , srv1402076803:85 , srv1442285127:85 , srv169695519:85 , srv1845144540:85 , srv1932246107:85 , srv210849912:85 , srv2114900379:85 , srv263378850:85 , srv40634499:85 , srv608688169:85 , srv802747342:85 , srv847507864:85 , srv920620583:85 , srv990807071:85 , srv1121484936:86 , srv1146012017:86 , srv1180816939:86 , srv1214200323:86 , srv1226801706:86 , srv1236928351:86 , srv1343266496:86 , srv1406302676:86 , srv156944604:86 , srv1571638435:86 , srv1776206094:86 , srv1860110795:86 , srv1987540435:86 , srv2010163507:86 , srv203138020:86 , srv2045370051:86 , srv2086036440:86 , srv510385682:86 , srv542414212:86 , srv61768269:86 , srv656222501:86 , srv667732456:86 , srv722775964:86 , srv83482618:86 , srv836459564:86 , srv871620645:86 , srv1053707374:87 , srv1057080864:87 , srv1392283774:87 , srv1612106164:87 , srv1733693680:87 , srv1737924011:87 , srv1802433437:87 , srv1846489891:87 , srv1868090907:87 , srv2060435394:87 , srv2074197177:87 , srv316343459:87 , srv476671669:87 , srv611568835:87 , srv651611585:87 , srv670929214:87 , srv781517859:87 , srv927605564:87 , srv942861433:87 , srv1067272688:88 , srv1297089383:88 , srv1384808613:88 , srv1400278727:88 , srv1427845570:88 , srv2112567570:88 , srv251026403:88 , srv852847819:88 , srv1798375626:537 }
2023-04-20 23:55:49,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-20 23:55:49,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2086036440=56, srv1406302676=23, srv847507864=87, srv888975951=92, srv1932246107=46, srv1682384932=33, srv1434810999=25, srv1297089383=14, srv169695519=34, srv1234892910=11, srv1427845570=24, srv1280271542=13, srv1845144540=42, srv510385682=68, srv802747342=84, srv1078700519=4, srv1343266496=16, srv1057080864=2, srv2045370051=53, srv990807071=99, srv1146012017=7, srv1402076803=22, srv2060435394=54, srv476671669=66, srv1214200323=9, srv2112567570=59, srv946697654=97, srv1571638435=30, srv203138020=52, srv852847819=89, srv670929214=77, srv487414976=67, srv1612106164=31, srv975052898=98, srv130734819=15, srv1802433437=40, srv611568835=71, srv1860110795=44, srv1737924011=36, srv1984059848=47, srv1999271383=50, srv1180816939=8, srv1815420194=41, srv2010163507=51, srv784120408=83, srv1987540435=48, srv1353434439=18, srv1015775020=0, srv61768269=72, srv263378850=62, srv2074197177=55, srv851920756=88, srv920620583=94, srv656222501=75, srv1517444031=28, srv1384808613=19, srv1502249773=27, srv1400278727=21, srv1798375626=39, srv91667680=93, srv1392283774=20, srv436915301=65, srv651611585=74, srv156944604=29, srv709084836=79, srv1868090907=45, srv210849912=58, srv40634499=64, srv1733693680=35, srv2114900379=60, srv83482618=85, srv1776206094=38, srv927605564=95, srv1236928351=12, srv174116001=37, srv251026403=61, srv836459564=86, srv608688169=70, srv722775964=81, srv1998921584=49, srv2086635984=57, srv855499272=90, srv1121480074=5, srv1067272688=3, srv697080721=78, srv871620645=91, srv1053707374=1, srv542414212=69, srv717643552=80, srv63759580=73, srv316343459=63, srv1226801706=10, srv1637831853=32, srv942861433=96, srv1442285127=26, srv1347755160=17, srv1846489891=43, srv781517859=82, srv667732456=76, srv1121484936=6} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-20 23:55:49,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-20 23:55:49,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-20 23:55:49,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-20 23:55:49,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-20 23:55:49,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-20 23:55:49,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-20 23:55:49,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-20 23:55:49,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-20 23:55:49,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-20 23:55:49,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-20 23:55:49,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-20 23:55:49,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-20 23:55:49,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-20 23:55:49,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-20 23:55:49,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-20 23:55:49,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-20 23:55:49,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-20 23:55:49,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-20 23:55:49,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-20 23:55:49,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-20 23:55:49,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-20 23:55:49,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-20 23:55:49,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-20 23:55:49,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-20 23:55:49,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-20 23:55:49,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-20 23:55:49,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-20 23:55:49,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-20 23:55:49,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-20 23:55:49,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-20 23:55:49,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-20 23:55:49,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-20 23:55:49,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-20 23:55:49,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-20 23:55:49,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-20 23:55:49,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-20 23:55:49,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-20 23:55:49,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-20 23:55:49,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-20 23:55:49,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-20 23:55:49,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-20 23:55:49,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-20 23:55:49,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-20 23:55:49,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-20 23:55:49,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-20 23:55:49,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-20 23:55:49,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-20 23:55:49,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-20 23:55:49,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-20 23:55:49,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-20 23:55:49,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-20 23:55:49,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-20 23:55:49,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-20 23:55:49,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-20 23:55:49,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-20 23:55:49,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-20 23:55:49,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-20 23:55:49,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-20 23:55:49,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-20 23:55:49,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-20 23:55:49,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-20 23:55:49,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-20 23:55:49,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-20 23:55:49,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-20 23:55:49,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-20 23:55:49,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-20 23:55:49,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-20 23:55:49,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-20 23:55:49,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-20 23:55:49,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-20 23:55:49,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-20 23:55:49,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-20 23:55:49,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-20 23:55:49,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-20 23:55:49,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-20 23:55:49,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-20 23:55:49,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-20 23:55:49,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-20 23:55:49,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-20 23:55:49,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-20 23:55:49,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-20 23:55:49,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-20 23:55:49,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-20 23:55:49,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-20 23:55:49,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-20 23:55:49,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-20 23:55:49,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-20 23:55:49,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-20 23:55:49,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-20 23:55:49,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-20 23:55:49,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-20 23:55:49,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-20 23:55:49,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-20 23:55:49,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-20 23:55:49,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-20 23:55:49,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-20 23:55:49,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-20 23:55:49,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-20 23:55:49,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-20 23:55:49,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-20 23:55:49,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-20 23:55:49,608 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005661173367839546); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008355190191882916); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005661173367839546); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004166666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-20 23:55:49,608 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-20 23:55:49,609 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=7.400841114518362E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005661173367839546); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008355190191882916); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005661173367839546); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004166666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-20 23:55:50,044 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 585 ms to try 5000 different iterations.  Found a solution that moves 252 regions; Going from a computed imbalance of 7.400841114518362E-4 to a new imbalance of 2.632177285084925E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.028, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-20 23:55:50,045 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1234892910:83 , srv1384808613:83 , srv1427845570:83 , srv1802433437:83 , srv2060435394:83 , srv210849912:83 , srv927605564:83 , srv1053707374:84 , srv1067272688:84 , srv1121484936:84 , srv1180816939:84 , srv1226801706:84 , srv1236928351:84 , srv1280271542:84 , srv1297089383:84 , srv1392283774:84 , srv1400278727:84 , srv1406302676:84 , srv1434810999:84 , srv1442285127:84 , srv156944604:84 , srv1612106164:84 , srv1682384932:84 , srv1737924011:84 , srv1846489891:84 , srv1860110795:84 , srv1868090907:84 , srv1987540435:84 , srv203138020:84 , srv2112567570:84 , srv2114900379:84 , srv251026403:84 , srv316343459:84 , srv487414976:84 , srv61768269:84 , srv651611585:84 , srv656222501:84 , srv670929214:84 , srv709084836:84 , srv781517859:84 , srv83482618:84 , srv836459564:84 , srv847507864:84 , srv851920756:84 , srv852847819:84 , srv855499272:84 , srv871620645:84 , srv920620583:84 , srv942861433:84 , srv990807071:84 , srv1057080864:85 , srv1078700519:85 , srv1146012017:85 , srv130734819:85 , srv1343266496:85 , srv1347755160:85 , srv1353434439:85 , srv1402076803:85 , srv1502249773:85 , srv1517444031:85 , srv1571638435:85 , srv1637831853:85 , srv169695519:85 , srv1733693680:85 , srv174116001:85 , srv1815420194:85 , srv1845144540:85 , srv1932246107:85 , srv1984059848:85 , srv1998921584:85 , srv1999271383:85 , srv2010163507:85 , srv2045370051:85 , srv2074197177:85 , srv2086036440:85 , srv263378850:85 , srv40634499:85 , srv436915301:85 , srv476671669:85 , srv510385682:85 , srv608688169:85 , srv611568835:85 , srv63759580:85 , srv667732456:85 , srv697080721:85 , srv717643552:85 , srv802747342:85 , srv888975951:85 , srv91667680:85 , srv946697654:85 , srv975052898:85 , srv1015775020:86 , srv1121480074:86 , srv1214200323:86 , srv1776206094:86 , srv2086635984:86 , srv542414212:86 , srv722775964:86 , srv784120408:86 , srv1798375626:634 }
2023-04-20 23:55:50,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-20 23:55:50,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2086036440=56, srv1406302676=23, srv847507864=87, srv888975951=92, srv1932246107=46, srv1682384932=33, srv1434810999=25, srv1297089383=14, srv169695519=34, srv1234892910=11, srv1427845570=24, srv1280271542=13, srv1845144540=42, srv510385682=68, srv802747342=84, srv1078700519=4, srv1343266496=16, srv1057080864=2, srv2045370051=53, srv990807071=99, srv1146012017=7, srv1402076803=22, srv2060435394=54, srv476671669=66, srv1214200323=9, srv2112567570=59, srv946697654=97, srv1571638435=30, srv203138020=52, srv852847819=89, srv670929214=77, srv487414976=67, srv1612106164=31, srv975052898=98, srv130734819=15, srv1802433437=40, srv611568835=71, srv1860110795=44, srv1737924011=36, srv1984059848=47, srv1999271383=50, srv1180816939=8, srv1815420194=41, srv2010163507=51, srv784120408=83, srv1987540435=48, srv1353434439=18, srv1015775020=0, srv61768269=72, srv263378850=62, srv2074197177=55, srv851920756=88, srv920620583=94, srv656222501=75, srv1517444031=28, srv1384808613=19, srv1502249773=27, srv1400278727=21, srv1798375626=39, srv91667680=93, srv1392283774=20, srv436915301=65, srv651611585=74, srv156944604=29, srv709084836=79, srv1868090907=45, srv210849912=58, srv40634499=64, srv1733693680=35, srv2114900379=60, srv83482618=85, srv1776206094=38, srv927605564=95, srv1236928351=12, srv174116001=37, srv251026403=61, srv836459564=86, srv608688169=70, srv722775964=81, srv1998921584=49, srv2086635984=57, srv855499272=90, srv1121480074=5, srv1067272688=3, srv697080721=78, srv871620645=91, srv1053707374=1, srv542414212=69, srv717643552=80, srv63759580=73, srv316343459=63, srv1226801706=10, srv1637831853=32, srv942861433=96, srv1442285127=26, srv1347755160=17, srv1846489891=43, srv781517859=82, srv667732456=76, srv1121484936=6} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-20 23:55:50,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-20 23:55:50,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-20 23:55:50,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-20 23:55:50,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-20 23:55:50,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-20 23:55:50,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-20 23:55:50,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-20 23:55:50,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-20 23:55:50,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-20 23:55:50,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-20 23:55:50,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-20 23:55:50,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-20 23:55:50,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-20 23:55:50,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-20 23:55:50,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-20 23:55:50,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-20 23:55:50,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-20 23:55:50,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-20 23:55:50,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-20 23:55:50,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-20 23:55:50,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-20 23:55:50,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-20 23:55:50,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-20 23:55:50,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-20 23:55:50,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-20 23:55:50,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-20 23:55:50,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-20 23:55:50,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-20 23:55:50,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-20 23:55:50,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-20 23:55:50,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-20 23:55:50,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-20 23:55:50,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-20 23:55:50,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-20 23:55:50,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-20 23:55:50,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-20 23:55:50,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-20 23:55:50,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-20 23:55:50,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-20 23:55:50,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-20 23:55:50,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-20 23:55:50,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-20 23:55:50,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-20 23:55:50,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-20 23:55:50,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-20 23:55:50,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-20 23:55:50,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-20 23:55:50,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-20 23:55:50,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-20 23:55:50,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-20 23:55:50,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-20 23:55:50,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-20 23:55:50,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-20 23:55:50,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-20 23:55:50,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-20 23:55:50,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-20 23:55:50,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-20 23:55:50,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-20 23:55:50,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-20 23:55:50,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-20 23:55:50,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-20 23:55:50,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-20 23:55:50,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-20 23:55:50,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-20 23:55:50,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-20 23:55:50,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-20 23:55:50,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-20 23:55:50,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-20 23:55:50,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-20 23:55:50,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-20 23:55:50,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-20 23:55:50,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-20 23:55:50,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-20 23:55:50,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-20 23:55:50,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-20 23:55:50,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-20 23:55:50,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-20 23:55:50,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-20 23:55:50,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-20 23:55:50,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-20 23:55:50,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-20 23:55:50,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-20 23:55:50,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-20 23:55:50,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-20 23:55:50,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-20 23:55:50,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-20 23:55:50,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-20 23:55:50,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-20 23:55:50,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-20 23:55:50,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-20 23:55:50,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-20 23:55:50,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-20 23:55:50,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-20 23:55:50,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-20 23:55:50,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-20 23:55:50,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-20 23:55:50,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-20 23:55:50,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-20 23:55:50,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-20 23:55:50,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-20 23:55:50,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-20 23:55:50,242 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-20 23:55:50,242 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-20 23:55:50,244 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.455723113654296E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-20 23:55:50,563 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 466 ms to try 5000 different iterations.  Found a solution that moves 14 regions; Going from a computed imbalance of 2.455723113654296E-5 to a new imbalance of 7.485787595551797E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0016412198797244363); MoveCostFunction : (multiplier=7.0, imbalance=0.0015555555555555555); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-20 23:55:50,563 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1214200323:83 , srv1987540435:83 , srv2086635984:83 , srv542414212:83 , srv608688169:83 , srv91667680:83 , srv1015775020:84 , srv1053707374:84 , srv1057080864:84 , srv1067272688:84 , srv1078700519:84 , srv1121480074:84 , srv1146012017:84 , srv1180816939:84 , srv1226801706:84 , srv1236928351:84 , srv1280271542:84 , srv1297089383:84 , srv130734819:84 , srv1343266496:84 , srv1347755160:84 , srv1353434439:84 , srv1392283774:84 , srv1400278727:84 , srv1402076803:84 , srv1406302676:84 , srv1427845570:84 , srv1434810999:84 , srv1442285127:84 , srv1502249773:84 , srv1517444031:84 , srv156944604:84 , srv1571638435:84 , srv1612106164:84 , srv1637831853:84 , srv1682384932:84 , srv169695519:84 , srv1733693680:84 , srv1737924011:84 , srv174116001:84 , srv1776206094:84 , srv1802433437:84 , srv1815420194:84 , srv1845144540:84 , srv1860110795:84 , srv1868090907:84 , srv1932246107:84 , srv1984059848:84 , srv1998921584:84 , srv1999271383:84 , srv2010163507:84 , srv203138020:84 , srv2045370051:84 , srv2060435394:84 , srv2074197177:84 , srv2086036440:84 , srv210849912:84 , srv2112567570:84 , srv2114900379:84 , srv251026403:84 , srv263378850:84 , srv316343459:84 , srv40634499:84 , srv436915301:84 , srv476671669:84 , srv487414976:84 , srv510385682:84 , srv611568835:84 , srv61768269:84 , srv63759580:84 , srv651611585:84 , srv656222501:84 , srv667732456:84 , srv670929214:84 , srv697080721:84 , srv709084836:84 , srv717643552:84 , srv722775964:84 , srv781517859:84 , srv784120408:84 , srv802747342:84 , srv83482618:84 , srv836459564:84 , srv847507864:84 , srv851920756:84 , srv852847819:84 , srv871620645:84 , srv888975951:84 , srv920620583:84 , srv942861433:84 , srv946697654:84 , srv975052898:84 , srv990807071:84 , srv1121484936:85 , srv1234892910:85 , srv1384808613:85 , srv1846489891:85 , srv855499272:85 , srv927605564:85 , srv1798375626:684 }
2023-04-20 23:55:50,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-20 23:55:50,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2086036440=56, srv1406302676=23, srv847507864=87, srv888975951=92, srv1932246107=46, srv1682384932=33, srv1434810999=25, srv1297089383=14, srv169695519=34, srv1234892910=11, srv1427845570=24, srv1280271542=13, srv1845144540=42, srv510385682=68, srv802747342=84, srv1078700519=4, srv1343266496=16, srv1057080864=2, srv2045370051=53, srv990807071=99, srv1146012017=7, srv1402076803=22, srv2060435394=54, srv476671669=66, srv1214200323=9, srv2112567570=59, srv946697654=97, srv1571638435=30, srv203138020=52, srv852847819=89, srv670929214=77, srv487414976=67, srv1612106164=31, srv975052898=98, srv130734819=15, srv1802433437=40, srv611568835=71, srv1860110795=44, srv1737924011=36, srv1984059848=47, srv1999271383=50, srv1180816939=8, srv1815420194=41, srv2010163507=51, srv784120408=83, srv1987540435=48, srv1353434439=18, srv1015775020=0, srv61768269=72, srv263378850=62, srv2074197177=55, srv851920756=88, srv920620583=94, srv656222501=75, srv1517444031=28, srv1384808613=19, srv1502249773=27, srv1400278727=21, srv1798375626=39, srv91667680=93, srv1392283774=20, srv436915301=65, srv651611585=74, srv156944604=29, srv709084836=79, srv1868090907=45, srv210849912=58, srv40634499=64, srv1733693680=35, srv2114900379=60, srv83482618=85, srv1776206094=38, srv927605564=95, srv1236928351=12, srv174116001=37, srv251026403=61, srv836459564=86, srv608688169=70, srv722775964=81, srv1998921584=49, srv2086635984=57, srv855499272=90, srv1121480074=5, srv1067272688=3, srv697080721=78, srv871620645=91, srv1053707374=1, srv542414212=69, srv717643552=80, srv63759580=73, srv316343459=63, srv1226801706=10, srv1637831853=32, srv942861433=96, srv1442285127=26, srv1347755160=17, srv1846489891=43, srv781517859=82, srv667732456=76, srv1121484936=6} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-20 23:55:50,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-20 23:55:50,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-20 23:55:50,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-20 23:55:50,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-20 23:55:50,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-20 23:55:50,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-20 23:55:50,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-20 23:55:50,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-20 23:55:50,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-20 23:55:50,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-20 23:55:50,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-20 23:55:50,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-20 23:55:50,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-20 23:55:50,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-20 23:55:50,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-20 23:55:50,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-20 23:55:50,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-20 23:55:50,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-20 23:55:50,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-20 23:55:50,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-20 23:55:50,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-20 23:55:50,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-20 23:55:50,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-20 23:55:50,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-20 23:55:50,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-20 23:55:50,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-20 23:55:50,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-20 23:55:50,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-20 23:55:50,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-20 23:55:50,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-20 23:55:50,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-20 23:55:50,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-20 23:55:50,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-20 23:55:50,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-20 23:55:50,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-20 23:55:50,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-20 23:55:50,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-20 23:55:50,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-20 23:55:50,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-20 23:55:50,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-20 23:55:50,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-20 23:55:50,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-20 23:55:50,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-20 23:55:50,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-20 23:55:50,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-20 23:55:50,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-20 23:55:50,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-20 23:55:50,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-20 23:55:50,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-20 23:55:50,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-20 23:55:50,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-20 23:55:50,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-20 23:55:50,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-20 23:55:50,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-20 23:55:50,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-20 23:55:50,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-20 23:55:50,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-20 23:55:50,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-20 23:55:50,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-20 23:55:50,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-20 23:55:50,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-20 23:55:50,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-20 23:55:50,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-20 23:55:50,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-20 23:55:50,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-20 23:55:50,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-20 23:55:50,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-20 23:55:50,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-20 23:55:50,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-20 23:55:50,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-20 23:55:50,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-20 23:55:50,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-20 23:55:50,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-20 23:55:50,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-20 23:55:50,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-20 23:55:50,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-20 23:55:50,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-20 23:55:50,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-20 23:55:50,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-20 23:55:50,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-20 23:55:50,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-20 23:55:50,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-20 23:55:50,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-20 23:55:50,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-20 23:55:50,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-20 23:55:50,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-20 23:55:50,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-20 23:55:50,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-20 23:55:50,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-20 23:55:50,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-20 23:55:50,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-20 23:55:50,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-20 23:55:50,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-20 23:55:50,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-20 23:55:50,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-20 23:55:50,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-20 23:55:50,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-20 23:55:50,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-20 23:55:50,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-20 23:55:50,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-20 23:55:50,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-20 23:55:50,711 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.387757500312559E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0016412198797244363); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-20 23:55:50,711 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1214200323:83 , srv1987540435:83 , srv2086635984:83 , srv542414212:83 , srv608688169:83 , srv91667680:83 , srv1015775020:84 , srv1053707374:84 , srv1057080864:84 , srv1067272688:84 , srv1078700519:84 , srv1121480074:84 , srv1146012017:84 , srv1180816939:84 , srv1226801706:84 , srv1236928351:84 , srv1280271542:84 , srv1297089383:84 , srv130734819:84 , srv1343266496:84 , srv1347755160:84 , srv1353434439:84 , srv1392283774:84 , srv1400278727:84 , srv1402076803:84 , srv1406302676:84 , srv1427845570:84 , srv1434810999:84 , srv1442285127:84 , srv1502249773:84 , srv1517444031:84 , srv156944604:84 , srv1571638435:84 , srv1612106164:84 , srv1637831853:84 , srv1682384932:84 , srv169695519:84 , srv1733693680:84 , srv1737924011:84 , srv174116001:84 , srv1776206094:84 , srv1802433437:84 , srv1815420194:84 , srv1845144540:84 , srv1860110795:84 , srv1868090907:84 , srv1932246107:84 , srv1984059848:84 , srv1998921584:84 , srv1999271383:84 , srv2010163507:84 , srv203138020:84 , srv2045370051:84 , srv2060435394:84 , srv2074197177:84 , srv2086036440:84 , srv210849912:84 , srv2112567570:84 , srv2114900379:84 , srv251026403:84 , srv263378850:84 , srv316343459:84 , srv40634499:84 , srv436915301:84 , srv476671669:84 , srv487414976:84 , srv510385682:84 , srv611568835:84 , srv61768269:84 , srv63759580:84 , srv651611585:84 , srv656222501:84 , srv667732456:84 , srv670929214:84 , srv697080721:84 , srv709084836:84 , srv717643552:84 , srv722775964:84 , srv781517859:84 , srv784120408:84 , srv802747342:84 , srv83482618:84 , srv836459564:84 , srv847507864:84 , srv851920756:84 , srv852847819:84 , srv871620645:84 , srv888975951:84 , srv920620583:84 , srv942861433:84 , srv946697654:84 , srv975052898:84 , srv990807071:84 , srv1121484936:85 , srv1234892910:85 , srv1384808613:85 , srv1846489891:85 , srv855499272:85 , srv927605564:85 , srv1798375626:684 }
2023-04-20 23:55:50,746 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=530 (was 498) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 169), AvailableMemoryMB=9091 (was 9595)
2023-04-20 23:55:50,756 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=530, ProcessCount=169, AvailableMemoryMB=9091
2023-04-20 23:55:50,757 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-20 23:55:50,757 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-04-20 23:55:50,772 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1012204335:84 , srv1035057152:84 , srv1152178655:84 , srv1234141143:84 , srv1275923535:84 , srv1312299903:84 , srv1330046690:84 , srv135025190:84 , srv1424223265:84 , srv1432088332:84 , srv143694596:84 , srv1484637757:84 , srv1626199679:84 , srv1750182406:84 , srv1791419272:84 , srv1920827750:84 , srv1938149499:84 , srv2049716191:84 , srv32914901:84 , srv432196457:84 , srv464176554:84 , srv483068235:84 , srv503604409:84 , srv511302768:84 , srv570699511:84 , srv704334187:84 , srv76381775:84 , srv947819729:84 , srv970811199:84 , srv1214829351:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-04-20 23:55:50,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-20 23:55:50,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1626199679=13, srv1234141143=4, srv503604409=23, srv1791419272=15, srv1035057152=1, srv947819729=28, srv1312299903=6, srv1750182406=14, srv135025190=8, srv2049716191=18, srv970811199=29, srv432196457=20, srv1432088332=10, srv1938149499=17, srv704334187=26, srv76381775=27, srv1275923535=5, srv1152178655=2, srv1330046690=7, srv32914901=19, srv143694596=11, srv1920827750=16, srv570699511=25, srv1012204335=0, srv464176554=21, srv1424223265=9, srv483068235=22, srv511302768=24, srv1214829351=3, srv1484637757=12} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-20 23:55:50,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-20 23:55:50,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-20 23:55:50,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-20 23:55:50,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-20 23:55:50,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-20 23:55:50,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-20 23:55:50,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-20 23:55:50,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-20 23:55:50,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-20 23:55:50,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-20 23:55:50,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-20 23:55:50,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-20 23:55:50,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-20 23:55:50,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-20 23:55:50,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-20 23:55:50,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-20 23:55:50,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-20 23:55:50,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-20 23:55:50,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-20 23:55:50,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-20 23:55:50,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-20 23:55:50,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-20 23:55:50,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-20 23:55:50,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-20 23:55:50,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-20 23:55:50,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-20 23:55:50,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-20 23:55:50,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-20 23:55:50,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-20 23:55:50,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-20 23:55:50,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-04-20 23:55:50,822 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1218689147008918, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-20 23:55:50,823 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912577048235116, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1218689147008918, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-04-20 23:57:50,795 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5403456 different iterations.  Found a solution that moves 1863 regions; Going from a computed imbalance of 0.9912577048235116 to a new imbalance of 4.3483349388262195E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.69, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-20 23:57:50,802 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1012204335:90 , srv1035057152:90 , srv1152178655:90 , srv1214829351:90 , srv1234141143:90 , srv1275923535:90 , srv1312299903:90 , srv1330046690:90 , srv135025190:90 , srv1424223265:90 , srv1432088332:90 , srv143694596:90 , srv1484637757:90 , srv1626199679:90 , srv1750182406:90 , srv1791419272:90 , srv1920827750:90 , srv1938149499:90 , srv2049716191:90 , srv32914901:90 , srv432196457:90 , srv464176554:90 , srv483068235:90 , srv503604409:90 , srv511302768:90 , srv570699511:90 , srv704334187:90 , srv76381775:90 , srv947819729:90 , srv970811199:90 }
2023-04-20 23:57:50,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-20 23:57:50,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1626199679=13, srv1234141143=4, srv503604409=23, srv1791419272=15, srv1035057152=1, srv947819729=28, srv1312299903=6, srv1750182406=14, srv135025190=8, srv2049716191=18, srv970811199=29, srv432196457=20, srv1432088332=10, srv1938149499=17, srv704334187=26, srv76381775=27, srv1275923535=5, srv1152178655=2, srv1330046690=7, srv32914901=19, srv143694596=11, srv1920827750=16, srv570699511=25, srv1012204335=0, srv464176554=21, srv1424223265=9, srv483068235=22, srv511302768=24, srv1214829351=3, srv1484637757=12} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-20 23:57:50,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-20 23:57:50,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-20 23:57:50,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-20 23:57:50,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-20 23:57:50,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-20 23:57:50,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-20 23:57:50,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-20 23:57:50,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-20 23:57:50,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-20 23:57:50,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-20 23:57:50,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-20 23:57:50,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-20 23:57:50,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-20 23:57:50,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-20 23:57:50,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-20 23:57:50,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-20 23:57:50,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-20 23:57:50,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-20 23:57:50,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-20 23:57:50,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-20 23:57:50,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-20 23:57:50,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-20 23:57:50,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-20 23:57:50,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-20 23:57:50,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-20 23:57:50,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-20 23:57:50,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-20 23:57:50,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-20 23:57:50,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-20 23:57:50,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-20 23:57:50,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-04-20 23:57:50,822 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-20 23:57:50,822 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1012204335:90 , srv1035057152:90 , srv1152178655:90 , srv1214829351:90 , srv1234141143:90 , srv1275923535:90 , srv1312299903:90 , srv1330046690:90 , srv135025190:90 , srv1424223265:90 , srv1432088332:90 , srv143694596:90 , srv1484637757:90 , srv1626199679:90 , srv1750182406:90 , srv1791419272:90 , srv1920827750:90 , srv1938149499:90 , srv2049716191:90 , srv32914901:90 , srv432196457:90 , srv464176554:90 , srv483068235:90 , srv503604409:90 , srv511302768:90 , srv570699511:90 , srv704334187:90 , srv76381775:90 , srv947819729:90 , srv970811199:90 }
2023-04-20 23:57:50,834 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=9 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=287 (was 530), ProcessCount=171 (was 169) - ProcessCount LEAK? -, AvailableMemoryMB=9162 (was 9091) - AvailableMemoryMB LEAK? -