2024-02-16 05:53:15,868 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2024-02-16 05:53:16,206 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2024-02-16 05:53:16,321 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2024-02-16 05:53:16,386 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-02-16 05:53:16,393 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-02-16 05:53:16,408 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=316, ProcessCount=168, AvailableMemoryMB=1981
2024-02-16 05:53:16,410 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-02-16 05:53:16,410 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-02-16 05:53:16,553 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1022990500:84 , srv1026659263:84 , srv1031844370:84 , srv1050205370:84 , srv1052575939:84 , srv108997710:84 , srv1117012802:84 , srv1200304188:84 , srv1211621990:84 , srv1229398319:84 , srv1279023966:84 , srv1302227668:84 , srv1304836146:84 , srv1335124538:84 , srv1352677532:84 , srv13545254:84 , srv1360327266:84 , srv1374462445:84 , srv1375850152:84 , srv1395279950:84 , srv1413377849:84 , srv1435162864:84 , srv1436621587:84 , srv1442590441:84 , srv1475238989:84 , srv1486364062:84 , srv1490809108:84 , srv1520188045:84 , srv1540226022:84 , srv1549993214:84 , srv1553363933:84 , srv1619505993:84 , srv1635779580:84 , srv1636127428:84 , srv164579498:84 , srv1657181161:84 , srv1682583521:84 , srv1700107102:84 , srv1711337388:84 , srv1714368876:84 , srv171774217:84 , srv1730441895:84 , srv1733213941:84 , srv1750603584:84 , srv1796214846:84 , srv1805549850:84 , srv182078695:84 , srv1834219380:84 , srv1851224648:84 , srv1960859493:84 , srv1967934978:84 , srv19702294:84 , srv197420944:84 , srv1981620432:84 , srv1987892645:84 , srv2020138985:84 , srv2027549298:84 , srv2029546388:84 , srv2040166486:84 , srv2058332453:84 , srv2065275842:84 , srv2096656629:84 , srv276084034:84 , srv288555306:84 , srv313037439:84 , srv326117579:84 , srv329796491:84 , srv337030788:84 , srv350494620:84 , srv3577439:84 , srv375416707:84 , srv389276488:84 , srv39914378:84 , srv445935705:84 , srv458599497:84 , srv472188524:84 , srv482153963:84 , srv493465473:84 , srv511670662:84 , srv539419600:84 , srv555121422:84 , srv574507774:84 , srv61179831:84 , srv644548719:84 , srv706088523:84 , srv735910471:84 , srv751527942:84 , srv772398249:84 , srv773413863:84 , srv824829902:84 , srv829902449:84 , srv845457397:84 , srv845969829:84 , srv851844347:84 , srv864072241:84 , srv879401493:84 , srv951591792:84 , srv982358077:84 , srv993783649:84 , srv1802758262:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2024-02-16 05:53:16,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-16 05:53:16,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv337030788=68, srv1805549850=46, srv845969829=93, srv1549993214=29, srv164579498=34, srv1714368876=39, srv61179831=83, srv1733213941=42, srv1730441895=41, srv2020138985=56, srv2029546388=58, srv773413863=89, srv329796491=67, srv288555306=64, srv2065275842=61, srv1619505993=31, srv951591792=97, srv1374462445=17, srv1375850152=18, srv19702294=52, srv1540226022=28, srv735910471=86, srv845457397=92, srv1981620432=54, srv375416707=71, srv1635779580=32, srv851844347=94, srv1279023966=10, srv1987892645=55, srv350494620=69, srv824829902=90, srv482153963=77, srv864072241=95, srv555121422=81, srv1960859493=50, srv182078695=47, srv1967934978=51, srv3577439=70, srv2096656629=62, srv1229398319=9, srv1834219380=48, srv389276488=72, srv2027549298=57, srv171774217=40, srv276084034=63, srv1031844370=2, srv993783649=99, srv1851224648=49, srv1211621990=8, srv1711337388=38, srv1200304188=7, srv1117012802=6, srv1796214846=44, srv1802758262=45, srv539419600=80, srv1335124538=13, srv1553363933=30, srv458599497=75, srv1302227668=11, srv1026659263=1, srv751527942=87, srv1436621587=22, srv1750603584=43, srv1395279950=19, srv1475238989=24, srv1682583521=36, srv313037439=65, srv1486364062=25, srv1052575939=4, srv829902449=91, srv1520188045=27, srv1490809108=26, srv197420944=53, srv1700107102=37, srv1657181161=35, srv39914378=73, srv706088523=85, srv493465473=78, srv1636127428=33, srv1442590441=23, srv1022990500=0, srv1304836146=12, srv1360327266=16, srv472188524=76, srv326117579=66, srv982358077=98, srv511670662=79, srv1352677532=14, srv445935705=74, srv13545254=15, srv1435162864=21, srv574507774=82, srv879401493=96, srv108997710=5, srv2058332453=60, srv772398249=88, srv1413377849=20, srv644548719=84, srv2040166486=59, srv1050205370=3} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-16 05:53:16,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-16 05:53:16,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-16 05:53:16,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-16 05:53:16,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-16 05:53:16,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-16 05:53:16,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-16 05:53:16,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-16 05:53:16,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-16 05:53:16,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-16 05:53:16,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-16 05:53:16,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-16 05:53:16,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-16 05:53:16,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-16 05:53:16,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-16 05:53:16,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-16 05:53:16,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-16 05:53:16,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-16 05:53:16,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-16 05:53:16,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-16 05:53:16,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-16 05:53:16,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-16 05:53:16,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-16 05:53:16,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-16 05:53:16,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-16 05:53:16,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-16 05:53:16,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-16 05:53:16,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-16 05:53:16,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-16 05:53:16,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-16 05:53:16,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-16 05:53:16,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-02-16 05:53:16,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-02-16 05:53:16,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-02-16 05:53:16,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-02-16 05:53:16,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-02-16 05:53:16,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-02-16 05:53:16,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-02-16 05:53:16,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-02-16 05:53:16,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-02-16 05:53:16,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-02-16 05:53:16,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-02-16 05:53:16,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-02-16 05:53:16,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-02-16 05:53:16,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-02-16 05:53:16,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-02-16 05:53:16,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-02-16 05:53:16,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-02-16 05:53:16,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-02-16 05:53:16,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-02-16 05:53:16,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-02-16 05:53:16,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-02-16 05:53:16,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-02-16 05:53:16,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-02-16 05:53:16,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-02-16 05:53:16,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-02-16 05:53:16,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-02-16 05:53:16,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-02-16 05:53:16,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-02-16 05:53:16,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-02-16 05:53:16,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-02-16 05:53:16,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-02-16 05:53:16,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-02-16 05:53:16,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-02-16 05:53:16,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-02-16 05:53:16,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-02-16 05:53:16,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-02-16 05:53:16,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-02-16 05:53:16,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-02-16 05:53:16,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-02-16 05:53:16,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-02-16 05:53:16,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-02-16 05:53:16,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-02-16 05:53:16,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-02-16 05:53:16,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-02-16 05:53:16,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-02-16 05:53:16,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-02-16 05:53:16,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-02-16 05:53:16,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-02-16 05:53:16,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-02-16 05:53:16,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-02-16 05:53:16,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-02-16 05:53:16,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-02-16 05:53:16,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-02-16 05:53:16,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-02-16 05:53:16,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-02-16 05:53:16,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-02-16 05:53:16,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-02-16 05:53:16,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-02-16 05:53:16,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-02-16 05:53:16,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-02-16 05:53:16,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-02-16 05:53:16,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-02-16 05:53:16,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-02-16 05:53:16,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-02-16 05:53:16,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-02-16 05:53:16,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-02-16 05:53:16,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-02-16 05:53:16,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-02-16 05:53:16,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-02-16 05:53:16,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-02-16 05:53:16,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-02-16 05:53:16,906 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-16 05:53:16,907 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-02-16 05:53:16,907 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-02-16 05:53:17,404 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 705 ms to try 5000 different iterations.  Found a solution that moves 4677 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18168925747122044. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.037469195894463465, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.050627931321100765, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5196666666666667, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.037469195894463465, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17716666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24158333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-16 05:53:17,415 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1619505993:82 , srv3577439:82 , srv644548719:82 , srv1335124538:83 , srv1540226022:83 , srv1711337388:83 , srv1733213941:83 , srv1851224648:83 , srv1981620432:83 , srv845969829:83 , srv1117012802:84 , srv1302227668:84 , srv13545254:84 , srv1796214846:84 , srv2020138985:84 , srv276084034:84 , srv375416707:84 , srv493465473:84 , srv539419600:84 , srv574507774:84 , srv1279023966:85 , srv1682583521:85 , srv1714368876:85 , srv1730441895:85 , srv19702294:85 , srv197420944:85 , srv2096656629:85 , srv288555306:85 , srv326117579:85 , srv329796491:85 , srv337030788:85 , srv445935705:85 , srv751527942:85 , srv1052575939:86 , srv1211621990:86 , srv1374462445:86 , srv1475238989:86 , srv1553363933:86 , srv1636127428:86 , srv1834219380:86 , srv1967934978:86 , srv2058332453:86 , srv458599497:86 , srv61179831:86 , srv735910471:86 , srv773413863:86 , srv851844347:86 , srv993783649:86 , srv1022990500:87 , srv1026659263:87 , srv1031844370:87 , srv1304836146:87 , srv1413377849:87 , srv1486364062:87 , srv1635779580:87 , srv1805549850:87 , srv2029546388:87 , srv389276488:87 , srv39914378:87 , srv472188524:87 , srv511670662:87 , srv706088523:87 , srv864072241:87 , srv879401493:87 , srv1229398319:88 , srv1352677532:88 , srv1360327266:88 , srv1435162864:88 , srv1520188045:88 , srv164579498:88 , srv1657181161:88 , srv2027549298:88 , srv2065275842:88 , srv555121422:88 , srv772398249:88 , srv829902449:88 , srv951591792:88 , srv982358077:88 , srv108997710:89 , srv1395279950:89 , srv1442590441:89 , srv1549993214:89 , srv1700107102:89 , srv171774217:89 , srv1750603584:89 , srv1960859493:89 , srv350494620:89 , srv845457397:89 , srv1375850152:90 , srv182078695:90 , srv2040166486:90 , srv313037439:90 , srv824829902:90 , srv1200304188:91 , srv1436621587:91 , srv1490809108:92 , srv1987892645:92 , srv482153963:92 , srv1050205370:93 , srv1802758262:423 }
2024-02-16 05:53:17,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-16 05:53:17,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv337030788=68, srv1805549850=46, srv845969829=93, srv1549993214=29, srv164579498=34, srv1714368876=39, srv61179831=83, srv1733213941=42, srv1730441895=41, srv2020138985=56, srv2029546388=58, srv773413863=89, srv329796491=67, srv288555306=64, srv2065275842=61, srv1619505993=31, srv951591792=97, srv1374462445=17, srv1375850152=18, srv19702294=52, srv1540226022=28, srv735910471=86, srv845457397=92, srv1981620432=54, srv375416707=71, srv1635779580=32, srv851844347=94, srv1279023966=10, srv1987892645=55, srv350494620=69, srv824829902=90, srv482153963=77, srv864072241=95, srv555121422=81, srv1960859493=50, srv182078695=47, srv1967934978=51, srv3577439=70, srv2096656629=62, srv1229398319=9, srv1834219380=48, srv389276488=72, srv2027549298=57, srv171774217=40, srv276084034=63, srv1031844370=2, srv993783649=99, srv1851224648=49, srv1211621990=8, srv1711337388=38, srv1200304188=7, srv1117012802=6, srv1796214846=44, srv1802758262=45, srv539419600=80, srv1335124538=13, srv1553363933=30, srv458599497=75, srv1302227668=11, srv1026659263=1, srv751527942=87, srv1436621587=22, srv1750603584=43, srv1395279950=19, srv1475238989=24, srv1682583521=36, srv313037439=65, srv1486364062=25, srv1052575939=4, srv829902449=91, srv1520188045=27, srv1490809108=26, srv197420944=53, srv1700107102=37, srv1657181161=35, srv39914378=73, srv706088523=85, srv493465473=78, srv1636127428=33, srv1442590441=23, srv1022990500=0, srv1304836146=12, srv1360327266=16, srv472188524=76, srv326117579=66, srv982358077=98, srv511670662=79, srv1352677532=14, srv445935705=74, srv13545254=15, srv1435162864=21, srv574507774=82, srv879401493=96, srv108997710=5, srv2058332453=60, srv772398249=88, srv1413377849=20, srv644548719=84, srv2040166486=59, srv1050205370=3} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-16 05:53:17,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-16 05:53:17,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-16 05:53:17,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-16 05:53:17,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-16 05:53:17,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-16 05:53:17,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-16 05:53:17,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-16 05:53:17,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-16 05:53:17,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-16 05:53:17,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-16 05:53:17,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-16 05:53:17,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-16 05:53:17,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-16 05:53:17,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-16 05:53:17,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-16 05:53:17,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-16 05:53:17,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-16 05:53:17,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-16 05:53:17,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-16 05:53:17,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-16 05:53:17,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-16 05:53:17,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-16 05:53:17,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-16 05:53:17,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-16 05:53:17,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-16 05:53:17,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-16 05:53:17,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-16 05:53:17,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-16 05:53:17,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-16 05:53:17,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-16 05:53:17,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-02-16 05:53:17,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-02-16 05:53:17,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-02-16 05:53:17,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-02-16 05:53:17,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-02-16 05:53:17,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-02-16 05:53:17,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-02-16 05:53:17,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-02-16 05:53:17,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-02-16 05:53:17,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-02-16 05:53:17,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-02-16 05:53:17,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-02-16 05:53:17,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-02-16 05:53:17,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-02-16 05:53:17,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-02-16 05:53:17,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-02-16 05:53:17,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-02-16 05:53:17,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-02-16 05:53:17,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-02-16 05:53:17,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-02-16 05:53:17,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-02-16 05:53:17,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-02-16 05:53:17,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-02-16 05:53:17,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-02-16 05:53:17,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-02-16 05:53:17,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-02-16 05:53:17,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-02-16 05:53:17,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-02-16 05:53:17,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-02-16 05:53:17,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-02-16 05:53:17,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-02-16 05:53:17,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-02-16 05:53:17,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-02-16 05:53:17,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-02-16 05:53:17,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-02-16 05:53:17,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-02-16 05:53:17,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-02-16 05:53:17,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-02-16 05:53:17,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-02-16 05:53:17,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-02-16 05:53:17,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-02-16 05:53:17,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-02-16 05:53:17,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-02-16 05:53:17,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-02-16 05:53:17,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-02-16 05:53:17,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-02-16 05:53:17,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-02-16 05:53:17,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-02-16 05:53:17,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-02-16 05:53:17,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-02-16 05:53:17,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-02-16 05:53:17,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-02-16 05:53:17,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-02-16 05:53:17,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-02-16 05:53:17,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-02-16 05:53:17,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-02-16 05:53:17,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-02-16 05:53:17,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-02-16 05:53:17,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-02-16 05:53:17,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-02-16 05:53:17,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-02-16 05:53:17,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-02-16 05:53:17,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-02-16 05:53:17,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-02-16 05:53:17,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-02-16 05:53:17,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-02-16 05:53:17,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-02-16 05:53:17,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-02-16 05:53:17,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-02-16 05:53:17,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-02-16 05:53:17,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-02-16 05:53:17,588 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.037469195894463465, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.050627931321100765, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.037469195894463465, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17716666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24158333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-16 05:53:17,588 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-02-16 05:53:17,589 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.1816565084172609, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.037469195894463465, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.050627931321100765, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.037469195894463465, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17716666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24158333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-02-16 05:53:17,855 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 372 ms to try 5000 different iterations.  Found a solution that moves 2614 regions; Going from a computed imbalance of 0.1816565084172609 to a new imbalance of 0.015193337409495515. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021393643706047932); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.034969924548040175, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29044444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021393643706047932); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012416666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0415, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-16 05:53:17,869 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1050205370:78 , srv1490809108:80 , srv1987892645:80 , srv313037439:80 , srv482153963:80 , srv1200304188:81 , srv1375850152:81 , srv108997710:82 , srv1436621587:82 , srv1442590441:82 , srv1750603584:82 , srv2040166486:82 , srv824829902:82 , srv1022990500:83 , srv1229398319:83 , srv1395279950:83 , srv1435162864:83 , srv1486364062:83 , srv164579498:83 , srv171774217:83 , srv1805549850:83 , srv182078695:83 , srv2065275842:83 , srv472188524:83 , srv772398249:83 , srv879401493:83 , srv982358077:83 , srv1211621990:84 , srv1279023966:84 , srv1304836146:84 , srv1352677532:84 , srv1360327266:84 , srv1374462445:84 , srv1549993214:84 , srv1635779580:84 , srv1657181161:84 , srv1700107102:84 , srv1834219380:84 , srv2029546388:84 , srv350494620:84 , srv61179831:84 , srv951591792:84 , srv1520188045:85 , srv1553363933:85 , srv1636127428:85 , srv458599497:85 , srv511670662:85 , srv555121422:85 , srv829902449:85 , srv845457397:85 , srv1026659263:86 , srv1413377849:86 , srv1682583521:86 , srv1714368876:86 , srv1960859493:86 , srv2027549298:86 , srv2096656629:86 , srv276084034:86 , srv329796491:86 , srv337030788:86 , srv39914378:86 , srv539419600:86 , srv735910471:86 , srv851844347:86 , srv864072241:86 , srv993783649:86 , srv1052575939:87 , srv2020138985:87 , srv2058332453:87 , srv326117579:87 , srv389276488:87 , srv706088523:87 , srv1031844370:88 , srv1302227668:88 , srv1335124538:88 , srv1730441895:88 , srv1967934978:88 , srv19702294:88 , srv1981620432:88 , srv751527942:88 , srv845969829:88 , srv1117012802:89 , srv13545254:89 , srv1475238989:89 , srv1619505993:89 , srv1711337388:89 , srv1733213941:89 , srv1851224648:89 , srv197420944:89 , srv288555306:89 , srv375416707:89 , srv445935705:89 , srv773413863:89 , srv1796214846:90 , srv3577439:90 , srv574507774:90 , srv644548719:90 , srv493465473:91 , srv1540226022:96 , srv1802758262:541 }
2024-02-16 05:53:17,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-16 05:53:17,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv337030788=68, srv1805549850=46, srv845969829=93, srv1549993214=29, srv164579498=34, srv1714368876=39, srv61179831=83, srv1733213941=42, srv1730441895=41, srv2020138985=56, srv2029546388=58, srv773413863=89, srv329796491=67, srv288555306=64, srv2065275842=61, srv1619505993=31, srv951591792=97, srv1374462445=17, srv1375850152=18, srv19702294=52, srv1540226022=28, srv735910471=86, srv845457397=92, srv1981620432=54, srv375416707=71, srv1635779580=32, srv851844347=94, srv1279023966=10, srv1987892645=55, srv350494620=69, srv824829902=90, srv482153963=77, srv864072241=95, srv555121422=81, srv1960859493=50, srv182078695=47, srv1967934978=51, srv3577439=70, srv2096656629=62, srv1229398319=9, srv1834219380=48, srv389276488=72, srv2027549298=57, srv171774217=40, srv276084034=63, srv1031844370=2, srv993783649=99, srv1851224648=49, srv1211621990=8, srv1711337388=38, srv1200304188=7, srv1117012802=6, srv1796214846=44, srv1802758262=45, srv539419600=80, srv1335124538=13, srv1553363933=30, srv458599497=75, srv1302227668=11, srv1026659263=1, srv751527942=87, srv1436621587=22, srv1750603584=43, srv1395279950=19, srv1475238989=24, srv1682583521=36, srv313037439=65, srv1486364062=25, srv1052575939=4, srv829902449=91, srv1520188045=27, srv1490809108=26, srv197420944=53, srv1700107102=37, srv1657181161=35, srv39914378=73, srv706088523=85, srv493465473=78, srv1636127428=33, srv1442590441=23, srv1022990500=0, srv1304836146=12, srv1360327266=16, srv472188524=76, srv326117579=66, srv982358077=98, srv511670662=79, srv1352677532=14, srv445935705=74, srv13545254=15, srv1435162864=21, srv574507774=82, srv879401493=96, srv108997710=5, srv2058332453=60, srv772398249=88, srv1413377849=20, srv644548719=84, srv2040166486=59, srv1050205370=3} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-16 05:53:17,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-16 05:53:17,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-16 05:53:17,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-16 05:53:17,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-16 05:53:17,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-16 05:53:17,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-16 05:53:17,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-16 05:53:17,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-16 05:53:17,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-16 05:53:17,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-16 05:53:17,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-16 05:53:17,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-16 05:53:17,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-16 05:53:17,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-16 05:53:17,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-16 05:53:17,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-16 05:53:17,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-16 05:53:17,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-16 05:53:17,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-16 05:53:17,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-16 05:53:17,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-16 05:53:17,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-16 05:53:17,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-16 05:53:17,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-16 05:53:17,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-16 05:53:17,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-16 05:53:17,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-16 05:53:17,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-16 05:53:17,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-16 05:53:17,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-16 05:53:17,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-02-16 05:53:17,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-02-16 05:53:17,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-02-16 05:53:17,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-02-16 05:53:17,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-02-16 05:53:17,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-02-16 05:53:17,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-02-16 05:53:17,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-02-16 05:53:17,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-02-16 05:53:17,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-02-16 05:53:17,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-02-16 05:53:17,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-02-16 05:53:17,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-02-16 05:53:17,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-02-16 05:53:17,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-02-16 05:53:17,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-02-16 05:53:17,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-02-16 05:53:17,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-02-16 05:53:17,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-02-16 05:53:17,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-02-16 05:53:17,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-02-16 05:53:17,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-02-16 05:53:17,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-02-16 05:53:17,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-02-16 05:53:17,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-02-16 05:53:17,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-02-16 05:53:17,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-02-16 05:53:17,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-02-16 05:53:17,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-02-16 05:53:17,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-02-16 05:53:17,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-02-16 05:53:17,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-02-16 05:53:17,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-02-16 05:53:17,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-02-16 05:53:17,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-02-16 05:53:17,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-02-16 05:53:17,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-02-16 05:53:17,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-02-16 05:53:17,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-02-16 05:53:17,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-02-16 05:53:17,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-02-16 05:53:17,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-02-16 05:53:17,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-02-16 05:53:17,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-02-16 05:53:17,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-02-16 05:53:17,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-02-16 05:53:17,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-02-16 05:53:17,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-02-16 05:53:17,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-02-16 05:53:17,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-02-16 05:53:17,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-02-16 05:53:17,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-02-16 05:53:17,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-02-16 05:53:17,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-02-16 05:53:17,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-02-16 05:53:17,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-02-16 05:53:17,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-02-16 05:53:17,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-02-16 05:53:17,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-02-16 05:53:17,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-02-16 05:53:17,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-02-16 05:53:17,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-02-16 05:53:17,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-02-16 05:53:17,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-02-16 05:53:17,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-02-16 05:53:17,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-02-16 05:53:17,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-02-16 05:53:17,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-02-16 05:53:17,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-02-16 05:53:17,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-02-16 05:53:17,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-02-16 05:53:18,051 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021393643706047932); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.034969924548040175, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021393643706047932); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012416666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0415, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-16 05:53:18,052 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-02-16 05:53:18,052 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.015175033790284419, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021393643706047932); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.034969924548040175, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021393643706047932); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012416666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0415, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-02-16 05:53:18,527 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 592 ms to try 5000 different iterations.  Found a solution that moves 938 regions; Going from a computed imbalance of 0.015175033790284419 to a new imbalance of 7.484640241994848E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0067834882385377025); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009223499972332542); MoveCostFunction : (multiplier=7.0, imbalance=0.10422222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0067834882385377025); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004083333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-16 05:53:18,530 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1540226022:79 , srv1031844370:82 , srv1475238989:82 , srv773413863:82 , srv1700107102:83 , srv1730441895:83 , srv1796214846:83 , srv197420944:83 , srv2027549298:83 , srv288555306:83 , srv706088523:83 , srv845457397:83 , srv1026659263:84 , srv1117012802:84 , srv13545254:84 , srv1413377849:84 , srv1520188045:84 , srv1549993214:84 , srv182078695:84 , srv1960859493:84 , srv1967934978:84 , srv19702294:84 , srv350494620:84 , srv375416707:84 , srv389276488:84 , srv39914378:84 , srv574507774:84 , srv751527942:84 , srv829902449:84 , srv1050205370:85 , srv1052575939:85 , srv1200304188:85 , srv1229398319:85 , srv1302227668:85 , srv1360327266:85 , srv1436621587:85 , srv1657181161:85 , srv1711337388:85 , srv1851224648:85 , srv1987892645:85 , srv2020138985:85 , srv2058332453:85 , srv326117579:85 , srv329796491:85 , srv3577439:85 , srv445935705:85 , srv482153963:85 , srv511670662:85 , srv555121422:85 , srv644548719:85 , srv824829902:85 , srv864072241:85 , srv951591792:85 , srv993783649:85 , srv108997710:86 , srv1335124538:86 , srv1375850152:86 , srv1395279950:86 , srv1490809108:86 , srv1635779580:86 , srv1682583521:86 , srv1714368876:86 , srv171774217:86 , srv1733213941:86 , srv1981620432:86 , srv2040166486:86 , srv2065275842:86 , srv337030788:86 , srv458599497:86 , srv493465473:86 , srv735910471:86 , srv845969829:86 , srv851844347:86 , srv982358077:86 , srv1022990500:87 , srv1304836146:87 , srv1352677532:87 , srv1435162864:87 , srv1442590441:87 , srv1486364062:87 , srv1553363933:87 , srv1619505993:87 , srv1636127428:87 , srv164579498:87 , srv1750603584:87 , srv2029546388:87 , srv2096656629:87 , srv313037439:87 , srv472188524:87 , srv772398249:87 , srv879401493:87 , srv1211621990:88 , srv1374462445:88 , srv1805549850:88 , srv1834219380:88 , srv276084034:88 , srv539419600:88 , srv61179831:88 , srv1279023966:89 , srv1802758262:554 }
2024-02-16 05:53:18,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-16 05:53:18,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv337030788=68, srv1805549850=46, srv845969829=93, srv1549993214=29, srv164579498=34, srv1714368876=39, srv61179831=83, srv1733213941=42, srv1730441895=41, srv2020138985=56, srv2029546388=58, srv773413863=89, srv329796491=67, srv288555306=64, srv2065275842=61, srv1619505993=31, srv951591792=97, srv1374462445=17, srv1375850152=18, srv19702294=52, srv1540226022=28, srv735910471=86, srv845457397=92, srv1981620432=54, srv375416707=71, srv1635779580=32, srv851844347=94, srv1279023966=10, srv1987892645=55, srv350494620=69, srv824829902=90, srv482153963=77, srv864072241=95, srv555121422=81, srv1960859493=50, srv182078695=47, srv1967934978=51, srv3577439=70, srv2096656629=62, srv1229398319=9, srv1834219380=48, srv389276488=72, srv2027549298=57, srv171774217=40, srv276084034=63, srv1031844370=2, srv993783649=99, srv1851224648=49, srv1211621990=8, srv1711337388=38, srv1200304188=7, srv1117012802=6, srv1796214846=44, srv1802758262=45, srv539419600=80, srv1335124538=13, srv1553363933=30, srv458599497=75, srv1302227668=11, srv1026659263=1, srv751527942=87, srv1436621587=22, srv1750603584=43, srv1395279950=19, srv1475238989=24, srv1682583521=36, srv313037439=65, srv1486364062=25, srv1052575939=4, srv829902449=91, srv1520188045=27, srv1490809108=26, srv197420944=53, srv1700107102=37, srv1657181161=35, srv39914378=73, srv706088523=85, srv493465473=78, srv1636127428=33, srv1442590441=23, srv1022990500=0, srv1304836146=12, srv1360327266=16, srv472188524=76, srv326117579=66, srv982358077=98, srv511670662=79, srv1352677532=14, srv445935705=74, srv13545254=15, srv1435162864=21, srv574507774=82, srv879401493=96, srv108997710=5, srv2058332453=60, srv772398249=88, srv1413377849=20, srv644548719=84, srv2040166486=59, srv1050205370=3} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-16 05:53:18,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-16 05:53:18,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-16 05:53:18,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-16 05:53:18,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-16 05:53:18,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-16 05:53:18,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-16 05:53:18,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-16 05:53:18,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-16 05:53:18,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-16 05:53:18,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-16 05:53:18,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-16 05:53:18,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-16 05:53:18,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-16 05:53:18,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-16 05:53:18,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-16 05:53:18,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-16 05:53:18,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-16 05:53:18,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-16 05:53:18,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-16 05:53:18,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-16 05:53:18,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-16 05:53:18,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-16 05:53:18,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-16 05:53:18,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-16 05:53:18,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-16 05:53:18,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-16 05:53:18,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-16 05:53:18,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-16 05:53:18,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-16 05:53:18,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-16 05:53:18,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-02-16 05:53:18,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-02-16 05:53:18,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-02-16 05:53:18,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-02-16 05:53:18,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-02-16 05:53:18,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-02-16 05:53:18,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-02-16 05:53:18,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-02-16 05:53:18,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-02-16 05:53:18,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-02-16 05:53:18,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-02-16 05:53:18,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-02-16 05:53:18,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-02-16 05:53:18,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-02-16 05:53:18,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-02-16 05:53:18,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-02-16 05:53:18,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-02-16 05:53:18,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-02-16 05:53:18,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-02-16 05:53:18,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-02-16 05:53:18,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-02-16 05:53:18,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-02-16 05:53:18,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-02-16 05:53:18,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-02-16 05:53:18,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-02-16 05:53:18,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-02-16 05:53:18,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-02-16 05:53:18,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-02-16 05:53:18,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-02-16 05:53:18,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-02-16 05:53:18,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-02-16 05:53:18,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-02-16 05:53:18,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-02-16 05:53:18,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-02-16 05:53:18,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-02-16 05:53:18,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-02-16 05:53:18,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-02-16 05:53:18,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-02-16 05:53:18,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-02-16 05:53:18,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-02-16 05:53:18,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-02-16 05:53:18,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-02-16 05:53:18,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-02-16 05:53:18,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-02-16 05:53:18,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-02-16 05:53:18,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-02-16 05:53:18,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-02-16 05:53:18,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-02-16 05:53:18,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-02-16 05:53:18,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-02-16 05:53:18,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-02-16 05:53:18,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-02-16 05:53:18,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-02-16 05:53:18,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-02-16 05:53:18,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-02-16 05:53:18,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-02-16 05:53:18,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-02-16 05:53:18,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-02-16 05:53:18,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-02-16 05:53:18,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-02-16 05:53:18,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-02-16 05:53:18,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-02-16 05:53:18,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-02-16 05:53:18,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-02-16 05:53:18,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-02-16 05:53:18,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-02-16 05:53:18,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-02-16 05:53:18,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-02-16 05:53:18,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-02-16 05:53:18,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-02-16 05:53:18,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-02-16 05:53:18,747 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0067834882385377025); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009223499972332542); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0067834882385377025); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004083333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-16 05:53:18,747 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-02-16 05:53:18,748 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=7.418960078184557E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0067834882385377025); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009223499972332542); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0067834882385377025); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004083333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-02-16 05:53:19,053 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 452 ms to try 5000 different iterations.  Found a solution that moves 244 regions; Going from a computed imbalance of 7.418960078184557E-4 to a new imbalance of 4.211158783041432E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.02711111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-16 05:53:19,054 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv493465473:81 , srv1352677532:83 , srv1636127428:83 , srv1960859493:83 , srv445935705:83 , srv1052575939:84 , srv1211621990:84 , srv1279023966:84 , srv1335124538:84 , srv1374462445:84 , srv1395279950:84 , srv1435162864:84 , srv1436621587:84 , srv1442590441:84 , srv1553363933:84 , srv1619505993:84 , srv164579498:84 , srv1711337388:84 , srv171774217:84 , srv1733213941:84 , srv1750603584:84 , srv1805549850:84 , srv1834219380:84 , srv1967934978:84 , srv197420944:84 , srv2029546388:84 , srv2040166486:84 , srv2058332453:84 , srv2065275842:84 , srv2096656629:84 , srv276084034:84 , srv389276488:84 , srv539419600:84 , srv555121422:84 , srv574507774:84 , srv61179831:84 , srv735910471:84 , srv851844347:84 , srv864072241:84 , srv1022990500:85 , srv1026659263:85 , srv1031844370:85 , srv108997710:85 , srv1117012802:85 , srv1200304188:85 , srv1229398319:85 , srv1302227668:85 , srv1304836146:85 , srv13545254:85 , srv1360327266:85 , srv1375850152:85 , srv1413377849:85 , srv1475238989:85 , srv1486364062:85 , srv1490809108:85 , srv1520188045:85 , srv1540226022:85 , srv1549993214:85 , srv1635779580:85 , srv1657181161:85 , srv1682583521:85 , srv1714368876:85 , srv1796214846:85 , srv182078695:85 , srv1851224648:85 , srv19702294:85 , srv1981620432:85 , srv1987892645:85 , srv2027549298:85 , srv288555306:85 , srv313037439:85 , srv350494620:85 , srv3577439:85 , srv375416707:85 , srv39914378:85 , srv458599497:85 , srv472188524:85 , srv482153963:85 , srv511670662:85 , srv644548719:85 , srv706088523:85 , srv751527942:85 , srv772398249:85 , srv773413863:85 , srv824829902:85 , srv829902449:85 , srv845457397:85 , srv845969829:85 , srv879401493:85 , srv951591792:85 , srv982358077:85 , srv993783649:85 , srv1050205370:86 , srv1700107102:86 , srv1730441895:86 , srv2020138985:86 , srv326117579:86 , srv329796491:86 , srv337030788:86 , srv1802758262:624 }
2024-02-16 05:53:19,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-16 05:53:19,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv337030788=68, srv1805549850=46, srv845969829=93, srv1549993214=29, srv164579498=34, srv1714368876=39, srv61179831=83, srv1733213941=42, srv1730441895=41, srv2020138985=56, srv2029546388=58, srv773413863=89, srv329796491=67, srv288555306=64, srv2065275842=61, srv1619505993=31, srv951591792=97, srv1374462445=17, srv1375850152=18, srv19702294=52, srv1540226022=28, srv735910471=86, srv845457397=92, srv1981620432=54, srv375416707=71, srv1635779580=32, srv851844347=94, srv1279023966=10, srv1987892645=55, srv350494620=69, srv824829902=90, srv482153963=77, srv864072241=95, srv555121422=81, srv1960859493=50, srv182078695=47, srv1967934978=51, srv3577439=70, srv2096656629=62, srv1229398319=9, srv1834219380=48, srv389276488=72, srv2027549298=57, srv171774217=40, srv276084034=63, srv1031844370=2, srv993783649=99, srv1851224648=49, srv1211621990=8, srv1711337388=38, srv1200304188=7, srv1117012802=6, srv1796214846=44, srv1802758262=45, srv539419600=80, srv1335124538=13, srv1553363933=30, srv458599497=75, srv1302227668=11, srv1026659263=1, srv751527942=87, srv1436621587=22, srv1750603584=43, srv1395279950=19, srv1475238989=24, srv1682583521=36, srv313037439=65, srv1486364062=25, srv1052575939=4, srv829902449=91, srv1520188045=27, srv1490809108=26, srv197420944=53, srv1700107102=37, srv1657181161=35, srv39914378=73, srv706088523=85, srv493465473=78, srv1636127428=33, srv1442590441=23, srv1022990500=0, srv1304836146=12, srv1360327266=16, srv472188524=76, srv326117579=66, srv982358077=98, srv511670662=79, srv1352677532=14, srv445935705=74, srv13545254=15, srv1435162864=21, srv574507774=82, srv879401493=96, srv108997710=5, srv2058332453=60, srv772398249=88, srv1413377849=20, srv644548719=84, srv2040166486=59, srv1050205370=3} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-16 05:53:19,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-16 05:53:19,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-16 05:53:19,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-16 05:53:19,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-16 05:53:19,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-16 05:53:19,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-16 05:53:19,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-16 05:53:19,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-16 05:53:19,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-16 05:53:19,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-16 05:53:19,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-16 05:53:19,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-16 05:53:19,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-16 05:53:19,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-16 05:53:19,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-16 05:53:19,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-16 05:53:19,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-16 05:53:19,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-16 05:53:19,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-16 05:53:19,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-16 05:53:19,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-16 05:53:19,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-16 05:53:19,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-16 05:53:19,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-16 05:53:19,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-16 05:53:19,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-16 05:53:19,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-16 05:53:19,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-16 05:53:19,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-16 05:53:19,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-16 05:53:19,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-02-16 05:53:19,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-02-16 05:53:19,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-02-16 05:53:19,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-02-16 05:53:19,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-02-16 05:53:19,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-02-16 05:53:19,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-02-16 05:53:19,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-02-16 05:53:19,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-02-16 05:53:19,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-02-16 05:53:19,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-02-16 05:53:19,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-02-16 05:53:19,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-02-16 05:53:19,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-02-16 05:53:19,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-02-16 05:53:19,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-02-16 05:53:19,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-02-16 05:53:19,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-02-16 05:53:19,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-02-16 05:53:19,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-02-16 05:53:19,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-02-16 05:53:19,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-02-16 05:53:19,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-02-16 05:53:19,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-02-16 05:53:19,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-02-16 05:53:19,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-02-16 05:53:19,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-02-16 05:53:19,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-02-16 05:53:19,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-02-16 05:53:19,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-02-16 05:53:19,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-02-16 05:53:19,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-02-16 05:53:19,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-02-16 05:53:19,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-02-16 05:53:19,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-02-16 05:53:19,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-02-16 05:53:19,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-02-16 05:53:19,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-02-16 05:53:19,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-02-16 05:53:19,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-02-16 05:53:19,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-02-16 05:53:19,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-02-16 05:53:19,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-02-16 05:53:19,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-02-16 05:53:19,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-02-16 05:53:19,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-02-16 05:53:19,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-02-16 05:53:19,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-02-16 05:53:19,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-02-16 05:53:19,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-02-16 05:53:19,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-02-16 05:53:19,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-02-16 05:53:19,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-02-16 05:53:19,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-02-16 05:53:19,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-02-16 05:53:19,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-02-16 05:53:19,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-02-16 05:53:19,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-02-16 05:53:19,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-02-16 05:53:19,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-02-16 05:53:19,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-02-16 05:53:19,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-02-16 05:53:19,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-02-16 05:53:19,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-02-16 05:53:19,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-02-16 05:53:19,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-02-16 05:53:19,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-02-16 05:53:19,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-02-16 05:53:19,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-02-16 05:53:19,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-02-16 05:53:19,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-02-16 05:53:19,180 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-16 05:53:19,181 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-02-16 05:53:19,181 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=4.040306331338759E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-02-16 05:53:19,422 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 336 ms to try 5000 different iterations.  Found a solution that moves 20 regions; Going from a computed imbalance of 4.040306331338759E-5 to a new imbalance of 8.1197331102395E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.0022222222222222222); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-16 05:53:19,423 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1304836146:83 , srv1490809108:83 , srv1540226022:83 , srv326117579:83 , srv337030788:83 , srv772398249:83 , srv1022990500:84 , srv1026659263:84 , srv1031844370:84 , srv1050205370:84 , srv1052575939:84 , srv108997710:84 , srv1117012802:84 , srv1200304188:84 , srv1211621990:84 , srv1279023966:84 , srv1302227668:84 , srv1352677532:84 , srv13545254:84 , srv1360327266:84 , srv1374462445:84 , srv1375850152:84 , srv1395279950:84 , srv1413377849:84 , srv1435162864:84 , srv1436621587:84 , srv1442590441:84 , srv1475238989:84 , srv1486364062:84 , srv1520188045:84 , srv1549993214:84 , srv1553363933:84 , srv1619505993:84 , srv1635779580:84 , srv164579498:84 , srv1657181161:84 , srv1682583521:84 , srv1700107102:84 , srv1714368876:84 , srv171774217:84 , srv1730441895:84 , srv1733213941:84 , srv1750603584:84 , srv1796214846:84 , srv1805549850:84 , srv182078695:84 , srv1834219380:84 , srv1851224648:84 , srv1960859493:84 , srv1967934978:84 , srv19702294:84 , srv1981620432:84 , srv1987892645:84 , srv2020138985:84 , srv2027549298:84 , srv2029546388:84 , srv2040166486:84 , srv2058332453:84 , srv2096656629:84 , srv276084034:84 , srv288555306:84 , srv313037439:84 , srv329796491:84 , srv350494620:84 , srv3577439:84 , srv375416707:84 , srv389276488:84 , srv39914378:84 , srv445935705:84 , srv458599497:84 , srv472188524:84 , srv482153963:84 , srv493465473:84 , srv511670662:84 , srv539419600:84 , srv555121422:84 , srv574507774:84 , srv61179831:84 , srv644548719:84 , srv706088523:84 , srv735910471:84 , srv751527942:84 , srv773413863:84 , srv824829902:84 , srv829902449:84 , srv845457397:84 , srv845969829:84 , srv851844347:84 , srv864072241:84 , srv879401493:84 , srv951591792:84 , srv982358077:84 , srv993783649:84 , srv1229398319:85 , srv1335124538:85 , srv1636127428:85 , srv1711337388:85 , srv197420944:85 , srv2065275842:85 , srv1802758262:684 }
2024-02-16 05:53:19,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-16 05:53:19,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv337030788=68, srv1805549850=46, srv845969829=93, srv1549993214=29, srv164579498=34, srv1714368876=39, srv61179831=83, srv1733213941=42, srv1730441895=41, srv2020138985=56, srv2029546388=58, srv773413863=89, srv329796491=67, srv288555306=64, srv2065275842=61, srv1619505993=31, srv951591792=97, srv1374462445=17, srv1375850152=18, srv19702294=52, srv1540226022=28, srv735910471=86, srv845457397=92, srv1981620432=54, srv375416707=71, srv1635779580=32, srv851844347=94, srv1279023966=10, srv1987892645=55, srv350494620=69, srv824829902=90, srv482153963=77, srv864072241=95, srv555121422=81, srv1960859493=50, srv182078695=47, srv1967934978=51, srv3577439=70, srv2096656629=62, srv1229398319=9, srv1834219380=48, srv389276488=72, srv2027549298=57, srv171774217=40, srv276084034=63, srv1031844370=2, srv993783649=99, srv1851224648=49, srv1211621990=8, srv1711337388=38, srv1200304188=7, srv1117012802=6, srv1796214846=44, srv1802758262=45, srv539419600=80, srv1335124538=13, srv1553363933=30, srv458599497=75, srv1302227668=11, srv1026659263=1, srv751527942=87, srv1436621587=22, srv1750603584=43, srv1395279950=19, srv1475238989=24, srv1682583521=36, srv313037439=65, srv1486364062=25, srv1052575939=4, srv829902449=91, srv1520188045=27, srv1490809108=26, srv197420944=53, srv1700107102=37, srv1657181161=35, srv39914378=73, srv706088523=85, srv493465473=78, srv1636127428=33, srv1442590441=23, srv1022990500=0, srv1304836146=12, srv1360327266=16, srv472188524=76, srv326117579=66, srv982358077=98, srv511670662=79, srv1352677532=14, srv445935705=74, srv13545254=15, srv1435162864=21, srv574507774=82, srv879401493=96, srv108997710=5, srv2058332453=60, srv772398249=88, srv1413377849=20, srv644548719=84, srv2040166486=59, srv1050205370=3} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-16 05:53:19,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-16 05:53:19,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-16 05:53:19,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-16 05:53:19,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-16 05:53:19,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-16 05:53:19,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-16 05:53:19,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-16 05:53:19,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-16 05:53:19,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-16 05:53:19,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-16 05:53:19,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-16 05:53:19,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-16 05:53:19,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-16 05:53:19,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-16 05:53:19,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-16 05:53:19,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-16 05:53:19,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-16 05:53:19,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-16 05:53:19,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-16 05:53:19,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-16 05:53:19,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-16 05:53:19,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-16 05:53:19,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-16 05:53:19,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-16 05:53:19,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-16 05:53:19,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-16 05:53:19,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-16 05:53:19,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-16 05:53:19,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-16 05:53:19,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-16 05:53:19,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-02-16 05:53:19,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-02-16 05:53:19,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-02-16 05:53:19,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-02-16 05:53:19,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-02-16 05:53:19,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-02-16 05:53:19,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-02-16 05:53:19,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-02-16 05:53:19,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-02-16 05:53:19,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-02-16 05:53:19,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-02-16 05:53:19,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-02-16 05:53:19,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-02-16 05:53:19,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-02-16 05:53:19,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-02-16 05:53:19,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-02-16 05:53:19,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-02-16 05:53:19,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-02-16 05:53:19,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-02-16 05:53:19,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-02-16 05:53:19,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-02-16 05:53:19,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-02-16 05:53:19,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-02-16 05:53:19,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-02-16 05:53:19,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-02-16 05:53:19,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-02-16 05:53:19,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-02-16 05:53:19,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-02-16 05:53:19,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-02-16 05:53:19,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-02-16 05:53:19,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-02-16 05:53:19,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-02-16 05:53:19,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-02-16 05:53:19,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-02-16 05:53:19,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-02-16 05:53:19,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-02-16 05:53:19,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-02-16 05:53:19,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-02-16 05:53:19,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-02-16 05:53:19,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-02-16 05:53:19,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-02-16 05:53:19,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-02-16 05:53:19,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-02-16 05:53:19,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-02-16 05:53:19,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-02-16 05:53:19,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-02-16 05:53:19,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-02-16 05:53:19,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-02-16 05:53:19,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-02-16 05:53:19,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-02-16 05:53:19,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-02-16 05:53:19,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-02-16 05:53:19,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-02-16 05:53:19,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-02-16 05:53:19,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-02-16 05:53:19,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-02-16 05:53:19,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-02-16 05:53:19,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-02-16 05:53:19,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-02-16 05:53:19,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-02-16 05:53:19,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-02-16 05:53:19,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-02-16 05:53:19,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-02-16 05:53:19,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-02-16 05:53:19,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-02-16 05:53:19,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-02-16 05:53:19,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-02-16 05:53:19,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-02-16 05:53:19,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-02-16 05:53:19,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-02-16 05:53:19,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-02-16 05:53:19,558 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.979690117040589E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-16 05:53:19,559 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1304836146:83 , srv1490809108:83 , srv1540226022:83 , srv326117579:83 , srv337030788:83 , srv772398249:83 , srv1022990500:84 , srv1026659263:84 , srv1031844370:84 , srv1050205370:84 , srv1052575939:84 , srv108997710:84 , srv1117012802:84 , srv1200304188:84 , srv1211621990:84 , srv1279023966:84 , srv1302227668:84 , srv1352677532:84 , srv13545254:84 , srv1360327266:84 , srv1374462445:84 , srv1375850152:84 , srv1395279950:84 , srv1413377849:84 , srv1435162864:84 , srv1436621587:84 , srv1442590441:84 , srv1475238989:84 , srv1486364062:84 , srv1520188045:84 , srv1549993214:84 , srv1553363933:84 , srv1619505993:84 , srv1635779580:84 , srv164579498:84 , srv1657181161:84 , srv1682583521:84 , srv1700107102:84 , srv1714368876:84 , srv171774217:84 , srv1730441895:84 , srv1733213941:84 , srv1750603584:84 , srv1796214846:84 , srv1805549850:84 , srv182078695:84 , srv1834219380:84 , srv1851224648:84 , srv1960859493:84 , srv1967934978:84 , srv19702294:84 , srv1981620432:84 , srv1987892645:84 , srv2020138985:84 , srv2027549298:84 , srv2029546388:84 , srv2040166486:84 , srv2058332453:84 , srv2096656629:84 , srv276084034:84 , srv288555306:84 , srv313037439:84 , srv329796491:84 , srv350494620:84 , srv3577439:84 , srv375416707:84 , srv389276488:84 , srv39914378:84 , srv445935705:84 , srv458599497:84 , srv472188524:84 , srv482153963:84 , srv493465473:84 , srv511670662:84 , srv539419600:84 , srv555121422:84 , srv574507774:84 , srv61179831:84 , srv644548719:84 , srv706088523:84 , srv735910471:84 , srv751527942:84 , srv773413863:84 , srv824829902:84 , srv829902449:84 , srv845457397:84 , srv845969829:84 , srv851844347:84 , srv864072241:84 , srv879401493:84 , srv951591792:84 , srv982358077:84 , srv993783649:84 , srv1229398319:85 , srv1335124538:85 , srv1636127428:85 , srv1711337388:85 , srv197420944:85 , srv2065275842:85 , srv1802758262:684 }
2024-02-16 05:53:19,588 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=316 (was 316), ProcessCount=168 (was 168), AvailableMemoryMB=1188 (was 1981)
2024-02-16 05:53:19,596 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=316, ProcessCount=168, AvailableMemoryMB=1188
2024-02-16 05:53:19,597 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-02-16 05:53:19,597 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2024-02-16 05:53:19,607 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1046146052:84 , srv1222919945:84 , srv1366757529:84 , srv1402605421:84 , srv145509245:84 , srv1747258255:84 , srv1775818036:84 , srv1851802354:84 , srv1935848249:84 , srv1942269063:84 , srv1994771841:84 , srv2002371471:84 , srv2048862133:84 , srv209727068:84 , srv224983057:84 , srv377390512:84 , srv431962300:84 , srv442868230:84 , srv472953174:84 , srv515195845:84 , srv53462802:84 , srv56026468:84 , srv600983305:84 , srv697589460:84 , srv78348492:84 , srv851332331:84 , srv879020777:84 , srv955001192:84 , srv999966623:84 , srv791633644:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2024-02-16 05:53:19,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-16 05:53:19,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1222919945=1, srv1775818036=6, srv1935848249=8, srv515195845=19, srv472953174=18, srv442868230=17, srv1747258255=5, srv955001192=28, srv209727068=13, srv999966623=29, srv53462802=20, srv1366757529=2, srv697589460=23, srv1402605421=3, srv2048862133=12, srv600983305=22, srv851332331=26, srv791633644=25, srv1851802354=7, srv377390512=15, srv1942269063=9, srv1994771841=10, srv1046146052=0, srv224983057=14, srv56026468=21, srv879020777=27, srv78348492=24, srv2002371471=11, srv431962300=16, srv145509245=4} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-16 05:53:19,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-16 05:53:19,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-16 05:53:19,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-16 05:53:19,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-16 05:53:19,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-16 05:53:19,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-16 05:53:19,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-16 05:53:19,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-16 05:53:19,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-16 05:53:19,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-16 05:53:19,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-16 05:53:19,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-16 05:53:19,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-16 05:53:19,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-16 05:53:19,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-16 05:53:19,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-16 05:53:19,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-16 05:53:19,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-16 05:53:19,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-16 05:53:19,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-16 05:53:19,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-16 05:53:19,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-16 05:53:19,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-16 05:53:19,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-16 05:53:19,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-16 05:53:19,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-16 05:53:19,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-16 05:53:19,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-16 05:53:19,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-16 05:53:19,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-16 05:53:19,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-02-16 05:53:19,646 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0940159953724835, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-16 05:53:19,646 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912489284595795, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0940159953724835, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2024-02-16 05:55:19,630 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5482000 different iterations.  Found a solution that moves 1849 regions; Going from a computed imbalance of 0.9912489284595795 to a new imbalance of 4.3156582404131396E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6848148148148148, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-16 05:55:19,636 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1046146052:90 , srv1222919945:90 , srv1366757529:90 , srv1402605421:90 , srv145509245:90 , srv1747258255:90 , srv1775818036:90 , srv1851802354:90 , srv1935848249:90 , srv1942269063:90 , srv1994771841:90 , srv2002371471:90 , srv2048862133:90 , srv209727068:90 , srv224983057:90 , srv377390512:90 , srv431962300:90 , srv442868230:90 , srv472953174:90 , srv515195845:90 , srv53462802:90 , srv56026468:90 , srv600983305:90 , srv697589460:90 , srv78348492:90 , srv791633644:90 , srv851332331:90 , srv879020777:90 , srv955001192:90 , srv999966623:90 }
2024-02-16 05:55:19,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-16 05:55:19,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1222919945=1, srv1775818036=6, srv1935848249=8, srv515195845=19, srv472953174=18, srv442868230=17, srv1747258255=5, srv955001192=28, srv209727068=13, srv999966623=29, srv53462802=20, srv1366757529=2, srv697589460=23, srv1402605421=3, srv2048862133=12, srv600983305=22, srv851332331=26, srv791633644=25, srv1851802354=7, srv377390512=15, srv1942269063=9, srv1994771841=10, srv1046146052=0, srv224983057=14, srv56026468=21, srv879020777=27, srv78348492=24, srv2002371471=11, srv431962300=16, srv145509245=4} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-16 05:55:19,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-16 05:55:19,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-16 05:55:19,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-16 05:55:19,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-16 05:55:19,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-16 05:55:19,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-16 05:55:19,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-16 05:55:19,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-16 05:55:19,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-16 05:55:19,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-16 05:55:19,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-16 05:55:19,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-16 05:55:19,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-16 05:55:19,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-16 05:55:19,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-16 05:55:19,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-16 05:55:19,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-16 05:55:19,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-16 05:55:19,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-16 05:55:19,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-16 05:55:19,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-16 05:55:19,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-16 05:55:19,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-16 05:55:19,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-16 05:55:19,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-16 05:55:19,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-16 05:55:19,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-16 05:55:19,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-16 05:55:19,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-16 05:55:19,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-16 05:55:19,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-02-16 05:55:19,653 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-16 05:55:19,653 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1046146052:90 , srv1222919945:90 , srv1366757529:90 , srv1402605421:90 , srv145509245:90 , srv1747258255:90 , srv1775818036:90 , srv1851802354:90 , srv1935848249:90 , srv1942269063:90 , srv1994771841:90 , srv2002371471:90 , srv2048862133:90 , srv209727068:90 , srv224983057:90 , srv377390512:90 , srv431962300:90 , srv442868230:90 , srv472953174:90 , srv515195845:90 , srv53462802:90 , srv56026468:90 , srv600983305:90 , srv697589460:90 , srv78348492:90 , srv791633644:90 , srv851332331:90 , srv879020777:90 , srv955001192:90 , srv999966623:90 }
2024-02-16 05:55:19,665 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=262 (was 316), ProcessCount=168 (was 168), AvailableMemoryMB=782 (was 1188)