2024-01-19 14:53:12,819 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2024-01-19 14:53:13,145 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2024-01-19 14:53:13,262 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2024-01-19 14:53:13,335 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-01-19 14:53:13,343 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-01-19 14:53:13,357 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=265, ProcessCount=170, AvailableMemoryMB=12788
2024-01-19 14:53:13,359 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-01-19 14:53:13,360 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-01-19 14:53:13,489 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1013577272:84 , srv1077898498:84 , srv1098323929:84 , srv1122739428:84 , srv1140604217:84 , srv1153300686:84 , srv115449206:84 , srv1165328319:84 , srv1175375142:84 , srv1192010450:84 , srv1221673171:84 , srv1221750037:84 , srv1236902628:84 , srv1260284978:84 , srv1310289783:84 , srv131265124:84 , srv1330120917:84 , srv1351567459:84 , srv1352683340:84 , srv1367114905:84 , srv1385756292:84 , srv1402077562:84 , srv1408701103:84 , srv1447385911:84 , srv1456862459:84 , srv1464114477:84 , srv1484015585:84 , srv1487525386:84 , srv14895166:84 , srv1536189096:84 , srv1543223767:84 , srv1583150447:84 , srv1603033446:84 , srv1619731502:84 , srv1641616412:84 , srv1677680924:84 , srv1686612150:84 , srv1692214433:84 , srv1710747832:84 , srv1735092857:84 , srv1768713828:84 , srv1776232402:84 , srv1784450779:84 , srv1788099099:84 , srv1801871391:84 , srv1805705378:84 , srv1872883215:84 , srv1875172029:84 , srv1893841542:84 , srv1912860677:84 , srv1915445608:84 , srv1942217510:84 , srv2009816348:84 , srv2027802379:84 , srv2041435319:84 , srv2064003592:84 , srv2076808251:84 , srv2102483428:84 , srv2113399477:84 , srv2130495639:84 , srv2134482597:84 , srv213481281:84 , srv268942874:84 , srv281075641:84 , srv301547409:84 , srv312919675:84 , srv317160969:84 , srv321331622:84 , srv331984992:84 , srv344642198:84 , srv350000382:84 , srv352522089:84 , srv388800900:84 , srv439436940:84 , srv456732916:84 , srv458815627:84 , srv545530820:84 , srv570391462:84 , srv619285142:84 , srv638616236:84 , srv646846128:84 , srv695483104:84 , srv7114769:84 , srv732153584:84 , srv784566244:84 , srv78644160:84 , srv802884010:84 , srv807681913:84 , srv849651964:84 , srv860420306:84 , srv885846836:84 , srv907602985:84 , srv918017453:84 , srv92482545:84 , srv926011200:84 , srv941347205:84 , srv985864570:84 , srv994872926:84 , srv99576690:84 , srv659508947:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2024-01-19 14:53:13,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-01-19 14:53:13,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1677680924=35, srv695483104=82, srv1260284978=13, srv638616236=79, srv1330120917=16, srv1487525386=27, srv2130495639=59, srv2102483428=57, srv1351567459=17, srv14895166=28, srv1641616412=34, srv312919675=65, srv885846836=91, srv994872926=98, srv1805705378=45, srv1942217510=51, srv78644160=86, srv1464114477=25, srv1153300686=5, srv918017453=93, srv458815627=75, srv92482545=94, srv352522089=71, srv1221750037=11, srv1352683340=18, srv926011200=95, srv350000382=70, srv1077898498=1, srv985864570=97, srv1768713828=40, srv1692214433=37, srv344642198=69, srv1536189096=29, srv1915445608=50, srv1221673171=10, srv1122739428=3, srv802884010=87, srv1408701103=22, srv2009816348=52, srv1013577272=0, srv99576690=99, srv1784450779=42, srv1484015585=26, srv2134482597=60, srv941347205=96, srv268942874=62, srv907602985=92, srv619285142=78, srv2041435319=54, srv331984992=68, srv1912860677=49, srv1893841542=48, srv1619731502=33, srv1603033446=32, srv281075641=63, srv1192010450=9, srv1447385911=23, srv1175375142=8, srv807681913=88, srv1165328319=7, srv1686612150=36, srv115449206=6, srv1385756292=20, srv849651964=89, srv860420306=90, srv1583150447=31, srv1543223767=30, srv2027802379=53, srv646846128=80, srv1710747832=38, srv545530820=76, srv1236902628=12, srv213481281=61, srv439436940=73, srv317160969=66, srv1788099099=43, srv1367114905=19, srv2113399477=58, srv1801871391=44, srv1456862459=24, srv321331622=67, srv1872883215=46, srv784566244=85, srv1875172029=47, srv570391462=77, srv1310289783=14, srv1776232402=41, srv456732916=74, srv388800900=72, srv2064003592=55, srv659508947=81, srv1098323929=2, srv1140604217=4, srv7114769=83, srv732153584=84, srv2076808251=56, srv1402077562=21, srv301547409=64, srv131265124=15, srv1735092857=39} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-01-19 14:53:13,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-01-19 14:53:13,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-01-19 14:53:13,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-01-19 14:53:13,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-01-19 14:53:13,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-01-19 14:53:13,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-01-19 14:53:13,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-01-19 14:53:13,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-01-19 14:53:13,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-01-19 14:53:13,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-01-19 14:53:13,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-01-19 14:53:13,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-01-19 14:53:13,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-01-19 14:53:13,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-01-19 14:53:13,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-01-19 14:53:13,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-01-19 14:53:13,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-01-19 14:53:13,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-01-19 14:53:13,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-01-19 14:53:13,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-01-19 14:53:13,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-01-19 14:53:13,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-01-19 14:53:13,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-01-19 14:53:13,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-01-19 14:53:13,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-01-19 14:53:13,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-01-19 14:53:13,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-01-19 14:53:13,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-01-19 14:53:13,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-01-19 14:53:13,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-01-19 14:53:13,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-01-19 14:53:13,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-01-19 14:53:13,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-01-19 14:53:13,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-01-19 14:53:13,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-01-19 14:53:13,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-01-19 14:53:13,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-01-19 14:53:13,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-01-19 14:53:13,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-01-19 14:53:13,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-01-19 14:53:13,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-01-19 14:53:13,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-01-19 14:53:13,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-01-19 14:53:13,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-01-19 14:53:13,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-01-19 14:53:13,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-01-19 14:53:13,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-01-19 14:53:13,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-01-19 14:53:13,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-01-19 14:53:13,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-01-19 14:53:13,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-01-19 14:53:13,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-01-19 14:53:13,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-01-19 14:53:13,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-01-19 14:53:13,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-01-19 14:53:13,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-01-19 14:53:13,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-01-19 14:53:13,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-01-19 14:53:13,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-01-19 14:53:13,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-01-19 14:53:13,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-01-19 14:53:13,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-01-19 14:53:13,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-01-19 14:53:13,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-01-19 14:53:13,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-01-19 14:53:13,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-01-19 14:53:13,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-01-19 14:53:13,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-01-19 14:53:13,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-01-19 14:53:13,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-01-19 14:53:13,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-01-19 14:53:13,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-01-19 14:53:13,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-01-19 14:53:13,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-01-19 14:53:13,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-01-19 14:53:13,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-01-19 14:53:13,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-01-19 14:53:13,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-01-19 14:53:13,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-01-19 14:53:13,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-01-19 14:53:13,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-01-19 14:53:13,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-01-19 14:53:13,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-01-19 14:53:13,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-01-19 14:53:13,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-01-19 14:53:13,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-01-19 14:53:13,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-01-19 14:53:13,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-01-19 14:53:13,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-01-19 14:53:13,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-01-19 14:53:13,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-01-19 14:53:13,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-01-19 14:53:13,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-01-19 14:53:13,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-01-19 14:53:13,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-01-19 14:53:13,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-01-19 14:53:13,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-01-19 14:53:13,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-01-19 14:53:13,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-01-19 14:53:13,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-01-19 14:53:13,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-01-19 14:53:13,801 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-19 14:53:13,801 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-01-19 14:53:13,802 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-01-19 14:53:14,211 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 577 ms to try 5000 different iterations.  Found a solution that moves 4639 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.180387947195707. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04221513319896503, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.058184273236642894, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5154444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04221513319896503, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.1755, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24316666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-19 14:53:14,225 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1735092857:80 , srv456732916:80 , srv1583150447:81 , srv1784450779:81 , srv7114769:81 , srv131265124:82 , srv14895166:82 , srv2009816348:82 , srv2113399477:82 , srv638616236:82 , srv1077898498:83 , srv1603033446:83 , srv1677680924:83 , srv321331622:83 , srv545530820:83 , srv695483104:83 , srv78644160:83 , srv807681913:83 , srv92482545:83 , srv926011200:83 , srv994872926:83 , srv1165328319:84 , srv1236902628:84 , srv1641616412:84 , srv1915445608:84 , srv331984992:84 , srv344642198:84 , srv885846836:84 , srv115449206:85 , srv1192010450:85 , srv1221673171:85 , srv1352683340:85 , srv1367114905:85 , srv1484015585:85 , srv1686612150:85 , srv1776232402:85 , srv1912860677:85 , srv268942874:85 , srv281075641:85 , srv317160969:85 , srv352522089:85 , srv1098323929:86 , srv1153300686:86 , srv1310289783:86 , srv1447385911:86 , srv1710747832:86 , srv1788099099:86 , srv1805705378:86 , srv1875172029:86 , srv1942217510:86 , srv301547409:86 , srv646846128:86 , srv941347205:86 , srv1013577272:87 , srv1260284978:87 , srv1330120917:87 , srv1402077562:87 , srv1408701103:87 , srv1464114477:87 , srv1543223767:87 , srv1768713828:87 , srv2041435319:87 , srv2064003592:87 , srv2130495639:87 , srv439436940:87 , srv802884010:87 , srv985864570:87 , srv1122739428:88 , srv1140604217:88 , srv1221750037:88 , srv1456862459:88 , srv1487525386:88 , srv1872883215:88 , srv213481281:88 , srv570391462:88 , srv619285142:88 , srv732153584:88 , srv860420306:88 , srv99576690:88 , srv1893841542:89 , srv2134482597:89 , srv388800900:89 , srv849651964:89 , srv907602985:89 , srv918017453:89 , srv1175375142:90 , srv1385756292:90 , srv1536189096:90 , srv2102483428:90 , srv1619731502:91 , srv1692214433:91 , srv1801871391:91 , srv2027802379:91 , srv2076808251:91 , srv458815627:91 , srv1351567459:92 , srv350000382:92 , srv312919675:93 , srv784566244:93 , srv659508947:465 }
2024-01-19 14:53:14,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-01-19 14:53:14,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1677680924=35, srv695483104=82, srv1260284978=13, srv638616236=79, srv1330120917=16, srv1487525386=27, srv2130495639=59, srv2102483428=57, srv1351567459=17, srv14895166=28, srv1641616412=34, srv312919675=65, srv885846836=91, srv994872926=98, srv1805705378=45, srv1942217510=51, srv78644160=86, srv1464114477=25, srv1153300686=5, srv918017453=93, srv458815627=75, srv92482545=94, srv352522089=71, srv1221750037=11, srv1352683340=18, srv926011200=95, srv350000382=70, srv1077898498=1, srv985864570=97, srv1768713828=40, srv1692214433=37, srv344642198=69, srv1536189096=29, srv1915445608=50, srv1221673171=10, srv1122739428=3, srv802884010=87, srv1408701103=22, srv2009816348=52, srv1013577272=0, srv99576690=99, srv1784450779=42, srv1484015585=26, srv2134482597=60, srv941347205=96, srv268942874=62, srv907602985=92, srv619285142=78, srv2041435319=54, srv331984992=68, srv1912860677=49, srv1893841542=48, srv1619731502=33, srv1603033446=32, srv281075641=63, srv1192010450=9, srv1447385911=23, srv1175375142=8, srv807681913=88, srv1165328319=7, srv1686612150=36, srv115449206=6, srv1385756292=20, srv849651964=89, srv860420306=90, srv1583150447=31, srv1543223767=30, srv2027802379=53, srv646846128=80, srv1710747832=38, srv545530820=76, srv1236902628=12, srv213481281=61, srv439436940=73, srv317160969=66, srv1788099099=43, srv1367114905=19, srv2113399477=58, srv1801871391=44, srv1456862459=24, srv321331622=67, srv1872883215=46, srv784566244=85, srv1875172029=47, srv570391462=77, srv1310289783=14, srv1776232402=41, srv456732916=74, srv388800900=72, srv2064003592=55, srv659508947=81, srv1098323929=2, srv1140604217=4, srv7114769=83, srv732153584=84, srv2076808251=56, srv1402077562=21, srv301547409=64, srv131265124=15, srv1735092857=39} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-01-19 14:53:14,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-01-19 14:53:14,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-01-19 14:53:14,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-01-19 14:53:14,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-01-19 14:53:14,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-01-19 14:53:14,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-01-19 14:53:14,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-01-19 14:53:14,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-01-19 14:53:14,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-01-19 14:53:14,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-01-19 14:53:14,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-01-19 14:53:14,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-01-19 14:53:14,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-01-19 14:53:14,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-01-19 14:53:14,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-01-19 14:53:14,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-01-19 14:53:14,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-01-19 14:53:14,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-01-19 14:53:14,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-01-19 14:53:14,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-01-19 14:53:14,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-01-19 14:53:14,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-01-19 14:53:14,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-01-19 14:53:14,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-01-19 14:53:14,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-01-19 14:53:14,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-01-19 14:53:14,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-01-19 14:53:14,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-01-19 14:53:14,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-01-19 14:53:14,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-01-19 14:53:14,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-01-19 14:53:14,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-01-19 14:53:14,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-01-19 14:53:14,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-01-19 14:53:14,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-01-19 14:53:14,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-01-19 14:53:14,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-01-19 14:53:14,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-01-19 14:53:14,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-01-19 14:53:14,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-01-19 14:53:14,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-01-19 14:53:14,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-01-19 14:53:14,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-01-19 14:53:14,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-01-19 14:53:14,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-01-19 14:53:14,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-01-19 14:53:14,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-01-19 14:53:14,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-01-19 14:53:14,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-01-19 14:53:14,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-01-19 14:53:14,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-01-19 14:53:14,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-01-19 14:53:14,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-01-19 14:53:14,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-01-19 14:53:14,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-01-19 14:53:14,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-01-19 14:53:14,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-01-19 14:53:14,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-01-19 14:53:14,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-01-19 14:53:14,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-01-19 14:53:14,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-01-19 14:53:14,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-01-19 14:53:14,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-01-19 14:53:14,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-01-19 14:53:14,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-01-19 14:53:14,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-01-19 14:53:14,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-01-19 14:53:14,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-01-19 14:53:14,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-01-19 14:53:14,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-01-19 14:53:14,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-01-19 14:53:14,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-01-19 14:53:14,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-01-19 14:53:14,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-01-19 14:53:14,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-01-19 14:53:14,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-01-19 14:53:14,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-01-19 14:53:14,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-01-19 14:53:14,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-01-19 14:53:14,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-01-19 14:53:14,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-01-19 14:53:14,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-01-19 14:53:14,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-01-19 14:53:14,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-01-19 14:53:14,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-01-19 14:53:14,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-01-19 14:53:14,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-01-19 14:53:14,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-01-19 14:53:14,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-01-19 14:53:14,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-01-19 14:53:14,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-01-19 14:53:14,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-01-19 14:53:14,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-01-19 14:53:14,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-01-19 14:53:14,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-01-19 14:53:14,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-01-19 14:53:14,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-01-19 14:53:14,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-01-19 14:53:14,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-01-19 14:53:14,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-01-19 14:53:14,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-01-19 14:53:14,429 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04221513319896503, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.058184273236642894, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04221513319896503, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.1755, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24316666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-19 14:53:14,429 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-01-19 14:53:14,430 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18035546422343451, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04221513319896503, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.058184273236642894, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04221513319896503, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.1755, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24316666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-01-19 14:53:14,689 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 401 ms to try 5000 different iterations.  Found a solution that moves 2646 regions; Going from a computed imbalance of 0.18035546422343451 to a new imbalance of 0.015871682222384127. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.025411932335530178, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.036317591499172755, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.294, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.025411932335530178, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04375, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-19 14:53:14,699 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv2027802379:79 , srv312919675:79 , srv350000382:79 , srv458815627:79 , srv1536189096:80 , srv1692214433:80 , srv2076808251:80 , srv784566244:80 , srv1175375142:81 , srv1801871391:81 , srv388800900:81 , srv918017453:81 , srv1140604217:82 , srv1351567459:82 , srv1619731502:82 , srv1893841542:82 , srv2102483428:82 , srv2134482597:82 , srv1013577272:83 , srv1385756292:83 , srv1456862459:83 , srv732153584:83 , srv860420306:83 , srv1122739428:84 , srv1260284978:84 , srv1487525386:84 , srv1543223767:84 , srv1768713828:84 , srv1942217510:84 , srv2041435319:84 , srv301547409:84 , srv619285142:84 , srv907602985:84 , srv985864570:84 , srv1310289783:85 , srv1367114905:85 , srv1402077562:85 , srv1408701103:85 , srv1776232402:85 , srv1788099099:85 , srv1872883215:85 , srv268942874:85 , srv439436940:85 , srv802884010:85 , srv849651964:85 , srv885846836:85 , srv115449206:86 , srv1192010450:86 , srv1221673171:86 , srv1221750037:86 , srv1330120917:86 , srv1447385911:86 , srv1484015585:86 , srv1710747832:86 , srv1875172029:86 , srv2130495639:86 , srv213481281:86 , srv281075641:86 , srv317160969:86 , srv570391462:86 , srv646846128:86 , srv1098323929:87 , srv1153300686:87 , srv1165328319:87 , srv1352683340:87 , srv1464114477:87 , srv2064003592:87 , srv331984992:87 , srv344642198:87 , srv78644160:87 , srv92482545:87 , srv994872926:87 , srv99576690:87 , srv1236902628:88 , srv131265124:88 , srv1641616412:88 , srv1735092857:88 , srv1805705378:88 , srv1912860677:88 , srv352522089:88 , srv545530820:88 , srv941347205:88 , srv14895166:89 , srv1583150447:89 , srv1603033446:89 , srv1686612150:89 , srv1915445608:89 , srv2009816348:89 , srv2113399477:89 , srv321331622:89 , srv695483104:89 , srv807681913:89 , srv1677680924:90 , srv1784450779:90 , srv638616236:91 , srv926011200:91 , srv1077898498:92 , srv456732916:92 , srv7114769:92 , srv659508947:535 }
2024-01-19 14:53:14,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-01-19 14:53:14,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1677680924=35, srv695483104=82, srv1260284978=13, srv638616236=79, srv1330120917=16, srv1487525386=27, srv2130495639=59, srv2102483428=57, srv1351567459=17, srv14895166=28, srv1641616412=34, srv312919675=65, srv885846836=91, srv994872926=98, srv1805705378=45, srv1942217510=51, srv78644160=86, srv1464114477=25, srv1153300686=5, srv918017453=93, srv458815627=75, srv92482545=94, srv352522089=71, srv1221750037=11, srv1352683340=18, srv926011200=95, srv350000382=70, srv1077898498=1, srv985864570=97, srv1768713828=40, srv1692214433=37, srv344642198=69, srv1536189096=29, srv1915445608=50, srv1221673171=10, srv1122739428=3, srv802884010=87, srv1408701103=22, srv2009816348=52, srv1013577272=0, srv99576690=99, srv1784450779=42, srv1484015585=26, srv2134482597=60, srv941347205=96, srv268942874=62, srv907602985=92, srv619285142=78, srv2041435319=54, srv331984992=68, srv1912860677=49, srv1893841542=48, srv1619731502=33, srv1603033446=32, srv281075641=63, srv1192010450=9, srv1447385911=23, srv1175375142=8, srv807681913=88, srv1165328319=7, srv1686612150=36, srv115449206=6, srv1385756292=20, srv849651964=89, srv860420306=90, srv1583150447=31, srv1543223767=30, srv2027802379=53, srv646846128=80, srv1710747832=38, srv545530820=76, srv1236902628=12, srv213481281=61, srv439436940=73, srv317160969=66, srv1788099099=43, srv1367114905=19, srv2113399477=58, srv1801871391=44, srv1456862459=24, srv321331622=67, srv1872883215=46, srv784566244=85, srv1875172029=47, srv570391462=77, srv1310289783=14, srv1776232402=41, srv456732916=74, srv388800900=72, srv2064003592=55, srv659508947=81, srv1098323929=2, srv1140604217=4, srv7114769=83, srv732153584=84, srv2076808251=56, srv1402077562=21, srv301547409=64, srv131265124=15, srv1735092857=39} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-01-19 14:53:14,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-01-19 14:53:14,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-01-19 14:53:14,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-01-19 14:53:14,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-01-19 14:53:14,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-01-19 14:53:14,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-01-19 14:53:14,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-01-19 14:53:14,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-01-19 14:53:14,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-01-19 14:53:14,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-01-19 14:53:14,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-01-19 14:53:14,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-01-19 14:53:14,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-01-19 14:53:14,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-01-19 14:53:14,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-01-19 14:53:14,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-01-19 14:53:14,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-01-19 14:53:14,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-01-19 14:53:14,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-01-19 14:53:14,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-01-19 14:53:14,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-01-19 14:53:14,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-01-19 14:53:14,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-01-19 14:53:14,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-01-19 14:53:14,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-01-19 14:53:14,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-01-19 14:53:14,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-01-19 14:53:14,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-01-19 14:53:14,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-01-19 14:53:14,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-01-19 14:53:14,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-01-19 14:53:14,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-01-19 14:53:14,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-01-19 14:53:14,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-01-19 14:53:14,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-01-19 14:53:14,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-01-19 14:53:14,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-01-19 14:53:14,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-01-19 14:53:14,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-01-19 14:53:14,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-01-19 14:53:14,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-01-19 14:53:14,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-01-19 14:53:14,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-01-19 14:53:14,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-01-19 14:53:14,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-01-19 14:53:14,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-01-19 14:53:14,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-01-19 14:53:14,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-01-19 14:53:14,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-01-19 14:53:14,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-01-19 14:53:14,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-01-19 14:53:14,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-01-19 14:53:14,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-01-19 14:53:14,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-01-19 14:53:14,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-01-19 14:53:14,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-01-19 14:53:14,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-01-19 14:53:14,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-01-19 14:53:14,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-01-19 14:53:14,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-01-19 14:53:14,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-01-19 14:53:14,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-01-19 14:53:14,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-01-19 14:53:14,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-01-19 14:53:14,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-01-19 14:53:14,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-01-19 14:53:14,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-01-19 14:53:14,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-01-19 14:53:14,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-01-19 14:53:14,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-01-19 14:53:14,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-01-19 14:53:14,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-01-19 14:53:14,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-01-19 14:53:14,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-01-19 14:53:14,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-01-19 14:53:14,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-01-19 14:53:14,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-01-19 14:53:14,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-01-19 14:53:14,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-01-19 14:53:14,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-01-19 14:53:14,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-01-19 14:53:14,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-01-19 14:53:14,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-01-19 14:53:14,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-01-19 14:53:14,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-01-19 14:53:14,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-01-19 14:53:14,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-01-19 14:53:14,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-01-19 14:53:14,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-01-19 14:53:14,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-01-19 14:53:14,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-01-19 14:53:14,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-01-19 14:53:14,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-01-19 14:53:14,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-01-19 14:53:14,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-01-19 14:53:14,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-01-19 14:53:14,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-01-19 14:53:14,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-01-19 14:53:14,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-01-19 14:53:14,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-01-19 14:53:14,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-01-19 14:53:14,851 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.025411932335530178, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.036317591499172755, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.025411932335530178, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04375, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-19 14:53:14,851 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-01-19 14:53:14,851 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.01585315453438391, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.025411932335530178, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.036317591499172755, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.025411932335530178, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04375, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-01-19 14:53:15,226 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 480 ms to try 5000 different iterations.  Found a solution that moves 986 regions; Going from a computed imbalance of 0.01585315453438391 to a new imbalance of 0.0010132214169733345. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006455696666805003); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009983150788368353); MoveCostFunction : (multiplier=7.0, imbalance=0.10955555555555556, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006455696666805003); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.833333333333334E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0045); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-19 14:53:15,228 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv99576690:82 , srv1077898498:83 , srv1221750037:83 , srv1351567459:83 , srv1464114477:83 , srv1805705378:83 , srv213481281:83 , srv849651964:83 , srv907602985:83 , srv941347205:83 , srv1352683340:84 , srv1408701103:84 , srv1619731502:84 , srv1686612150:84 , srv1912860677:84 , srv1915445608:84 , srv2064003592:84 , srv2130495639:84 , srv570391462:84 , srv784566244:84 , srv926011200:84 , srv1098323929:85 , srv1153300686:85 , srv1236902628:85 , srv1330120917:85 , srv1402077562:85 , srv1447385911:85 , srv1641616412:85 , srv1677680924:85 , srv1710747832:85 , srv1801871391:85 , srv1872883215:85 , srv2102483428:85 , srv312919675:85 , srv321331622:85 , srv350000382:85 , srv352522089:85 , srv439436940:85 , srv456732916:85 , srv619285142:85 , srv638616236:85 , srv646846128:85 , srv7114769:85 , srv802884010:85 , srv1122739428:86 , srv115449206:86 , srv1165328319:86 , srv1175375142:86 , srv1221673171:86 , srv1260284978:86 , srv1310289783:86 , srv1385756292:86 , srv1456862459:86 , srv1484015585:86 , srv1487525386:86 , srv14895166:86 , srv1543223767:86 , srv1784450779:86 , srv1893841542:86 , srv2041435319:86 , srv2076808251:86 , srv268942874:86 , srv344642198:86 , srv807681913:86 , srv985864570:86 , srv994872926:86 , srv1013577272:87 , srv1140604217:87 , srv1192010450:87 , srv131265124:87 , srv1367114905:87 , srv1536189096:87 , srv1603033446:87 , srv1692214433:87 , srv1768713828:87 , srv1776232402:87 , srv1788099099:87 , srv1875172029:87 , srv2009816348:87 , srv2113399477:87 , srv281075641:87 , srv317160969:87 , srv695483104:87 , srv78644160:87 , srv860420306:87 , srv885846836:87 , srv918017453:87 , srv92482545:87 , srv1942217510:88 , srv2027802379:88 , srv301547409:88 , srv331984992:88 , srv388800900:88 , srv458815627:88 , srv545530820:88 , srv732153584:88 , srv1583150447:89 , srv1735092857:89 , srv2134482597:89 , srv659508947:515 }
2024-01-19 14:53:15,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-01-19 14:53:15,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1677680924=35, srv695483104=82, srv1260284978=13, srv638616236=79, srv1330120917=16, srv1487525386=27, srv2130495639=59, srv2102483428=57, srv1351567459=17, srv14895166=28, srv1641616412=34, srv312919675=65, srv885846836=91, srv994872926=98, srv1805705378=45, srv1942217510=51, srv78644160=86, srv1464114477=25, srv1153300686=5, srv918017453=93, srv458815627=75, srv92482545=94, srv352522089=71, srv1221750037=11, srv1352683340=18, srv926011200=95, srv350000382=70, srv1077898498=1, srv985864570=97, srv1768713828=40, srv1692214433=37, srv344642198=69, srv1536189096=29, srv1915445608=50, srv1221673171=10, srv1122739428=3, srv802884010=87, srv1408701103=22, srv2009816348=52, srv1013577272=0, srv99576690=99, srv1784450779=42, srv1484015585=26, srv2134482597=60, srv941347205=96, srv268942874=62, srv907602985=92, srv619285142=78, srv2041435319=54, srv331984992=68, srv1912860677=49, srv1893841542=48, srv1619731502=33, srv1603033446=32, srv281075641=63, srv1192010450=9, srv1447385911=23, srv1175375142=8, srv807681913=88, srv1165328319=7, srv1686612150=36, srv115449206=6, srv1385756292=20, srv849651964=89, srv860420306=90, srv1583150447=31, srv1543223767=30, srv2027802379=53, srv646846128=80, srv1710747832=38, srv545530820=76, srv1236902628=12, srv213481281=61, srv439436940=73, srv317160969=66, srv1788099099=43, srv1367114905=19, srv2113399477=58, srv1801871391=44, srv1456862459=24, srv321331622=67, srv1872883215=46, srv784566244=85, srv1875172029=47, srv570391462=77, srv1310289783=14, srv1776232402=41, srv456732916=74, srv388800900=72, srv2064003592=55, srv659508947=81, srv1098323929=2, srv1140604217=4, srv7114769=83, srv732153584=84, srv2076808251=56, srv1402077562=21, srv301547409=64, srv131265124=15, srv1735092857=39} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-01-19 14:53:15,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-01-19 14:53:15,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-01-19 14:53:15,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-01-19 14:53:15,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-01-19 14:53:15,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-01-19 14:53:15,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-01-19 14:53:15,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-01-19 14:53:15,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-01-19 14:53:15,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-01-19 14:53:15,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-01-19 14:53:15,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-01-19 14:53:15,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-01-19 14:53:15,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-01-19 14:53:15,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-01-19 14:53:15,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-01-19 14:53:15,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-01-19 14:53:15,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-01-19 14:53:15,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-01-19 14:53:15,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-01-19 14:53:15,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-01-19 14:53:15,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-01-19 14:53:15,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-01-19 14:53:15,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-01-19 14:53:15,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-01-19 14:53:15,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-01-19 14:53:15,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-01-19 14:53:15,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-01-19 14:53:15,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-01-19 14:53:15,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-01-19 14:53:15,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-01-19 14:53:15,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-01-19 14:53:15,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-01-19 14:53:15,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-01-19 14:53:15,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-01-19 14:53:15,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-01-19 14:53:15,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-01-19 14:53:15,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-01-19 14:53:15,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-01-19 14:53:15,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-01-19 14:53:15,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-01-19 14:53:15,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-01-19 14:53:15,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-01-19 14:53:15,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-01-19 14:53:15,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-01-19 14:53:15,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-01-19 14:53:15,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-01-19 14:53:15,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-01-19 14:53:15,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-01-19 14:53:15,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-01-19 14:53:15,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-01-19 14:53:15,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-01-19 14:53:15,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-01-19 14:53:15,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-01-19 14:53:15,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-01-19 14:53:15,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-01-19 14:53:15,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-01-19 14:53:15,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-01-19 14:53:15,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-01-19 14:53:15,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-01-19 14:53:15,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-01-19 14:53:15,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-01-19 14:53:15,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-01-19 14:53:15,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-01-19 14:53:15,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-01-19 14:53:15,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-01-19 14:53:15,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-01-19 14:53:15,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-01-19 14:53:15,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-01-19 14:53:15,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-01-19 14:53:15,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-01-19 14:53:15,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-01-19 14:53:15,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-01-19 14:53:15,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-01-19 14:53:15,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-01-19 14:53:15,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-01-19 14:53:15,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-01-19 14:53:15,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-01-19 14:53:15,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-01-19 14:53:15,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-01-19 14:53:15,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-01-19 14:53:15,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-01-19 14:53:15,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-01-19 14:53:15,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-01-19 14:53:15,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-01-19 14:53:15,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-01-19 14:53:15,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-01-19 14:53:15,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-01-19 14:53:15,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-01-19 14:53:15,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-01-19 14:53:15,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-01-19 14:53:15,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-01-19 14:53:15,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-01-19 14:53:15,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-01-19 14:53:15,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-01-19 14:53:15,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-01-19 14:53:15,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-01-19 14:53:15,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-01-19 14:53:15,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-01-19 14:53:15,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-01-19 14:53:15,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-01-19 14:53:15,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-01-19 14:53:15,363 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006455696666805003); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009983150788368353); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006455696666805003); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.833333333333334E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0045); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-19 14:53:15,363 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-01-19 14:53:15,364 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.0010063172974086282, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006455696666805003); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009983150788368353); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006455696666805003); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.833333333333334E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0045); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-01-19 14:53:15,630 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 369 ms to try 5000 different iterations.  Found a solution that moves 308 regions; Going from a computed imbalance of 0.0010063172974086282 to a new imbalance of 4.937008909872809E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.03422222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=4.166666666666667E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-19 14:53:15,631 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv2134482597:82 , srv1153300686:83 , srv1192010450:83 , srv1385756292:83 , srv1583150447:83 , srv1603033446:83 , srv1875172029:83 , srv331984992:83 , srv545530820:83 , srv695483104:83 , srv732153584:83 , srv1077898498:84 , srv1098323929:84 , srv1122739428:84 , srv1330120917:84 , srv1351567459:84 , srv1487525386:84 , srv1677680924:84 , srv1686612150:84 , srv1692214433:84 , srv1710747832:84 , srv1768713828:84 , srv1776232402:84 , srv1801871391:84 , srv1942217510:84 , srv2009816348:84 , srv2027802379:84 , srv2064003592:84 , srv2113399477:84 , srv281075641:84 , srv301547409:84 , srv317160969:84 , srv352522089:84 , srv388800900:84 , srv458815627:84 , srv570391462:84 , srv638616236:84 , srv7114769:84 , srv860420306:84 , srv926011200:84 , srv1013577272:85 , srv1140604217:85 , srv115449206:85 , srv1165328319:85 , srv1175375142:85 , srv1221673171:85 , srv1236902628:85 , srv1260284978:85 , srv1310289783:85 , srv131265124:85 , srv1352683340:85 , srv1367114905:85 , srv1402077562:85 , srv1447385911:85 , srv1456862459:85 , srv1464114477:85 , srv1484015585:85 , srv14895166:85 , srv1536189096:85 , srv1619731502:85 , srv1641616412:85 , srv1735092857:85 , srv1784450779:85 , srv1788099099:85 , srv1805705378:85 , srv1872883215:85 , srv1893841542:85 , srv1912860677:85 , srv1915445608:85 , srv2041435319:85 , srv2076808251:85 , srv2102483428:85 , srv2130495639:85 , srv213481281:85 , srv312919675:85 , srv344642198:85 , srv439436940:85 , srv456732916:85 , srv619285142:85 , srv646846128:85 , srv784566244:85 , srv78644160:85 , srv802884010:85 , srv807681913:85 , srv849651964:85 , srv918017453:85 , srv92482545:85 , srv941347205:85 , srv985864570:85 , srv99576690:85 , srv1221750037:86 , srv1408701103:86 , srv1543223767:86 , srv268942874:86 , srv321331622:86 , srv350000382:86 , srv885846836:86 , srv907602985:86 , srv994872926:86 , srv659508947:628 }
2024-01-19 14:53:15,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-01-19 14:53:15,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1677680924=35, srv695483104=82, srv1260284978=13, srv638616236=79, srv1330120917=16, srv1487525386=27, srv2130495639=59, srv2102483428=57, srv1351567459=17, srv14895166=28, srv1641616412=34, srv312919675=65, srv885846836=91, srv994872926=98, srv1805705378=45, srv1942217510=51, srv78644160=86, srv1464114477=25, srv1153300686=5, srv918017453=93, srv458815627=75, srv92482545=94, srv352522089=71, srv1221750037=11, srv1352683340=18, srv926011200=95, srv350000382=70, srv1077898498=1, srv985864570=97, srv1768713828=40, srv1692214433=37, srv344642198=69, srv1536189096=29, srv1915445608=50, srv1221673171=10, srv1122739428=3, srv802884010=87, srv1408701103=22, srv2009816348=52, srv1013577272=0, srv99576690=99, srv1784450779=42, srv1484015585=26, srv2134482597=60, srv941347205=96, srv268942874=62, srv907602985=92, srv619285142=78, srv2041435319=54, srv331984992=68, srv1912860677=49, srv1893841542=48, srv1619731502=33, srv1603033446=32, srv281075641=63, srv1192010450=9, srv1447385911=23, srv1175375142=8, srv807681913=88, srv1165328319=7, srv1686612150=36, srv115449206=6, srv1385756292=20, srv849651964=89, srv860420306=90, srv1583150447=31, srv1543223767=30, srv2027802379=53, srv646846128=80, srv1710747832=38, srv545530820=76, srv1236902628=12, srv213481281=61, srv439436940=73, srv317160969=66, srv1788099099=43, srv1367114905=19, srv2113399477=58, srv1801871391=44, srv1456862459=24, srv321331622=67, srv1872883215=46, srv784566244=85, srv1875172029=47, srv570391462=77, srv1310289783=14, srv1776232402=41, srv456732916=74, srv388800900=72, srv2064003592=55, srv659508947=81, srv1098323929=2, srv1140604217=4, srv7114769=83, srv732153584=84, srv2076808251=56, srv1402077562=21, srv301547409=64, srv131265124=15, srv1735092857=39} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-01-19 14:53:15,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-01-19 14:53:15,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-01-19 14:53:15,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-01-19 14:53:15,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-01-19 14:53:15,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-01-19 14:53:15,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-01-19 14:53:15,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-01-19 14:53:15,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-01-19 14:53:15,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-01-19 14:53:15,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-01-19 14:53:15,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-01-19 14:53:15,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-01-19 14:53:15,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-01-19 14:53:15,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-01-19 14:53:15,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-01-19 14:53:15,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-01-19 14:53:15,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-01-19 14:53:15,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-01-19 14:53:15,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-01-19 14:53:15,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-01-19 14:53:15,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-01-19 14:53:15,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-01-19 14:53:15,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-01-19 14:53:15,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-01-19 14:53:15,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-01-19 14:53:15,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-01-19 14:53:15,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-01-19 14:53:15,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-01-19 14:53:15,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-01-19 14:53:15,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-01-19 14:53:15,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-01-19 14:53:15,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-01-19 14:53:15,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-01-19 14:53:15,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-01-19 14:53:15,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-01-19 14:53:15,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-01-19 14:53:15,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-01-19 14:53:15,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-01-19 14:53:15,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-01-19 14:53:15,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-01-19 14:53:15,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-01-19 14:53:15,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-01-19 14:53:15,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-01-19 14:53:15,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-01-19 14:53:15,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-01-19 14:53:15,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-01-19 14:53:15,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-01-19 14:53:15,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-01-19 14:53:15,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-01-19 14:53:15,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-01-19 14:53:15,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-01-19 14:53:15,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-01-19 14:53:15,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-01-19 14:53:15,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-01-19 14:53:15,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-01-19 14:53:15,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-01-19 14:53:15,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-01-19 14:53:15,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-01-19 14:53:15,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-01-19 14:53:15,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-01-19 14:53:15,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-01-19 14:53:15,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-01-19 14:53:15,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-01-19 14:53:15,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-01-19 14:53:15,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-01-19 14:53:15,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-01-19 14:53:15,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-01-19 14:53:15,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-01-19 14:53:15,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-01-19 14:53:15,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-01-19 14:53:15,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-01-19 14:53:15,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-01-19 14:53:15,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-01-19 14:53:15,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-01-19 14:53:15,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-01-19 14:53:15,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-01-19 14:53:15,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-01-19 14:53:15,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-01-19 14:53:15,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-01-19 14:53:15,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-01-19 14:53:15,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-01-19 14:53:15,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-01-19 14:53:15,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-01-19 14:53:15,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-01-19 14:53:15,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-01-19 14:53:15,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-01-19 14:53:15,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-01-19 14:53:15,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-01-19 14:53:15,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-01-19 14:53:15,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-01-19 14:53:15,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-01-19 14:53:15,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-01-19 14:53:15,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-01-19 14:53:15,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-01-19 14:53:15,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-01-19 14:53:15,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-01-19 14:53:15,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-01-19 14:53:15,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-01-19 14:53:15,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-01-19 14:53:15,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-01-19 14:53:15,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-01-19 14:53:15,758 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=4.166666666666667E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-19 14:53:15,759 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-01-19 14:53:15,759 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=4.721342700346484E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=4.166666666666667E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-01-19 14:53:16,003 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 344 ms to try 5000 different iterations.  Found a solution that moves 29 regions; Going from a computed imbalance of 4.721342700346484E-5 to a new imbalance of 6.947131393970371E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014982219165849825); MoveCostFunction : (multiplier=7.0, imbalance=0.0032222222222222222); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-19 14:53:16,004 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1221750037:83 , srv1543223767:83 , srv1788099099:83 , srv1872883215:83 , srv321331622:83 , srv807681913:83 , srv1013577272:84 , srv1077898498:84 , srv1098323929:84 , srv1122739428:84 , srv1140604217:84 , srv115449206:84 , srv1165328319:84 , srv1175375142:84 , srv1221673171:84 , srv1236902628:84 , srv1260284978:84 , srv1310289783:84 , srv131265124:84 , srv1330120917:84 , srv1367114905:84 , srv1385756292:84 , srv1402077562:84 , srv1408701103:84 , srv1447385911:84 , srv1456862459:84 , srv1464114477:84 , srv1484015585:84 , srv1487525386:84 , srv14895166:84 , srv1536189096:84 , srv1583150447:84 , srv1603033446:84 , srv1619731502:84 , srv1641616412:84 , srv1677680924:84 , srv1686612150:84 , srv1692214433:84 , srv1735092857:84 , srv1768713828:84 , srv1784450779:84 , srv1805705378:84 , srv1875172029:84 , srv1893841542:84 , srv1912860677:84 , srv1915445608:84 , srv1942217510:84 , srv2009816348:84 , srv2027802379:84 , srv2041435319:84 , srv2064003592:84 , srv2076808251:84 , srv2102483428:84 , srv2113399477:84 , srv2130495639:84 , srv2134482597:84 , srv213481281:84 , srv268942874:84 , srv281075641:84 , srv301547409:84 , srv312919675:84 , srv317160969:84 , srv331984992:84 , srv344642198:84 , srv350000382:84 , srv352522089:84 , srv388800900:84 , srv439436940:84 , srv456732916:84 , srv458815627:84 , srv545530820:84 , srv570391462:84 , srv619285142:84 , srv638616236:84 , srv646846128:84 , srv695483104:84 , srv7114769:84 , srv732153584:84 , srv784566244:84 , srv78644160:84 , srv802884010:84 , srv849651964:84 , srv860420306:84 , srv885846836:84 , srv907602985:84 , srv918017453:84 , srv92482545:84 , srv926011200:84 , srv941347205:84 , srv985864570:84 , srv994872926:84 , srv99576690:84 , srv1153300686:85 , srv1192010450:85 , srv1351567459:85 , srv1352683340:85 , srv1710747832:85 , srv1776232402:85 , srv1801871391:85 , srv659508947:683 }
2024-01-19 14:53:16,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-01-19 14:53:16,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1677680924=35, srv695483104=82, srv1260284978=13, srv638616236=79, srv1330120917=16, srv1487525386=27, srv2130495639=59, srv2102483428=57, srv1351567459=17, srv14895166=28, srv1641616412=34, srv312919675=65, srv885846836=91, srv994872926=98, srv1805705378=45, srv1942217510=51, srv78644160=86, srv1464114477=25, srv1153300686=5, srv918017453=93, srv458815627=75, srv92482545=94, srv352522089=71, srv1221750037=11, srv1352683340=18, srv926011200=95, srv350000382=70, srv1077898498=1, srv985864570=97, srv1768713828=40, srv1692214433=37, srv344642198=69, srv1536189096=29, srv1915445608=50, srv1221673171=10, srv1122739428=3, srv802884010=87, srv1408701103=22, srv2009816348=52, srv1013577272=0, srv99576690=99, srv1784450779=42, srv1484015585=26, srv2134482597=60, srv941347205=96, srv268942874=62, srv907602985=92, srv619285142=78, srv2041435319=54, srv331984992=68, srv1912860677=49, srv1893841542=48, srv1619731502=33, srv1603033446=32, srv281075641=63, srv1192010450=9, srv1447385911=23, srv1175375142=8, srv807681913=88, srv1165328319=7, srv1686612150=36, srv115449206=6, srv1385756292=20, srv849651964=89, srv860420306=90, srv1583150447=31, srv1543223767=30, srv2027802379=53, srv646846128=80, srv1710747832=38, srv545530820=76, srv1236902628=12, srv213481281=61, srv439436940=73, srv317160969=66, srv1788099099=43, srv1367114905=19, srv2113399477=58, srv1801871391=44, srv1456862459=24, srv321331622=67, srv1872883215=46, srv784566244=85, srv1875172029=47, srv570391462=77, srv1310289783=14, srv1776232402=41, srv456732916=74, srv388800900=72, srv2064003592=55, srv659508947=81, srv1098323929=2, srv1140604217=4, srv7114769=83, srv732153584=84, srv2076808251=56, srv1402077562=21, srv301547409=64, srv131265124=15, srv1735092857=39} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-01-19 14:53:16,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-01-19 14:53:16,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-01-19 14:53:16,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-01-19 14:53:16,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-01-19 14:53:16,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-01-19 14:53:16,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-01-19 14:53:16,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-01-19 14:53:16,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-01-19 14:53:16,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-01-19 14:53:16,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-01-19 14:53:16,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-01-19 14:53:16,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-01-19 14:53:16,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-01-19 14:53:16,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-01-19 14:53:16,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-01-19 14:53:16,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-01-19 14:53:16,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-01-19 14:53:16,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-01-19 14:53:16,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-01-19 14:53:16,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-01-19 14:53:16,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-01-19 14:53:16,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-01-19 14:53:16,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-01-19 14:53:16,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-01-19 14:53:16,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-01-19 14:53:16,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-01-19 14:53:16,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-01-19 14:53:16,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-01-19 14:53:16,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-01-19 14:53:16,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-01-19 14:53:16,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-01-19 14:53:16,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-01-19 14:53:16,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-01-19 14:53:16,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-01-19 14:53:16,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-01-19 14:53:16,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-01-19 14:53:16,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-01-19 14:53:16,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-01-19 14:53:16,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-01-19 14:53:16,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-01-19 14:53:16,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-01-19 14:53:16,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-01-19 14:53:16,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-01-19 14:53:16,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-01-19 14:53:16,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-01-19 14:53:16,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-01-19 14:53:16,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-01-19 14:53:16,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-01-19 14:53:16,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-01-19 14:53:16,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-01-19 14:53:16,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-01-19 14:53:16,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-01-19 14:53:16,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-01-19 14:53:16,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-01-19 14:53:16,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-01-19 14:53:16,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-01-19 14:53:16,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-01-19 14:53:16,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-01-19 14:53:16,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-01-19 14:53:16,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-01-19 14:53:16,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-01-19 14:53:16,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-01-19 14:53:16,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-01-19 14:53:16,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-01-19 14:53:16,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-01-19 14:53:16,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-01-19 14:53:16,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-01-19 14:53:16,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-01-19 14:53:16,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-01-19 14:53:16,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-01-19 14:53:16,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-01-19 14:53:16,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-01-19 14:53:16,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-01-19 14:53:16,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-01-19 14:53:16,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-01-19 14:53:16,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-01-19 14:53:16,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-01-19 14:53:16,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-01-19 14:53:16,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-01-19 14:53:16,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-01-19 14:53:16,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-01-19 14:53:16,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-01-19 14:53:16,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-01-19 14:53:16,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-01-19 14:53:16,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-01-19 14:53:16,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-01-19 14:53:16,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-01-19 14:53:16,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-01-19 14:53:16,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-01-19 14:53:16,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-01-19 14:53:16,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-01-19 14:53:16,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-01-19 14:53:16,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-01-19 14:53:16,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-01-19 14:53:16,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-01-19 14:53:16,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-01-19 14:53:16,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-01-19 14:53:16,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-01-19 14:53:16,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-01-19 14:53:16,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-01-19 14:53:16,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-01-19 14:53:16,132 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=6.744069053831948E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014982219165849825); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-19 14:53:16,132 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1221750037:83 , srv1543223767:83 , srv1788099099:83 , srv1872883215:83 , srv321331622:83 , srv807681913:83 , srv1013577272:84 , srv1077898498:84 , srv1098323929:84 , srv1122739428:84 , srv1140604217:84 , srv115449206:84 , srv1165328319:84 , srv1175375142:84 , srv1221673171:84 , srv1236902628:84 , srv1260284978:84 , srv1310289783:84 , srv131265124:84 , srv1330120917:84 , srv1367114905:84 , srv1385756292:84 , srv1402077562:84 , srv1408701103:84 , srv1447385911:84 , srv1456862459:84 , srv1464114477:84 , srv1484015585:84 , srv1487525386:84 , srv14895166:84 , srv1536189096:84 , srv1583150447:84 , srv1603033446:84 , srv1619731502:84 , srv1641616412:84 , srv1677680924:84 , srv1686612150:84 , srv1692214433:84 , srv1735092857:84 , srv1768713828:84 , srv1784450779:84 , srv1805705378:84 , srv1875172029:84 , srv1893841542:84 , srv1912860677:84 , srv1915445608:84 , srv1942217510:84 , srv2009816348:84 , srv2027802379:84 , srv2041435319:84 , srv2064003592:84 , srv2076808251:84 , srv2102483428:84 , srv2113399477:84 , srv2130495639:84 , srv2134482597:84 , srv213481281:84 , srv268942874:84 , srv281075641:84 , srv301547409:84 , srv312919675:84 , srv317160969:84 , srv331984992:84 , srv344642198:84 , srv350000382:84 , srv352522089:84 , srv388800900:84 , srv439436940:84 , srv456732916:84 , srv458815627:84 , srv545530820:84 , srv570391462:84 , srv619285142:84 , srv638616236:84 , srv646846128:84 , srv695483104:84 , srv7114769:84 , srv732153584:84 , srv784566244:84 , srv78644160:84 , srv802884010:84 , srv849651964:84 , srv860420306:84 , srv885846836:84 , srv907602985:84 , srv918017453:84 , srv92482545:84 , srv926011200:84 , srv941347205:84 , srv985864570:84 , srv994872926:84 , srv99576690:84 , srv1153300686:85 , srv1192010450:85 , srv1351567459:85 , srv1352683340:85 , srv1710747832:85 , srv1776232402:85 , srv1801871391:85 , srv659508947:683 }
2024-01-19 14:53:16,168 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=265 (was 265), ProcessCount=170 (was 170), AvailableMemoryMB=12170 (was 12788)
2024-01-19 14:53:16,176 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=265, ProcessCount=170, AvailableMemoryMB=12170
2024-01-19 14:53:16,176 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-01-19 14:53:16,177 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2024-01-19 14:53:16,187 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1007491469:84 , srv1031861530:84 , srv1065668672:84 , srv1084450180:84 , srv1096832534:84 , srv1188560957:84 , srv1222614259:84 , srv1289278449:84 , srv136898384:84 , srv1450974963:84 , srv1487758593:84 , srv1534773131:84 , srv1567459631:84 , srv1688804998:84 , srv1852793100:84 , srv1858088736:84 , srv2002274360:84 , srv2103176125:84 , srv386214941:84 , srv396254464:84 , srv526753717:84 , srv566841279:84 , srv589758519:84 , srv670003680:84 , srv836318257:84 , srv892014426:84 , srv909603385:84 , srv922450582:84 , srv988781488:84 , srv1770644319:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2024-01-19 14:53:16,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-01-19 14:53:16,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1084450180=3, srv1222614259=6, srv2002274360=17, srv1065668672=2, srv988781488=29, srv836318257=25, srv922450582=28, srv1188560957=5, srv1567459631=12, srv386214941=19, srv670003680=24, srv1770644319=14, srv396254464=20, srv1450974963=9, srv1858088736=16, srv526753717=21, srv1289278449=7, srv909603385=27, srv566841279=22, srv1031861530=1, srv1487758593=10, srv1007491469=0, srv136898384=8, srv589758519=23, srv1534773131=11, srv1852793100=15, srv1688804998=13, srv2103176125=18, srv892014426=26, srv1096832534=4} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-01-19 14:53:16,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-01-19 14:53:16,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-01-19 14:53:16,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-01-19 14:53:16,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-01-19 14:53:16,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-01-19 14:53:16,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-01-19 14:53:16,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-01-19 14:53:16,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-01-19 14:53:16,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-01-19 14:53:16,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-01-19 14:53:16,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-01-19 14:53:16,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-01-19 14:53:16,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-01-19 14:53:16,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-01-19 14:53:16,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-01-19 14:53:16,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-01-19 14:53:16,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-01-19 14:53:16,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-01-19 14:53:16,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-01-19 14:53:16,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-01-19 14:53:16,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-01-19 14:53:16,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-01-19 14:53:16,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-01-19 14:53:16,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-01-19 14:53:16,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-01-19 14:53:16,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-01-19 14:53:16,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-01-19 14:53:16,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-01-19 14:53:16,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-01-19 14:53:16,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-01-19 14:53:16,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-01-19 14:53:16,218 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1322650565059365, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-19 14:53:16,218 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912609806138478, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1322650565059365, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2024-01-19 14:55:16,205 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5427578 different iterations.  Found a solution that moves 1865 regions; Going from a computed imbalance of 0.9912609806138478 to a new imbalance of 4.353003038599517E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6907407407407408, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-19 14:55:16,213 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1007491469:90 , srv1031861530:90 , srv1065668672:90 , srv1084450180:90 , srv1096832534:90 , srv1188560957:90 , srv1222614259:90 , srv1289278449:90 , srv136898384:90 , srv1450974963:90 , srv1487758593:90 , srv1534773131:90 , srv1567459631:90 , srv1688804998:90 , srv1770644319:90 , srv1852793100:90 , srv1858088736:90 , srv2002274360:90 , srv2103176125:90 , srv386214941:90 , srv396254464:90 , srv526753717:90 , srv566841279:90 , srv589758519:90 , srv670003680:90 , srv836318257:90 , srv892014426:90 , srv909603385:90 , srv922450582:90 , srv988781488:90 }
2024-01-19 14:55:16,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-01-19 14:55:16,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1084450180=3, srv1222614259=6, srv2002274360=17, srv1065668672=2, srv988781488=29, srv836318257=25, srv922450582=28, srv1188560957=5, srv1567459631=12, srv386214941=19, srv670003680=24, srv1770644319=14, srv396254464=20, srv1450974963=9, srv1858088736=16, srv526753717=21, srv1289278449=7, srv909603385=27, srv566841279=22, srv1031861530=1, srv1487758593=10, srv1007491469=0, srv136898384=8, srv589758519=23, srv1534773131=11, srv1852793100=15, srv1688804998=13, srv2103176125=18, srv892014426=26, srv1096832534=4} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-01-19 14:55:16,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-01-19 14:55:16,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-01-19 14:55:16,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-01-19 14:55:16,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-01-19 14:55:16,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-01-19 14:55:16,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-01-19 14:55:16,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-01-19 14:55:16,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-01-19 14:55:16,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-01-19 14:55:16,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-01-19 14:55:16,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-01-19 14:55:16,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-01-19 14:55:16,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-01-19 14:55:16,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-01-19 14:55:16,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-01-19 14:55:16,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-01-19 14:55:16,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-01-19 14:55:16,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-01-19 14:55:16,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-01-19 14:55:16,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-01-19 14:55:16,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-01-19 14:55:16,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-01-19 14:55:16,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-01-19 14:55:16,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-01-19 14:55:16,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-01-19 14:55:16,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-01-19 14:55:16,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-01-19 14:55:16,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-01-19 14:55:16,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-01-19 14:55:16,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-01-19 14:55:16,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-01-19 14:55:16,234 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-19 14:55:16,235 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1007491469:90 , srv1031861530:90 , srv1065668672:90 , srv1084450180:90 , srv1096832534:90 , srv1188560957:90 , srv1222614259:90 , srv1289278449:90 , srv136898384:90 , srv1450974963:90 , srv1487758593:90 , srv1534773131:90 , srv1567459631:90 , srv1688804998:90 , srv1770644319:90 , srv1852793100:90 , srv1858088736:90 , srv2002274360:90 , srv2103176125:90 , srv386214941:90 , srv396254464:90 , srv526753717:90 , srv566841279:90 , srv589758519:90 , srv670003680:90 , srv836318257:90 , srv892014426:90 , srv909603385:90 , srv922450582:90 , srv988781488:90 }
2024-01-19 14:55:16,248 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=214 (was 265), ProcessCount=167 (was 170), AvailableMemoryMB=11069 (was 12170)