2024-01-08 13:53:15,603 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2024-01-08 13:53:15,928 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2024-01-08 13:53:16,056 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2024-01-08 13:53:16,123 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-01-08 13:53:16,130 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-01-08 13:53:16,145 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=287, ProcessCount=168, AvailableMemoryMB=11132
2024-01-08 13:53:16,148 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-01-08 13:53:16,148 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-01-08 13:53:16,290 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1011286592:84 , srv1085656725:84 , srv1098441654:84 , srv1144057238:84 , srv116619625:84 , srv1171577845:84 , srv1199611297:84 , srv1204129627:84 , srv1207153616:84 , srv1220630380:84 , srv1243851313:84 , srv1270859852:84 , srv1320804015:84 , srv1338435548:84 , srv1370431899:84 , srv1394710869:84 , srv1424277502:84 , srv1428983957:84 , srv142929661:84 , srv1432274789:84 , srv1445792287:84 , srv1469601679:84 , srv148243850:84 , srv14857202:84 , srv1553977756:84 , srv1577607415:84 , srv1581909332:84 , srv1606963691:84 , srv1613769160:84 , srv1618540015:84 , srv1634042722:84 , srv1640106465:84 , srv1643459493:84 , srv1652408446:84 , srv1669606532:84 , srv1678559298:84 , srv1679193817:84 , srv1680640299:84 , srv1709284339:84 , srv1730518685:84 , srv1744359708:84 , srv1758195764:84 , srv1790100964:84 , srv181938390:84 , srv1829571725:84 , srv1834153036:84 , srv1886556938:84 , srv1895572651:84 , srv1897703529:84 , srv1903072449:84 , srv1918158455:84 , srv1948980197:84 , srv1963096176:84 , srv1963562255:84 , srv1967505984:84 , srv1998688380:84 , srv2025110397:84 , srv2048210355:84 , srv205456943:84 , srv206970900:84 , srv2081661069:84 , srv2087524320:84 , srv2125991658:84 , srv242992320:84 , srv281347256:84 , srv286131172:84 , srv29746868:84 , srv317979003:84 , srv354606878:84 , srv422562663:84 , srv479387516:84 , srv50476074:84 , srv540627865:84 , srv558978136:84 , srv569721394:84 , srv593269558:84 , srv611033379:84 , srv621329235:84 , srv623180298:84 , srv666957346:84 , srv677181939:84 , srv700025113:84 , srv712796668:84 , srv722709542:84 , srv724547681:84 , srv742431273:84 , srv743999989:84 , srv815494029:84 , srv815519141:84 , srv839722567:84 , srv884459326:84 , srv893808970:84 , srv907693585:84 , srv90939997:84 , srv910879660:84 , srv924813635:84 , srv926300088:84 , srv952441150:84 , srv968718037:84 , srv1924888311:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2024-01-08 13:53:16,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-01-08 13:53:16,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1678559298=35, srv1270859852=11, srv1834153036=45, srv1709284339=38, srv815519141=89, srv1207153616=8, srv14857202=23, srv1634042722=30, srv666957346=80, srv1243851313=10, srv1144057238=3, srv540627865=73, srv1011286592=0, srv142929661=18, srv1320804015=12, srv1643459493=32, srv317979003=68, srv1758195764=41, srv1895572651=47, srv1903072449=49, srv952441150=98, srv1618540015=29, srv354606878=69, srv815494029=88, srv724547681=85, srv1394710869=15, srv926300088=97, srv1098441654=2, srv90939997=94, srv742431273=86, srv1886556938=46, srv29746868=67, srv1924888311=51, srv1948980197=52, srv1640106465=31, srv1744359708=40, srv148243850=22, srv1204129627=7, srv2048210355=58, srv2025110397=57, srv1553977756=24, srv1428983957=17, srv242992320=64, srv1679193817=36, srv1199611297=6, srv1220630380=9, srv1669606532=34, srv1730518685=39, srv623180298=79, srv286131172=66, srv2081661069=61, srv893808970=92, srv206970900=60, srv1963096176=53, srv1790100964=42, srv205456943=59, srv1432274789=19, srv1469601679=21, srv968718037=99, srv422562663=70, srv910879660=95, srv181938390=43, srv569721394=75, srv593269558=76, srv1998688380=56, srv558978136=74, srv924813635=96, srv1370431899=14, srv700025113=82, srv677181939=81, srv712796668=83, srv1918158455=50, srv907693585=93, srv884459326=91, srv1652408446=33, srv1606963691=27, srv1829571725=44, srv1424277502=16, srv1967505984=55, srv1085656725=1, srv50476074=72, srv1338435548=13, srv1680640299=37, srv1581909332=26, srv1963562255=54, srv2125991658=63, srv479387516=71, srv281347256=65, srv2087524320=62, srv1577607415=25, srv621329235=78, srv1897703529=48, srv1613769160=28, srv611033379=77, srv722709542=84, srv116619625=4, srv1445792287=20, srv839722567=90, srv743999989=87, srv1171577845=5} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-01-08 13:53:16,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-01-08 13:53:16,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-01-08 13:53:16,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-01-08 13:53:16,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-01-08 13:53:16,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-01-08 13:53:16,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-01-08 13:53:16,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-01-08 13:53:16,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-01-08 13:53:16,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-01-08 13:53:16,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-01-08 13:53:16,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-01-08 13:53:16,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-01-08 13:53:16,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-01-08 13:53:16,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-01-08 13:53:16,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-01-08 13:53:16,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-01-08 13:53:16,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-01-08 13:53:16,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-01-08 13:53:16,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-01-08 13:53:16,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-01-08 13:53:16,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-01-08 13:53:16,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-01-08 13:53:16,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-01-08 13:53:16,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-01-08 13:53:16,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-01-08 13:53:16,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-01-08 13:53:16,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-01-08 13:53:16,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-01-08 13:53:16,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-01-08 13:53:16,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-01-08 13:53:16,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-01-08 13:53:16,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-01-08 13:53:16,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-01-08 13:53:16,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-01-08 13:53:16,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-01-08 13:53:16,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-01-08 13:53:16,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-01-08 13:53:16,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-01-08 13:53:16,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-01-08 13:53:16,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-01-08 13:53:16,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-01-08 13:53:16,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-01-08 13:53:16,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-01-08 13:53:16,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-01-08 13:53:16,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-01-08 13:53:16,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-01-08 13:53:16,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-01-08 13:53:16,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-01-08 13:53:16,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-01-08 13:53:16,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-01-08 13:53:16,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-01-08 13:53:16,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-01-08 13:53:16,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-01-08 13:53:16,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-01-08 13:53:16,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-01-08 13:53:16,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-01-08 13:53:16,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-01-08 13:53:16,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-01-08 13:53:16,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-01-08 13:53:16,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-01-08 13:53:16,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-01-08 13:53:16,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-01-08 13:53:16,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-01-08 13:53:16,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-01-08 13:53:16,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-01-08 13:53:16,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-01-08 13:53:16,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-01-08 13:53:16,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-01-08 13:53:16,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-01-08 13:53:16,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-01-08 13:53:16,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-01-08 13:53:16,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-01-08 13:53:16,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-01-08 13:53:16,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-01-08 13:53:16,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-01-08 13:53:16,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-01-08 13:53:16,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-01-08 13:53:16,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-01-08 13:53:16,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-01-08 13:53:16,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-01-08 13:53:16,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-01-08 13:53:16,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-01-08 13:53:16,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-01-08 13:53:16,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-01-08 13:53:16,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-01-08 13:53:16,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-01-08 13:53:16,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-01-08 13:53:16,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-01-08 13:53:16,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-01-08 13:53:16,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-01-08 13:53:16,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-01-08 13:53:16,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-01-08 13:53:16,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-01-08 13:53:16,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-01-08 13:53:16,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-01-08 13:53:16,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-01-08 13:53:16,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-01-08 13:53:16,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-01-08 13:53:16,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-01-08 13:53:16,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-01-08 13:53:16,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-01-08 13:53:16,845 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-08 13:53:16,846 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-01-08 13:53:16,846 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-01-08 13:53:17,590 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 1133 ms to try 5000 different iterations.  Found a solution that moves 4684 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17846073197851411. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.036420456916480846, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05450934083196113, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5204444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.036420456916480846, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17383333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23891666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-08 13:53:17,599 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv623180298:83 , srv116619625:84 , srv1243851313:84 , srv1744359708:84 , srv479387516:84 , srv815519141:84 , srv884459326:84 , srv952441150:84 , srv1144057238:85 , srv1207153616:85 , srv1320804015:85 , srv1394710869:85 , srv1432274789:85 , srv1613769160:85 , srv1640106465:85 , srv1652408446:85 , srv1680640299:85 , srv2087524320:85 , srv281347256:85 , srv286131172:85 , srv700025113:85 , srv722709542:85 , srv815494029:85 , srv1011286592:86 , srv1171577845:86 , srv1199611297:86 , srv1370431899:86 , srv1469601679:86 , srv1577607415:86 , srv1606963691:86 , srv1618540015:86 , srv1669606532:86 , srv1679193817:86 , srv1730518685:86 , srv1758195764:86 , srv1829571725:86 , srv1834153036:86 , srv1903072449:86 , srv1918158455:86 , srv1967505984:86 , srv1998688380:86 , srv242992320:86 , srv317979003:86 , srv354606878:86 , srv569721394:86 , srv677181939:86 , srv724547681:86 , srv743999989:86 , srv907693585:86 , srv924813635:86 , srv1085656725:87 , srv1098441654:87 , srv1204129627:87 , srv1424277502:87 , srv1445792287:87 , srv1709284339:87 , srv1790100964:87 , srv1895572651:87 , srv1897703529:87 , srv1948980197:87 , srv1963562255:87 , srv2048210355:87 , srv2081661069:87 , srv2125991658:87 , srv422562663:87 , srv50476074:87 , srv540627865:87 , srv558978136:87 , srv611033379:87 , srv712796668:87 , srv90939997:87 , srv1220630380:88 , srv1270859852:88 , srv1428983957:88 , srv14857202:88 , srv1581909332:88 , srv1634042722:88 , srv1643459493:88 , srv1678559298:88 , srv181938390:88 , srv206970900:88 , srv742431273:88 , srv893808970:88 , srv926300088:88 , srv968718037:88 , srv1338435548:89 , srv142929661:89 , srv148243850:89 , srv1553977756:89 , srv1886556938:89 , srv2025110397:89 , srv29746868:89 , srv593269558:89 , srv666957346:89 , srv839722567:89 , srv1963096176:90 , srv910879660:92 , srv621329235:93 , srv205456943:94 , srv1924888311:414 }
2024-01-08 13:53:17,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-01-08 13:53:17,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1678559298=35, srv1270859852=11, srv1834153036=45, srv1709284339=38, srv815519141=89, srv1207153616=8, srv14857202=23, srv1634042722=30, srv666957346=80, srv1243851313=10, srv1144057238=3, srv540627865=73, srv1011286592=0, srv142929661=18, srv1320804015=12, srv1643459493=32, srv317979003=68, srv1758195764=41, srv1895572651=47, srv1903072449=49, srv952441150=98, srv1618540015=29, srv354606878=69, srv815494029=88, srv724547681=85, srv1394710869=15, srv926300088=97, srv1098441654=2, srv90939997=94, srv742431273=86, srv1886556938=46, srv29746868=67, srv1924888311=51, srv1948980197=52, srv1640106465=31, srv1744359708=40, srv148243850=22, srv1204129627=7, srv2048210355=58, srv2025110397=57, srv1553977756=24, srv1428983957=17, srv242992320=64, srv1679193817=36, srv1199611297=6, srv1220630380=9, srv1669606532=34, srv1730518685=39, srv623180298=79, srv286131172=66, srv2081661069=61, srv893808970=92, srv206970900=60, srv1963096176=53, srv1790100964=42, srv205456943=59, srv1432274789=19, srv1469601679=21, srv968718037=99, srv422562663=70, srv910879660=95, srv181938390=43, srv569721394=75, srv593269558=76, srv1998688380=56, srv558978136=74, srv924813635=96, srv1370431899=14, srv700025113=82, srv677181939=81, srv712796668=83, srv1918158455=50, srv907693585=93, srv884459326=91, srv1652408446=33, srv1606963691=27, srv1829571725=44, srv1424277502=16, srv1967505984=55, srv1085656725=1, srv50476074=72, srv1338435548=13, srv1680640299=37, srv1581909332=26, srv1963562255=54, srv2125991658=63, srv479387516=71, srv281347256=65, srv2087524320=62, srv1577607415=25, srv621329235=78, srv1897703529=48, srv1613769160=28, srv611033379=77, srv722709542=84, srv116619625=4, srv1445792287=20, srv839722567=90, srv743999989=87, srv1171577845=5} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-01-08 13:53:17,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-01-08 13:53:17,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-01-08 13:53:17,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-01-08 13:53:17,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-01-08 13:53:17,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-01-08 13:53:17,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-01-08 13:53:17,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-01-08 13:53:17,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-01-08 13:53:17,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-01-08 13:53:17,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-01-08 13:53:17,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-01-08 13:53:17,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-01-08 13:53:17,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-01-08 13:53:17,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-01-08 13:53:17,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-01-08 13:53:17,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-01-08 13:53:17,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-01-08 13:53:17,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-01-08 13:53:17,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-01-08 13:53:17,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-01-08 13:53:17,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-01-08 13:53:17,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-01-08 13:53:17,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-01-08 13:53:17,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-01-08 13:53:17,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-01-08 13:53:17,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-01-08 13:53:17,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-01-08 13:53:17,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-01-08 13:53:17,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-01-08 13:53:17,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-01-08 13:53:17,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-01-08 13:53:17,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-01-08 13:53:17,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-01-08 13:53:17,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-01-08 13:53:17,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-01-08 13:53:17,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-01-08 13:53:17,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-01-08 13:53:17,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-01-08 13:53:17,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-01-08 13:53:17,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-01-08 13:53:17,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-01-08 13:53:17,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-01-08 13:53:17,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-01-08 13:53:17,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-01-08 13:53:17,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-01-08 13:53:17,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-01-08 13:53:17,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-01-08 13:53:17,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-01-08 13:53:17,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-01-08 13:53:17,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-01-08 13:53:17,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-01-08 13:53:17,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-01-08 13:53:17,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-01-08 13:53:17,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-01-08 13:53:17,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-01-08 13:53:17,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-01-08 13:53:17,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-01-08 13:53:17,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-01-08 13:53:17,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-01-08 13:53:17,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-01-08 13:53:17,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-01-08 13:53:17,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-01-08 13:53:17,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-01-08 13:53:17,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-01-08 13:53:17,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-01-08 13:53:17,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-01-08 13:53:17,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-01-08 13:53:17,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-01-08 13:53:17,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-01-08 13:53:17,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-01-08 13:53:17,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-01-08 13:53:17,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-01-08 13:53:17,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-01-08 13:53:17,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-01-08 13:53:17,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-01-08 13:53:17,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-01-08 13:53:17,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-01-08 13:53:17,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-01-08 13:53:17,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-01-08 13:53:17,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-01-08 13:53:17,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-01-08 13:53:17,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-01-08 13:53:17,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-01-08 13:53:17,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-01-08 13:53:17,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-01-08 13:53:17,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-01-08 13:53:17,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-01-08 13:53:17,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-01-08 13:53:17,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-01-08 13:53:17,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-01-08 13:53:17,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-01-08 13:53:17,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-01-08 13:53:17,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-01-08 13:53:17,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-01-08 13:53:17,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-01-08 13:53:17,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-01-08 13:53:17,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-01-08 13:53:17,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-01-08 13:53:17,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-01-08 13:53:17,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-01-08 13:53:17,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-01-08 13:53:17,752 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.036420456916480846, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05450934083196113, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.036420456916480846, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17383333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23891666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-08 13:53:17,753 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-01-08 13:53:17,753 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17842793390950695, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.036420456916480846, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05450934083196113, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.036420456916480846, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17383333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23891666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-01-08 13:53:18,048 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 399 ms to try 5000 different iterations.  Found a solution that moves 2680 regions; Going from a computed imbalance of 0.17842793390950695 to a new imbalance of 0.013578789299852711. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020484224218301848); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03049534931700783, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29777777777777775, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020484224218301848); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010583333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.042166666666666665, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-08 13:53:18,062 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv205456943:77 , srv621329235:78 , srv910879660:79 , srv1338435548:82 , srv1553977756:82 , srv1678559298:82 , srv1204129627:83 , srv1220630380:83 , srv1270859852:83 , srv148243850:83 , srv1886556938:83 , srv1963096176:83 , srv2081661069:83 , srv29746868:83 , srv666957346:83 , srv926300088:83 , srv142929661:84 , srv1790100964:84 , srv1948980197:84 , srv2025110397:84 , srv206970900:84 , srv50476074:84 , srv540627865:84 , srv611033379:84 , srv839722567:84 , srv893808970:84 , srv90939997:84 , srv968718037:84 , srv1011286592:85 , srv1445792287:85 , srv1577607415:85 , srv1634042722:85 , srv1640106465:85 , srv1652408446:85 , srv1669606532:85 , srv1709284339:85 , srv1730518685:85 , srv1895572651:85 , srv1918158455:85 , srv1967505984:85 , srv569721394:85 , srv593269558:85 , srv700025113:85 , srv722709542:85 , srv743999989:85 , srv907693585:85 , srv1098441654:86 , srv1199611297:86 , srv1370431899:86 , srv1394710869:86 , srv1424277502:86 , srv1432274789:86 , srv14857202:86 , srv1643459493:86 , srv1758195764:86 , srv181938390:86 , srv1829571725:86 , srv1903072449:86 , srv2048210355:86 , srv2125991658:86 , srv242992320:86 , srv281347256:86 , srv354606878:86 , srv558978136:86 , srv712796668:86 , srv724547681:86 , srv742431273:86 , srv1085656725:87 , srv116619625:87 , srv1171577845:87 , srv1243851313:87 , srv1428983957:87 , srv1469601679:87 , srv1606963691:87 , srv1613769160:87 , srv1679193817:87 , srv1680640299:87 , srv1744359708:87 , srv1834153036:87 , srv1963562255:87 , srv1998688380:87 , srv2087524320:87 , srv286131172:87 , srv422562663:87 , srv815519141:87 , srv952441150:87 , srv1144057238:88 , srv1207153616:88 , srv1897703529:88 , srv479387516:88 , srv884459326:88 , srv924813635:88 , srv1320804015:89 , srv1581909332:89 , srv1618540015:89 , srv317979003:89 , srv623180298:89 , srv677181939:89 , srv815494029:89 , srv1924888311:542 }
2024-01-08 13:53:18,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-01-08 13:53:18,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1678559298=35, srv1270859852=11, srv1834153036=45, srv1709284339=38, srv815519141=89, srv1207153616=8, srv14857202=23, srv1634042722=30, srv666957346=80, srv1243851313=10, srv1144057238=3, srv540627865=73, srv1011286592=0, srv142929661=18, srv1320804015=12, srv1643459493=32, srv317979003=68, srv1758195764=41, srv1895572651=47, srv1903072449=49, srv952441150=98, srv1618540015=29, srv354606878=69, srv815494029=88, srv724547681=85, srv1394710869=15, srv926300088=97, srv1098441654=2, srv90939997=94, srv742431273=86, srv1886556938=46, srv29746868=67, srv1924888311=51, srv1948980197=52, srv1640106465=31, srv1744359708=40, srv148243850=22, srv1204129627=7, srv2048210355=58, srv2025110397=57, srv1553977756=24, srv1428983957=17, srv242992320=64, srv1679193817=36, srv1199611297=6, srv1220630380=9, srv1669606532=34, srv1730518685=39, srv623180298=79, srv286131172=66, srv2081661069=61, srv893808970=92, srv206970900=60, srv1963096176=53, srv1790100964=42, srv205456943=59, srv1432274789=19, srv1469601679=21, srv968718037=99, srv422562663=70, srv910879660=95, srv181938390=43, srv569721394=75, srv593269558=76, srv1998688380=56, srv558978136=74, srv924813635=96, srv1370431899=14, srv700025113=82, srv677181939=81, srv712796668=83, srv1918158455=50, srv907693585=93, srv884459326=91, srv1652408446=33, srv1606963691=27, srv1829571725=44, srv1424277502=16, srv1967505984=55, srv1085656725=1, srv50476074=72, srv1338435548=13, srv1680640299=37, srv1581909332=26, srv1963562255=54, srv2125991658=63, srv479387516=71, srv281347256=65, srv2087524320=62, srv1577607415=25, srv621329235=78, srv1897703529=48, srv1613769160=28, srv611033379=77, srv722709542=84, srv116619625=4, srv1445792287=20, srv839722567=90, srv743999989=87, srv1171577845=5} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-01-08 13:53:18,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-01-08 13:53:18,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-01-08 13:53:18,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-01-08 13:53:18,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-01-08 13:53:18,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-01-08 13:53:18,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-01-08 13:53:18,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-01-08 13:53:18,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-01-08 13:53:18,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-01-08 13:53:18,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-01-08 13:53:18,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-01-08 13:53:18,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-01-08 13:53:18,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-01-08 13:53:18,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-01-08 13:53:18,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-01-08 13:53:18,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-01-08 13:53:18,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-01-08 13:53:18,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-01-08 13:53:18,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-01-08 13:53:18,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-01-08 13:53:18,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-01-08 13:53:18,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-01-08 13:53:18,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-01-08 13:53:18,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-01-08 13:53:18,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-01-08 13:53:18,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-01-08 13:53:18,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-01-08 13:53:18,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-01-08 13:53:18,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-01-08 13:53:18,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-01-08 13:53:18,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-01-08 13:53:18,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-01-08 13:53:18,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-01-08 13:53:18,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-01-08 13:53:18,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-01-08 13:53:18,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-01-08 13:53:18,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-01-08 13:53:18,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-01-08 13:53:18,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-01-08 13:53:18,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-01-08 13:53:18,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-01-08 13:53:18,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-01-08 13:53:18,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-01-08 13:53:18,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-01-08 13:53:18,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-01-08 13:53:18,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-01-08 13:53:18,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-01-08 13:53:18,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-01-08 13:53:18,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-01-08 13:53:18,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-01-08 13:53:18,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-01-08 13:53:18,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-01-08 13:53:18,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-01-08 13:53:18,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-01-08 13:53:18,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-01-08 13:53:18,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-01-08 13:53:18,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-01-08 13:53:18,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-01-08 13:53:18,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-01-08 13:53:18,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-01-08 13:53:18,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-01-08 13:53:18,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-01-08 13:53:18,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-01-08 13:53:18,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-01-08 13:53:18,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-01-08 13:53:18,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-01-08 13:53:18,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-01-08 13:53:18,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-01-08 13:53:18,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-01-08 13:53:18,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-01-08 13:53:18,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-01-08 13:53:18,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-01-08 13:53:18,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-01-08 13:53:18,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-01-08 13:53:18,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-01-08 13:53:18,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-01-08 13:53:18,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-01-08 13:53:18,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-01-08 13:53:18,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-01-08 13:53:18,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-01-08 13:53:18,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-01-08 13:53:18,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-01-08 13:53:18,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-01-08 13:53:18,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-01-08 13:53:18,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-01-08 13:53:18,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-01-08 13:53:18,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-01-08 13:53:18,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-01-08 13:53:18,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-01-08 13:53:18,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-01-08 13:53:18,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-01-08 13:53:18,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-01-08 13:53:18,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-01-08 13:53:18,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-01-08 13:53:18,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-01-08 13:53:18,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-01-08 13:53:18,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-01-08 13:53:18,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-01-08 13:53:18,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-01-08 13:53:18,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-01-08 13:53:18,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-01-08 13:53:18,205 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020484224218301848); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03049534931700783, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020484224218301848); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010583333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.042166666666666665, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-08 13:53:18,205 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-01-08 13:53:18,205 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.013560023538764059, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020484224218301848); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03049534931700783, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020484224218301848); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010583333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.042166666666666665, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-01-08 13:53:18,433 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 326 ms to try 5000 different iterations.  Found a solution that moves 949 regions; Going from a computed imbalance of 0.013560023538764059 to a new imbalance of 5.584636567390362E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006776130873858127); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00867158627528677); MoveCostFunction : (multiplier=7.0, imbalance=0.10544444444444444, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006776130873858127); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0045); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-08 13:53:18,435 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1581909332:82 , srv1897703529:82 , srv317979003:82 , srv677181939:82 , srv1085656725:83 , srv1144057238:83 , srv1428983957:83 , srv1469601679:83 , srv14857202:83 , srv1618540015:83 , srv181938390:83 , srv1998688380:83 , srv2025110397:83 , srv593269558:83 , srv924813635:83 , srv1098441654:84 , srv1171577845:84 , srv1207153616:84 , srv1424277502:84 , srv1606963691:84 , srv1643459493:84 , srv1679193817:84 , srv1963096176:84 , srv1963562255:84 , srv2048210355:84 , srv712796668:84 , srv815494029:84 , srv839722567:84 , srv1320804015:85 , srv1370431899:85 , srv142929661:85 , srv1445792287:85 , srv1613769160:85 , srv1634042722:85 , srv1680640299:85 , srv1709284339:85 , srv1758195764:85 , srv1829571725:85 , srv1834153036:85 , srv1903072449:85 , srv2125991658:85 , srv242992320:85 , srv29746868:85 , srv422562663:85 , srv479387516:85 , srv558978136:85 , srv569721394:85 , srv623180298:85 , srv666957346:85 , srv742431273:85 , srv893808970:85 , srv1011286592:86 , srv1199611297:86 , srv1220630380:86 , srv1243851313:86 , srv1270859852:86 , srv1394710869:86 , srv148243850:86 , srv1553977756:86 , srv1577607415:86 , srv1669606532:86 , srv1678559298:86 , srv1790100964:86 , srv1886556938:86 , srv1895572651:86 , srv1967505984:86 , srv206970900:86 , srv2087524320:86 , srv281347256:86 , srv286131172:86 , srv354606878:86 , srv540627865:86 , srv611033379:86 , srv743999989:86 , srv815519141:86 , srv884459326:86 , srv907693585:86 , srv90939997:86 , srv926300088:86 , srv952441150:86 , srv968718037:86 , srv116619625:87 , srv1338435548:87 , srv1432274789:87 , srv1652408446:87 , srv1730518685:87 , srv1744359708:87 , srv1918158455:87 , srv1948980197:87 , srv205456943:87 , srv50476074:87 , srv621329235:87 , srv722709542:87 , srv724547681:87 , srv910879660:87 , srv1204129627:88 , srv1640106465:88 , srv2081661069:88 , srv700025113:88 , srv1924888311:562 }
2024-01-08 13:53:18,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-01-08 13:53:18,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1678559298=35, srv1270859852=11, srv1834153036=45, srv1709284339=38, srv815519141=89, srv1207153616=8, srv14857202=23, srv1634042722=30, srv666957346=80, srv1243851313=10, srv1144057238=3, srv540627865=73, srv1011286592=0, srv142929661=18, srv1320804015=12, srv1643459493=32, srv317979003=68, srv1758195764=41, srv1895572651=47, srv1903072449=49, srv952441150=98, srv1618540015=29, srv354606878=69, srv815494029=88, srv724547681=85, srv1394710869=15, srv926300088=97, srv1098441654=2, srv90939997=94, srv742431273=86, srv1886556938=46, srv29746868=67, srv1924888311=51, srv1948980197=52, srv1640106465=31, srv1744359708=40, srv148243850=22, srv1204129627=7, srv2048210355=58, srv2025110397=57, srv1553977756=24, srv1428983957=17, srv242992320=64, srv1679193817=36, srv1199611297=6, srv1220630380=9, srv1669606532=34, srv1730518685=39, srv623180298=79, srv286131172=66, srv2081661069=61, srv893808970=92, srv206970900=60, srv1963096176=53, srv1790100964=42, srv205456943=59, srv1432274789=19, srv1469601679=21, srv968718037=99, srv422562663=70, srv910879660=95, srv181938390=43, srv569721394=75, srv593269558=76, srv1998688380=56, srv558978136=74, srv924813635=96, srv1370431899=14, srv700025113=82, srv677181939=81, srv712796668=83, srv1918158455=50, srv907693585=93, srv884459326=91, srv1652408446=33, srv1606963691=27, srv1829571725=44, srv1424277502=16, srv1967505984=55, srv1085656725=1, srv50476074=72, srv1338435548=13, srv1680640299=37, srv1581909332=26, srv1963562255=54, srv2125991658=63, srv479387516=71, srv281347256=65, srv2087524320=62, srv1577607415=25, srv621329235=78, srv1897703529=48, srv1613769160=28, srv611033379=77, srv722709542=84, srv116619625=4, srv1445792287=20, srv839722567=90, srv743999989=87, srv1171577845=5} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-01-08 13:53:18,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-01-08 13:53:18,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-01-08 13:53:18,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-01-08 13:53:18,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-01-08 13:53:18,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-01-08 13:53:18,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-01-08 13:53:18,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-01-08 13:53:18,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-01-08 13:53:18,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-01-08 13:53:18,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-01-08 13:53:18,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-01-08 13:53:18,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-01-08 13:53:18,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-01-08 13:53:18,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-01-08 13:53:18,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-01-08 13:53:18,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-01-08 13:53:18,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-01-08 13:53:18,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-01-08 13:53:18,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-01-08 13:53:18,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-01-08 13:53:18,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-01-08 13:53:18,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-01-08 13:53:18,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-01-08 13:53:18,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-01-08 13:53:18,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-01-08 13:53:18,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-01-08 13:53:18,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-01-08 13:53:18,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-01-08 13:53:18,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-01-08 13:53:18,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-01-08 13:53:18,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-01-08 13:53:18,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-01-08 13:53:18,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-01-08 13:53:18,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-01-08 13:53:18,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-01-08 13:53:18,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-01-08 13:53:18,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-01-08 13:53:18,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-01-08 13:53:18,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-01-08 13:53:18,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-01-08 13:53:18,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-01-08 13:53:18,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-01-08 13:53:18,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-01-08 13:53:18,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-01-08 13:53:18,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-01-08 13:53:18,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-01-08 13:53:18,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-01-08 13:53:18,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-01-08 13:53:18,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-01-08 13:53:18,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-01-08 13:53:18,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-01-08 13:53:18,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-01-08 13:53:18,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-01-08 13:53:18,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-01-08 13:53:18,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-01-08 13:53:18,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-01-08 13:53:18,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-01-08 13:53:18,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-01-08 13:53:18,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-01-08 13:53:18,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-01-08 13:53:18,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-01-08 13:53:18,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-01-08 13:53:18,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-01-08 13:53:18,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-01-08 13:53:18,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-01-08 13:53:18,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-01-08 13:53:18,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-01-08 13:53:18,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-01-08 13:53:18,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-01-08 13:53:18,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-01-08 13:53:18,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-01-08 13:53:18,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-01-08 13:53:18,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-01-08 13:53:18,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-01-08 13:53:18,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-01-08 13:53:18,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-01-08 13:53:18,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-01-08 13:53:18,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-01-08 13:53:18,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-01-08 13:53:18,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-01-08 13:53:18,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-01-08 13:53:18,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-01-08 13:53:18,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-01-08 13:53:18,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-01-08 13:53:18,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-01-08 13:53:18,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-01-08 13:53:18,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-01-08 13:53:18,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-01-08 13:53:18,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-01-08 13:53:18,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-01-08 13:53:18,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-01-08 13:53:18,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-01-08 13:53:18,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-01-08 13:53:18,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-01-08 13:53:18,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-01-08 13:53:18,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-01-08 13:53:18,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-01-08 13:53:18,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-01-08 13:53:18,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-01-08 13:53:18,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-01-08 13:53:18,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-01-08 13:53:18,569 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006776130873858127); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00867158627528677); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006776130873858127); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0045); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-08 13:53:18,569 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-01-08 13:53:18,570 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=5.518186167117479E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006776130873858127); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00867158627528677); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006776130873858127); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0045); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-01-08 13:53:18,893 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 421 ms to try 5000 different iterations.  Found a solution that moves 253 regions; Going from a computed imbalance of 5.518186167117479E-4 to a new imbalance of 2.717000076318468E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.02811111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-08 13:53:18,894 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1320804015:83 , srv1581909332:83 , srv1948980197:83 , srv205456943:83 , srv422562663:83 , srv724547681:83 , srv742431273:83 , srv968718037:83 , srv116619625:84 , srv1199611297:84 , srv1204129627:84 , srv1270859852:84 , srv1338435548:84 , srv1428983957:84 , srv142929661:84 , srv1432274789:84 , srv148243850:84 , srv1618540015:84 , srv1640106465:84 , srv1730518685:84 , srv1744359708:84 , srv181938390:84 , srv1886556938:84 , srv1895572651:84 , srv1903072449:84 , srv1918158455:84 , srv1963562255:84 , srv206970900:84 , srv2081661069:84 , srv2125991658:84 , srv286131172:84 , srv354606878:84 , srv50476074:84 , srv558978136:84 , srv621329235:84 , srv700025113:84 , srv815494029:84 , srv884459326:84 , srv910879660:84 , srv1011286592:85 , srv1085656725:85 , srv1098441654:85 , srv1171577845:85 , srv1207153616:85 , srv1220630380:85 , srv1243851313:85 , srv1370431899:85 , srv1394710869:85 , srv1424277502:85 , srv1445792287:85 , srv14857202:85 , srv1553977756:85 , srv1577607415:85 , srv1606963691:85 , srv1613769160:85 , srv1634042722:85 , srv1643459493:85 , srv1652408446:85 , srv1669606532:85 , srv1679193817:85 , srv1680640299:85 , srv1709284339:85 , srv1790100964:85 , srv1829571725:85 , srv1834153036:85 , srv1897703529:85 , srv1963096176:85 , srv1967505984:85 , srv2048210355:85 , srv2087524320:85 , srv242992320:85 , srv281347256:85 , srv317979003:85 , srv479387516:85 , srv540627865:85 , srv593269558:85 , srv611033379:85 , srv623180298:85 , srv666957346:85 , srv677181939:85 , srv712796668:85 , srv722709542:85 , srv743999989:85 , srv815519141:85 , srv839722567:85 , srv893808970:85 , srv907693585:85 , srv90939997:85 , srv924813635:85 , srv926300088:85 , srv952441150:85 , srv1144057238:86 , srv1469601679:86 , srv1678559298:86 , srv1758195764:86 , srv1998688380:86 , srv2025110397:86 , srv29746868:86 , srv569721394:86 , srv1924888311:624 }
2024-01-08 13:53:18,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-01-08 13:53:18,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1678559298=35, srv1270859852=11, srv1834153036=45, srv1709284339=38, srv815519141=89, srv1207153616=8, srv14857202=23, srv1634042722=30, srv666957346=80, srv1243851313=10, srv1144057238=3, srv540627865=73, srv1011286592=0, srv142929661=18, srv1320804015=12, srv1643459493=32, srv317979003=68, srv1758195764=41, srv1895572651=47, srv1903072449=49, srv952441150=98, srv1618540015=29, srv354606878=69, srv815494029=88, srv724547681=85, srv1394710869=15, srv926300088=97, srv1098441654=2, srv90939997=94, srv742431273=86, srv1886556938=46, srv29746868=67, srv1924888311=51, srv1948980197=52, srv1640106465=31, srv1744359708=40, srv148243850=22, srv1204129627=7, srv2048210355=58, srv2025110397=57, srv1553977756=24, srv1428983957=17, srv242992320=64, srv1679193817=36, srv1199611297=6, srv1220630380=9, srv1669606532=34, srv1730518685=39, srv623180298=79, srv286131172=66, srv2081661069=61, srv893808970=92, srv206970900=60, srv1963096176=53, srv1790100964=42, srv205456943=59, srv1432274789=19, srv1469601679=21, srv968718037=99, srv422562663=70, srv910879660=95, srv181938390=43, srv569721394=75, srv593269558=76, srv1998688380=56, srv558978136=74, srv924813635=96, srv1370431899=14, srv700025113=82, srv677181939=81, srv712796668=83, srv1918158455=50, srv907693585=93, srv884459326=91, srv1652408446=33, srv1606963691=27, srv1829571725=44, srv1424277502=16, srv1967505984=55, srv1085656725=1, srv50476074=72, srv1338435548=13, srv1680640299=37, srv1581909332=26, srv1963562255=54, srv2125991658=63, srv479387516=71, srv281347256=65, srv2087524320=62, srv1577607415=25, srv621329235=78, srv1897703529=48, srv1613769160=28, srv611033379=77, srv722709542=84, srv116619625=4, srv1445792287=20, srv839722567=90, srv743999989=87, srv1171577845=5} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-01-08 13:53:18,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-01-08 13:53:18,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-01-08 13:53:18,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-01-08 13:53:18,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-01-08 13:53:18,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-01-08 13:53:18,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-01-08 13:53:18,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-01-08 13:53:18,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-01-08 13:53:18,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-01-08 13:53:18,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-01-08 13:53:18,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-01-08 13:53:18,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-01-08 13:53:18,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-01-08 13:53:18,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-01-08 13:53:18,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-01-08 13:53:18,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-01-08 13:53:18,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-01-08 13:53:18,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-01-08 13:53:18,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-01-08 13:53:18,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-01-08 13:53:18,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-01-08 13:53:18,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-01-08 13:53:18,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-01-08 13:53:18,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-01-08 13:53:18,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-01-08 13:53:18,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-01-08 13:53:18,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-01-08 13:53:18,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-01-08 13:53:18,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-01-08 13:53:18,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-01-08 13:53:18,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-01-08 13:53:18,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-01-08 13:53:18,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-01-08 13:53:18,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-01-08 13:53:18,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-01-08 13:53:18,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-01-08 13:53:18,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-01-08 13:53:18,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-01-08 13:53:18,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-01-08 13:53:18,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-01-08 13:53:18,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-01-08 13:53:18,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-01-08 13:53:18,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-01-08 13:53:18,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-01-08 13:53:18,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-01-08 13:53:18,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-01-08 13:53:18,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-01-08 13:53:18,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-01-08 13:53:18,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-01-08 13:53:18,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-01-08 13:53:18,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-01-08 13:53:18,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-01-08 13:53:18,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-01-08 13:53:18,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-01-08 13:53:18,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-01-08 13:53:18,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-01-08 13:53:18,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-01-08 13:53:18,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-01-08 13:53:18,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-01-08 13:53:18,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-01-08 13:53:18,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-01-08 13:53:18,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-01-08 13:53:18,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-01-08 13:53:18,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-01-08 13:53:18,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-01-08 13:53:18,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-01-08 13:53:18,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-01-08 13:53:18,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-01-08 13:53:18,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-01-08 13:53:18,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-01-08 13:53:18,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-01-08 13:53:18,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-01-08 13:53:18,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-01-08 13:53:18,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-01-08 13:53:18,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-01-08 13:53:18,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-01-08 13:53:18,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-01-08 13:53:18,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-01-08 13:53:18,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-01-08 13:53:18,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-01-08 13:53:18,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-01-08 13:53:18,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-01-08 13:53:18,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-01-08 13:53:18,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-01-08 13:53:18,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-01-08 13:53:18,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-01-08 13:53:18,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-01-08 13:53:18,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-01-08 13:53:18,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-01-08 13:53:18,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-01-08 13:53:18,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-01-08 13:53:18,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-01-08 13:53:18,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-01-08 13:53:18,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-01-08 13:53:18,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-01-08 13:53:18,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-01-08 13:53:18,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-01-08 13:53:18,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-01-08 13:53:18,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-01-08 13:53:18,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-01-08 13:53:18,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-01-08 13:53:19,026 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-08 13:53:19,026 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-01-08 13:53:19,026 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.539845689921844E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-01-08 13:53:19,243 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 321 ms to try 5000 different iterations.  Found a solution that moves 20 regions; Going from a computed imbalance of 2.539845689921844E-5 to a new imbalance of 7.213282289528359E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0022222222222222222); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-08 13:53:19,243 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1634042722:83 , srv1643459493:83 , srv1758195764:83 , srv1834153036:83 , srv2087524320:83 , srv29746868:83 , srv1011286592:84 , srv1085656725:84 , srv1098441654:84 , srv1144057238:84 , srv116619625:84 , srv1171577845:84 , srv1199611297:84 , srv1204129627:84 , srv1207153616:84 , srv1220630380:84 , srv1243851313:84 , srv1320804015:84 , srv1338435548:84 , srv1370431899:84 , srv1394710869:84 , srv1424277502:84 , srv1428983957:84 , srv142929661:84 , srv1432274789:84 , srv1445792287:84 , srv1469601679:84 , srv148243850:84 , srv14857202:84 , srv1553977756:84 , srv1577607415:84 , srv1581909332:84 , srv1606963691:84 , srv1613769160:84 , srv1618540015:84 , srv1640106465:84 , srv1652408446:84 , srv1669606532:84 , srv1678559298:84 , srv1679193817:84 , srv1680640299:84 , srv1709284339:84 , srv1730518685:84 , srv1744359708:84 , srv1790100964:84 , srv1829571725:84 , srv1886556938:84 , srv1895572651:84 , srv1897703529:84 , srv1918158455:84 , srv1963096176:84 , srv1963562255:84 , srv1967505984:84 , srv1998688380:84 , srv2025110397:84 , srv2048210355:84 , srv206970900:84 , srv2081661069:84 , srv2125991658:84 , srv242992320:84 , srv281347256:84 , srv286131172:84 , srv317979003:84 , srv354606878:84 , srv422562663:84 , srv479387516:84 , srv50476074:84 , srv540627865:84 , srv558978136:84 , srv569721394:84 , srv593269558:84 , srv611033379:84 , srv621329235:84 , srv623180298:84 , srv666957346:84 , srv677181939:84 , srv700025113:84 , srv712796668:84 , srv722709542:84 , srv724547681:84 , srv742431273:84 , srv743999989:84 , srv815494029:84 , srv815519141:84 , srv839722567:84 , srv884459326:84 , srv893808970:84 , srv907693585:84 , srv90939997:84 , srv910879660:84 , srv924813635:84 , srv926300088:84 , srv952441150:84 , srv1270859852:85 , srv181938390:85 , srv1903072449:85 , srv1948980197:85 , srv205456943:85 , srv968718037:85 , srv1924888311:684 }
2024-01-08 13:53:19,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-01-08 13:53:19,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1678559298=35, srv1270859852=11, srv1834153036=45, srv1709284339=38, srv815519141=89, srv1207153616=8, srv14857202=23, srv1634042722=30, srv666957346=80, srv1243851313=10, srv1144057238=3, srv540627865=73, srv1011286592=0, srv142929661=18, srv1320804015=12, srv1643459493=32, srv317979003=68, srv1758195764=41, srv1895572651=47, srv1903072449=49, srv952441150=98, srv1618540015=29, srv354606878=69, srv815494029=88, srv724547681=85, srv1394710869=15, srv926300088=97, srv1098441654=2, srv90939997=94, srv742431273=86, srv1886556938=46, srv29746868=67, srv1924888311=51, srv1948980197=52, srv1640106465=31, srv1744359708=40, srv148243850=22, srv1204129627=7, srv2048210355=58, srv2025110397=57, srv1553977756=24, srv1428983957=17, srv242992320=64, srv1679193817=36, srv1199611297=6, srv1220630380=9, srv1669606532=34, srv1730518685=39, srv623180298=79, srv286131172=66, srv2081661069=61, srv893808970=92, srv206970900=60, srv1963096176=53, srv1790100964=42, srv205456943=59, srv1432274789=19, srv1469601679=21, srv968718037=99, srv422562663=70, srv910879660=95, srv181938390=43, srv569721394=75, srv593269558=76, srv1998688380=56, srv558978136=74, srv924813635=96, srv1370431899=14, srv700025113=82, srv677181939=81, srv712796668=83, srv1918158455=50, srv907693585=93, srv884459326=91, srv1652408446=33, srv1606963691=27, srv1829571725=44, srv1424277502=16, srv1967505984=55, srv1085656725=1, srv50476074=72, srv1338435548=13, srv1680640299=37, srv1581909332=26, srv1963562255=54, srv2125991658=63, srv479387516=71, srv281347256=65, srv2087524320=62, srv1577607415=25, srv621329235=78, srv1897703529=48, srv1613769160=28, srv611033379=77, srv722709542=84, srv116619625=4, srv1445792287=20, srv839722567=90, srv743999989=87, srv1171577845=5} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-01-08 13:53:19,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-01-08 13:53:19,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-01-08 13:53:19,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-01-08 13:53:19,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-01-08 13:53:19,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-01-08 13:53:19,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-01-08 13:53:19,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-01-08 13:53:19,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-01-08 13:53:19,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-01-08 13:53:19,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-01-08 13:53:19,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-01-08 13:53:19,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-01-08 13:53:19,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-01-08 13:53:19,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-01-08 13:53:19,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-01-08 13:53:19,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-01-08 13:53:19,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-01-08 13:53:19,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-01-08 13:53:19,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-01-08 13:53:19,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-01-08 13:53:19,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-01-08 13:53:19,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-01-08 13:53:19,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-01-08 13:53:19,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-01-08 13:53:19,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-01-08 13:53:19,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-01-08 13:53:19,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-01-08 13:53:19,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-01-08 13:53:19,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-01-08 13:53:19,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-01-08 13:53:19,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-01-08 13:53:19,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-01-08 13:53:19,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-01-08 13:53:19,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-01-08 13:53:19,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-01-08 13:53:19,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-01-08 13:53:19,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-01-08 13:53:19,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-01-08 13:53:19,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-01-08 13:53:19,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-01-08 13:53:19,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-01-08 13:53:19,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-01-08 13:53:19,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-01-08 13:53:19,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-01-08 13:53:19,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-01-08 13:53:19,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-01-08 13:53:19,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-01-08 13:53:19,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-01-08 13:53:19,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-01-08 13:53:19,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-01-08 13:53:19,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-01-08 13:53:19,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-01-08 13:53:19,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-01-08 13:53:19,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-01-08 13:53:19,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-01-08 13:53:19,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-01-08 13:53:19,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-01-08 13:53:19,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-01-08 13:53:19,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-01-08 13:53:19,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-01-08 13:53:19,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-01-08 13:53:19,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-01-08 13:53:19,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-01-08 13:53:19,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-01-08 13:53:19,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-01-08 13:53:19,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-01-08 13:53:19,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-01-08 13:53:19,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-01-08 13:53:19,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-01-08 13:53:19,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-01-08 13:53:19,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-01-08 13:53:19,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-01-08 13:53:19,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-01-08 13:53:19,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-01-08 13:53:19,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-01-08 13:53:19,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-01-08 13:53:19,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-01-08 13:53:19,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-01-08 13:53:19,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-01-08 13:53:19,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-01-08 13:53:19,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-01-08 13:53:19,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-01-08 13:53:19,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-01-08 13:53:19,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-01-08 13:53:19,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-01-08 13:53:19,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-01-08 13:53:19,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-01-08 13:53:19,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-01-08 13:53:19,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-01-08 13:53:19,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-01-08 13:53:19,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-01-08 13:53:19,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-01-08 13:53:19,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-01-08 13:53:19,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-01-08 13:53:19,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-01-08 13:53:19,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-01-08 13:53:19,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-01-08 13:53:19,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-01-08 13:53:19,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-01-08 13:53:19,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-01-08 13:53:19,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-01-08 13:53:19,368 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.073239296329447E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-08 13:53:19,368 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1634042722:83 , srv1643459493:83 , srv1758195764:83 , srv1834153036:83 , srv2087524320:83 , srv29746868:83 , srv1011286592:84 , srv1085656725:84 , srv1098441654:84 , srv1144057238:84 , srv116619625:84 , srv1171577845:84 , srv1199611297:84 , srv1204129627:84 , srv1207153616:84 , srv1220630380:84 , srv1243851313:84 , srv1320804015:84 , srv1338435548:84 , srv1370431899:84 , srv1394710869:84 , srv1424277502:84 , srv1428983957:84 , srv142929661:84 , srv1432274789:84 , srv1445792287:84 , srv1469601679:84 , srv148243850:84 , srv14857202:84 , srv1553977756:84 , srv1577607415:84 , srv1581909332:84 , srv1606963691:84 , srv1613769160:84 , srv1618540015:84 , srv1640106465:84 , srv1652408446:84 , srv1669606532:84 , srv1678559298:84 , srv1679193817:84 , srv1680640299:84 , srv1709284339:84 , srv1730518685:84 , srv1744359708:84 , srv1790100964:84 , srv1829571725:84 , srv1886556938:84 , srv1895572651:84 , srv1897703529:84 , srv1918158455:84 , srv1963096176:84 , srv1963562255:84 , srv1967505984:84 , srv1998688380:84 , srv2025110397:84 , srv2048210355:84 , srv206970900:84 , srv2081661069:84 , srv2125991658:84 , srv242992320:84 , srv281347256:84 , srv286131172:84 , srv317979003:84 , srv354606878:84 , srv422562663:84 , srv479387516:84 , srv50476074:84 , srv540627865:84 , srv558978136:84 , srv569721394:84 , srv593269558:84 , srv611033379:84 , srv621329235:84 , srv623180298:84 , srv666957346:84 , srv677181939:84 , srv700025113:84 , srv712796668:84 , srv722709542:84 , srv724547681:84 , srv742431273:84 , srv743999989:84 , srv815494029:84 , srv815519141:84 , srv839722567:84 , srv884459326:84 , srv893808970:84 , srv907693585:84 , srv90939997:84 , srv910879660:84 , srv924813635:84 , srv926300088:84 , srv952441150:84 , srv1270859852:85 , srv181938390:85 , srv1903072449:85 , srv1948980197:85 , srv205456943:85 , srv968718037:85 , srv1924888311:684 }
2024-01-08 13:53:19,392 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=280 (was 287), ProcessCount=168 (was 168), AvailableMemoryMB=10527 (was 11132)
2024-01-08 13:53:19,399 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=280, ProcessCount=168, AvailableMemoryMB=10526
2024-01-08 13:53:19,400 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-01-08 13:53:19,400 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2024-01-08 13:53:19,413 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1059657377:84 , srv111729833:84 , srv111969409:84 , srv1249335225:84 , srv1377159190:84 , srv1520327383:84 , srv1659491886:84 , srv1687124996:84 , srv1723667931:84 , srv1769074437:84 , srv1913598333:84 , srv1920371346:84 , srv2005346642:84 , srv2043379221:84 , srv2052673717:84 , srv2102518679:84 , srv286584558:84 , srv345458423:84 , srv467982775:84 , srv492278358:84 , srv516270751:84 , srv574569583:84 , srv583038504:84 , srv667314665:84 , srv692202632:84 , srv755904122:84 , srv974557281:84 , srv975147303:84 , srv97682290:84 , srv1122477676:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2024-01-08 13:53:19,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-01-08 13:53:19,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1122477676=3, srv1377159190=5, srv583038504=23, srv667314665=24, srv97682290=29, srv692202632=25, srv1687124996=8, srv345458423=18, srv1913598333=11, srv975147303=28, srv1659491886=7, srv1920371346=12, srv111969409=2, srv1249335225=4, srv574569583=22, srv2043379221=14, srv1059657377=0, srv1769074437=10, srv974557281=27, srv755904122=26, srv492278358=20, srv1723667931=9, srv467982775=19, srv111729833=1, srv1520327383=6, srv286584558=17, srv516270751=21, srv2052673717=15, srv2102518679=16, srv2005346642=13} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-01-08 13:53:19,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-01-08 13:53:19,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-01-08 13:53:19,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-01-08 13:53:19,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-01-08 13:53:19,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-01-08 13:53:19,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-01-08 13:53:19,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-01-08 13:53:19,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-01-08 13:53:19,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-01-08 13:53:19,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-01-08 13:53:19,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-01-08 13:53:19,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-01-08 13:53:19,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-01-08 13:53:19,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-01-08 13:53:19,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-01-08 13:53:19,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-01-08 13:53:19,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-01-08 13:53:19,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-01-08 13:53:19,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-01-08 13:53:19,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-01-08 13:53:19,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-01-08 13:53:19,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-01-08 13:53:19,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-01-08 13:53:19,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-01-08 13:53:19,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-01-08 13:53:19,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-01-08 13:53:19,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-01-08 13:53:19,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-01-08 13:53:19,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-01-08 13:53:19,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-01-08 13:53:19,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-01-08 13:53:19,456 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.196501954720328, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-08 13:53:19,457 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912812214507223, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.196501954720328, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2024-01-08 13:55:19,434 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6220174 different iterations.  Found a solution that moves 1859 regions; Going from a computed imbalance of 0.9912812214507223 to a new imbalance of 4.338998739279625E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6885185185185185, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-08 13:55:19,441 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1059657377:90 , srv111729833:90 , srv111969409:90 , srv1122477676:90 , srv1249335225:90 , srv1377159190:90 , srv1520327383:90 , srv1659491886:90 , srv1687124996:90 , srv1723667931:90 , srv1769074437:90 , srv1913598333:90 , srv1920371346:90 , srv2005346642:90 , srv2043379221:90 , srv2052673717:90 , srv2102518679:90 , srv286584558:90 , srv345458423:90 , srv467982775:90 , srv492278358:90 , srv516270751:90 , srv574569583:90 , srv583038504:90 , srv667314665:90 , srv692202632:90 , srv755904122:90 , srv974557281:90 , srv975147303:90 , srv97682290:90 }
2024-01-08 13:55:19,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-01-08 13:55:19,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1122477676=3, srv1377159190=5, srv583038504=23, srv667314665=24, srv97682290=29, srv692202632=25, srv1687124996=8, srv345458423=18, srv1913598333=11, srv975147303=28, srv1659491886=7, srv1920371346=12, srv111969409=2, srv1249335225=4, srv574569583=22, srv2043379221=14, srv1059657377=0, srv1769074437=10, srv974557281=27, srv755904122=26, srv492278358=20, srv1723667931=9, srv467982775=19, srv111729833=1, srv1520327383=6, srv286584558=17, srv516270751=21, srv2052673717=15, srv2102518679=16, srv2005346642=13} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-01-08 13:55:19,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-01-08 13:55:19,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-01-08 13:55:19,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-01-08 13:55:19,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-01-08 13:55:19,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-01-08 13:55:19,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-01-08 13:55:19,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-01-08 13:55:19,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-01-08 13:55:19,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-01-08 13:55:19,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-01-08 13:55:19,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-01-08 13:55:19,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-01-08 13:55:19,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-01-08 13:55:19,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-01-08 13:55:19,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-01-08 13:55:19,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-01-08 13:55:19,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-01-08 13:55:19,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-01-08 13:55:19,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-01-08 13:55:19,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-01-08 13:55:19,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-01-08 13:55:19,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-01-08 13:55:19,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-01-08 13:55:19,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-01-08 13:55:19,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-01-08 13:55:19,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-01-08 13:55:19,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-01-08 13:55:19,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-01-08 13:55:19,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-01-08 13:55:19,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-01-08 13:55:19,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-01-08 13:55:19,463 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-08 13:55:19,464 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1059657377:90 , srv111729833:90 , srv111969409:90 , srv1122477676:90 , srv1249335225:90 , srv1377159190:90 , srv1520327383:90 , srv1659491886:90 , srv1687124996:90 , srv1723667931:90 , srv1769074437:90 , srv1913598333:90 , srv1920371346:90 , srv2005346642:90 , srv2043379221:90 , srv2052673717:90 , srv2102518679:90 , srv286584558:90 , srv345458423:90 , srv467982775:90 , srv492278358:90 , srv516270751:90 , srv574569583:90 , srv583038504:90 , srv667314665:90 , srv692202632:90 , srv755904122:90 , srv974557281:90 , srv975147303:90 , srv97682290:90 }
2024-01-08 13:55:19,476 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=179 (was 280), ProcessCount=167 (was 168), AvailableMemoryMB=10009 (was 10526)