2024-01-12 00:53:16,199 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2024-01-12 00:53:16,530 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2024-01-12 00:53:16,644 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2024-01-12 00:53:16,711 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-01-12 00:53:16,718 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-01-12 00:53:16,734 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=270, ProcessCount=167, AvailableMemoryMB=5643
2024-01-12 00:53:16,736 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-01-12 00:53:16,736 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-01-12 00:53:16,864 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv100003479:84 , srv1007330034:84 , srv1038371821:84 , srv1041196209:84 , srv1050179960:84 , srv105647069:84 , srv1061614083:84 , srv1065408055:84 , srv1088157759:84 , srv113608867:84 , srv1159179891:84 , srv1167250522:84 , srv1202682880:84 , srv1208030063:84 , srv1233572190:84 , srv1333208922:84 , srv1376983795:84 , srv137743513:84 , srv138385819:84 , srv1383994212:84 , srv1401910200:84 , srv1409893727:84 , srv143370682:84 , srv1438972919:84 , srv1458249604:84 , srv1514997897:84 , srv1516912827:84 , srv1560655606:84 , srv156741662:84 , srv1571230506:84 , srv1575507527:84 , srv160779179:84 , srv1616801326:84 , srv1658452329:84 , srv1666928789:84 , srv1674653169:84 , srv1684745084:84 , srv1685207396:84 , srv1704851181:84 , srv1717170122:84 , srv1743856763:84 , srv1756465138:84 , srv1760391015:84 , srv1778086725:84 , srv1804243969:84 , srv181520929:84 , srv1832417624:84 , srv1886299656:84 , srv1887805650:84 , srv1924658647:84 , srv1927638579:84 , srv1946143904:84 , srv1981765218:84 , srv1988558144:84 , srv1989405869:84 , srv2012260209:84 , srv2026133167:84 , srv2038070926:84 , srv2054543354:84 , srv2073465772:84 , srv2078982632:84 , srv2089438893:84 , srv221279152:84 , srv259355488:84 , srv270047392:84 , srv287772185:84 , srv312808312:84 , srv321595032:84 , srv350978349:84 , srv359745042:84 , srv37270623:84 , srv37862716:84 , srv405912163:84 , srv416104250:84 , srv464758319:84 , srv519328222:84 , srv529988941:84 , srv556340697:84 , srv572440582:84 , srv575279058:84 , srv586246885:84 , srv659768870:84 , srv664036885:84 , srv674474162:84 , srv674848624:84 , srv678867300:84 , srv724843662:84 , srv795493483:84 , srv81136344:84 , srv852729558:84 , srv865317286:84 , srv885039482:84 , srv897653301:84 , srv899779592:84 , srv950878020:84 , srv958019374:84 , srv968968485:84 , srv979878311:84 , srv990271565:84 , srv1888150908:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2024-01-12 00:53:16,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-01-12 00:53:16,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1065408055=7, srv885039482=92, srv1571230506=29, srv1743856763=40, srv350978349=69, srv950878020=95, srv1202682880=12, srv1685207396=37, srv160779179=31, srv958019374=96, srv575279058=80, srv464758319=75, srv968968485=97, srv664036885=83, srv1832417624=46, srv321595032=68, srv1333208922=15, srv519328222=76, srv1684745084=36, srv1007330034=1, srv1438972919=23, srv113608867=9, srv1061614083=6, srv1704851181=38, srv1717170122=39, srv659768870=82, srv724843662=87, srv572440582=79, srv1616801326=32, srv2073465772=60, srv979878311=98, srv1409893727=21, srv312808312=67, srv1560655606=27, srv678867300=86, srv556340697=78, srv37270623=71, srv529988941=77, srv2038070926=58, srv674848624=85, srv1376983795=16, srv1946143904=52, srv865317286=91, srv137743513=17, srv143370682=22, srv2078982632=61, srv897653301=93, srv1989405869=55, srv270047392=65, srv156741662=28, srv37862716=72, srv1674653169=35, srv2089438893=62, srv1088157759=8, srv1458249604=24, srv1050179960=4, srv1887805650=48, srv899779592=94, srv1760391015=42, srv1208030063=13, srv1658452329=33, srv1981765218=53, srv1401910200=20, srv81136344=89, srv1575507527=30, srv2012260209=56, srv2054543354=59, srv359745042=70, srv1038371821=2, srv138385819=18, srv795493483=88, srv1516912827=26, srv1159179891=10, srv1778086725=43, srv181520929=45, srv287772185=66, srv100003479=0, srv221279152=63, srv259355488=64, srv416104250=74, srv674474162=84, srv586246885=81, srv852729558=90, srv990271565=99, srv1756465138=41, srv405912163=73, srv1383994212=19, srv1804243969=44, srv2026133167=57, srv1233572190=14, srv1514997897=25, srv1886299656=47, srv1041196209=3, srv1927638579=51, srv105647069=5, srv1167250522=11, srv1888150908=49, srv1924658647=50, srv1666928789=34, srv1988558144=54} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-01-12 00:53:16,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-01-12 00:53:16,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-01-12 00:53:16,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-01-12 00:53:16,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-01-12 00:53:16,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-01-12 00:53:16,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-01-12 00:53:16,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-01-12 00:53:16,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-01-12 00:53:16,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-01-12 00:53:16,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-01-12 00:53:16,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-01-12 00:53:16,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-01-12 00:53:16,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-01-12 00:53:16,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-01-12 00:53:16,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-01-12 00:53:16,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-01-12 00:53:16,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-01-12 00:53:16,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-01-12 00:53:16,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-01-12 00:53:16,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-01-12 00:53:16,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-01-12 00:53:16,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-01-12 00:53:16,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-01-12 00:53:16,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-01-12 00:53:16,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-01-12 00:53:16,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-01-12 00:53:16,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-01-12 00:53:16,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-01-12 00:53:16,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-01-12 00:53:16,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-01-12 00:53:16,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-01-12 00:53:16,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-01-12 00:53:16,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-01-12 00:53:16,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-01-12 00:53:16,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-01-12 00:53:16,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-01-12 00:53:16,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-01-12 00:53:16,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-01-12 00:53:16,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-01-12 00:53:16,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-01-12 00:53:16,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-01-12 00:53:16,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-01-12 00:53:16,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-01-12 00:53:16,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-01-12 00:53:16,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-01-12 00:53:16,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-01-12 00:53:16,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-01-12 00:53:16,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-01-12 00:53:16,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-01-12 00:53:16,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-01-12 00:53:16,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-01-12 00:53:16,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-01-12 00:53:16,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-01-12 00:53:16,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-01-12 00:53:16,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-01-12 00:53:16,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-01-12 00:53:16,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-01-12 00:53:16,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-01-12 00:53:16,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-01-12 00:53:16,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-01-12 00:53:16,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-01-12 00:53:16,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-01-12 00:53:16,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-01-12 00:53:16,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-01-12 00:53:16,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-01-12 00:53:16,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-01-12 00:53:16,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-01-12 00:53:16,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-01-12 00:53:16,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-01-12 00:53:16,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-01-12 00:53:16,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-01-12 00:53:16,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-01-12 00:53:16,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-01-12 00:53:16,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-01-12 00:53:16,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-01-12 00:53:16,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-01-12 00:53:16,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-01-12 00:53:16,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-01-12 00:53:16,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-01-12 00:53:16,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-01-12 00:53:16,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-01-12 00:53:16,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-01-12 00:53:16,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-01-12 00:53:16,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-01-12 00:53:16,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-01-12 00:53:16,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-01-12 00:53:16,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-01-12 00:53:16,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-01-12 00:53:16,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-01-12 00:53:16,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-01-12 00:53:16,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-01-12 00:53:16,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-01-12 00:53:16,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-01-12 00:53:16,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-01-12 00:53:16,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-01-12 00:53:16,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-01-12 00:53:16,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-01-12 00:53:16,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-01-12 00:53:16,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-01-12 00:53:16,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-01-12 00:53:16,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-01-12 00:53:17,204 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-12 00:53:17,205 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-01-12 00:53:17,205 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-01-12 00:53:17,558 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 540 ms to try 5000 different iterations.  Found a solution that moves 4655 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18356572350457925. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.045433440667246375, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.060671513477901756, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5172222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.045433440667246375, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17925, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24066666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-12 00:53:17,572 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1088157759:82 , srv1167250522:82 , srv181520929:82 , srv1927638579:82 , srv312808312:82 , srv350978349:82 , srv1041196209:83 , srv1233572190:83 , srv1383994212:83 , srv1886299656:83 , srv1946143904:83 , srv2038070926:83 , srv2073465772:83 , srv464758319:83 , srv572440582:83 , srv659768870:83 , srv968968485:83 , srv1065408055:84 , srv1208030063:84 , srv1333208922:84 , srv1401910200:84 , srv1560655606:84 , srv160779179:84 , srv2078982632:84 , srv359745042:84 , srv37270623:84 , srv556340697:84 , srv575279058:84 , srv678867300:84 , srv724843662:84 , srv950878020:84 , srv958019374:84 , srv1050179960:85 , srv113608867:85 , srv1376983795:85 , srv143370682:85 , srv1458249604:85 , srv1616801326:85 , srv1666928789:85 , srv1674653169:85 , srv1685207396:85 , srv1778086725:85 , srv1832417624:85 , srv2012260209:85 , srv2054543354:85 , srv2089438893:85 , srv259355488:85 , srv586246885:85 , srv674848624:85 , srv100003479:86 , srv1516912827:86 , srv1575507527:86 , srv1704851181:86 , srv1743856763:86 , srv1756465138:86 , srv1924658647:86 , srv416104250:86 , srv519328222:86 , srv664036885:86 , srv795493483:86 , srv897653301:86 , srv990271565:86 , srv1007330034:87 , srv1061614083:87 , srv1409893727:87 , srv1438972919:87 , srv1658452329:87 , srv1717170122:87 , srv1988558144:87 , srv405912163:87 , srv529988941:87 , srv674474162:87 , srv81136344:87 , srv885039482:87 , srv1038371821:88 , srv105647069:88 , srv137743513:88 , srv1571230506:88 , srv1760391015:88 , srv1887805650:88 , srv221279152:88 , srv321595032:88 , srv37862716:88 , srv865317286:88 , srv899779592:88 , srv979878311:88 , srv1159179891:89 , srv1684745084:89 , srv1804243969:89 , srv2026133167:89 , srv287772185:89 , srv1202682880:90 , srv138385819:90 , srv852729558:90 , srv156741662:91 , srv1981765218:91 , srv1989405869:91 , srv270047392:94 , srv1514997897:96 , srv1888150908:494 }
2024-01-12 00:53:17,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-01-12 00:53:17,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1065408055=7, srv885039482=92, srv1571230506=29, srv1743856763=40, srv350978349=69, srv950878020=95, srv1202682880=12, srv1685207396=37, srv160779179=31, srv958019374=96, srv575279058=80, srv464758319=75, srv968968485=97, srv664036885=83, srv1832417624=46, srv321595032=68, srv1333208922=15, srv519328222=76, srv1684745084=36, srv1007330034=1, srv1438972919=23, srv113608867=9, srv1061614083=6, srv1704851181=38, srv1717170122=39, srv659768870=82, srv724843662=87, srv572440582=79, srv1616801326=32, srv2073465772=60, srv979878311=98, srv1409893727=21, srv312808312=67, srv1560655606=27, srv678867300=86, srv556340697=78, srv37270623=71, srv529988941=77, srv2038070926=58, srv674848624=85, srv1376983795=16, srv1946143904=52, srv865317286=91, srv137743513=17, srv143370682=22, srv2078982632=61, srv897653301=93, srv1989405869=55, srv270047392=65, srv156741662=28, srv37862716=72, srv1674653169=35, srv2089438893=62, srv1088157759=8, srv1458249604=24, srv1050179960=4, srv1887805650=48, srv899779592=94, srv1760391015=42, srv1208030063=13, srv1658452329=33, srv1981765218=53, srv1401910200=20, srv81136344=89, srv1575507527=30, srv2012260209=56, srv2054543354=59, srv359745042=70, srv1038371821=2, srv138385819=18, srv795493483=88, srv1516912827=26, srv1159179891=10, srv1778086725=43, srv181520929=45, srv287772185=66, srv100003479=0, srv221279152=63, srv259355488=64, srv416104250=74, srv674474162=84, srv586246885=81, srv852729558=90, srv990271565=99, srv1756465138=41, srv405912163=73, srv1383994212=19, srv1804243969=44, srv2026133167=57, srv1233572190=14, srv1514997897=25, srv1886299656=47, srv1041196209=3, srv1927638579=51, srv105647069=5, srv1167250522=11, srv1888150908=49, srv1924658647=50, srv1666928789=34, srv1988558144=54} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-01-12 00:53:17,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-01-12 00:53:17,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-01-12 00:53:17,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-01-12 00:53:17,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-01-12 00:53:17,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-01-12 00:53:17,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-01-12 00:53:17,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-01-12 00:53:17,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-01-12 00:53:17,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-01-12 00:53:17,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-01-12 00:53:17,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-01-12 00:53:17,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-01-12 00:53:17,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-01-12 00:53:17,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-01-12 00:53:17,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-01-12 00:53:17,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-01-12 00:53:17,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-01-12 00:53:17,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-01-12 00:53:17,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-01-12 00:53:17,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-01-12 00:53:17,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-01-12 00:53:17,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-01-12 00:53:17,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-01-12 00:53:17,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-01-12 00:53:17,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-01-12 00:53:17,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-01-12 00:53:17,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-01-12 00:53:17,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-01-12 00:53:17,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-01-12 00:53:17,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-01-12 00:53:17,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-01-12 00:53:17,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-01-12 00:53:17,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-01-12 00:53:17,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-01-12 00:53:17,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-01-12 00:53:17,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-01-12 00:53:17,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-01-12 00:53:17,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-01-12 00:53:17,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-01-12 00:53:17,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-01-12 00:53:17,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-01-12 00:53:17,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-01-12 00:53:17,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-01-12 00:53:17,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-01-12 00:53:17,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-01-12 00:53:17,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-01-12 00:53:17,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-01-12 00:53:17,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-01-12 00:53:17,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-01-12 00:53:17,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-01-12 00:53:17,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-01-12 00:53:17,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-01-12 00:53:17,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-01-12 00:53:17,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-01-12 00:53:17,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-01-12 00:53:17,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-01-12 00:53:17,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-01-12 00:53:17,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-01-12 00:53:17,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-01-12 00:53:17,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-01-12 00:53:17,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-01-12 00:53:17,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-01-12 00:53:17,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-01-12 00:53:17,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-01-12 00:53:17,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-01-12 00:53:17,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-01-12 00:53:17,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-01-12 00:53:17,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-01-12 00:53:17,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-01-12 00:53:17,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-01-12 00:53:17,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-01-12 00:53:17,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-01-12 00:53:17,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-01-12 00:53:17,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-01-12 00:53:17,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-01-12 00:53:17,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-01-12 00:53:17,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-01-12 00:53:17,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-01-12 00:53:17,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-01-12 00:53:17,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-01-12 00:53:17,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-01-12 00:53:17,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-01-12 00:53:17,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-01-12 00:53:17,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-01-12 00:53:17,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-01-12 00:53:17,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-01-12 00:53:17,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-01-12 00:53:17,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-01-12 00:53:17,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-01-12 00:53:17,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-01-12 00:53:17,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-01-12 00:53:17,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-01-12 00:53:17,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-01-12 00:53:17,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-01-12 00:53:17,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-01-12 00:53:17,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-01-12 00:53:17,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-01-12 00:53:17,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-01-12 00:53:17,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-01-12 00:53:17,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-01-12 00:53:17,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-01-12 00:53:17,777 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.045433440667246375, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.060671513477901756, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.045433440667246375, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17925, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24066666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-12 00:53:17,777 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-01-12 00:53:17,777 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.1835331284979122, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.045433440667246375, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.060671513477901756, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.045433440667246375, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17925, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24066666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-01-12 00:53:18,047 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 417 ms to try 5000 different iterations.  Found a solution that moves 2617 regions; Going from a computed imbalance of 0.1835331284979122 to a new imbalance of 0.017129452640934656. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.027774859554904597, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03825310004822698, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2907777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.027774859554904597, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0475, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-12 00:53:18,058 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv270047392:75 , srv1514997897:78 , srv1989405869:79 , srv1202682880:80 , srv105647069:81 , srv138385819:81 , srv1981765218:81 , srv287772185:81 , srv37862716:81 , srv1159179891:82 , srv1684745084:82 , srv852729558:82 , srv1007330034:83 , srv1438972919:83 , srv156741662:83 , srv1717170122:83 , srv405912163:83 , srv899779592:83 , srv100003479:84 , srv1038371821:84 , srv1376983795:84 , srv137743513:84 , srv1571230506:84 , srv1575507527:84 , srv1704851181:84 , srv1756465138:84 , srv1778086725:84 , srv1887805650:84 , srv1924658647:84 , srv2026133167:84 , srv2089438893:84 , srv321595032:84 , srv529988941:84 , srv674474162:84 , srv674848624:84 , srv795493483:84 , srv865317286:84 , srv885039482:84 , srv1458249604:85 , srv1743856763:85 , srv1760391015:85 , srv1804243969:85 , srv1832417624:85 , srv1988558144:85 , srv221279152:85 , srv259355488:85 , srv416104250:85 , srv81136344:85 , srv897653301:85 , srv958019374:85 , srv1050179960:86 , srv1065408055:86 , srv1333208922:86 , srv1401910200:86 , srv1409893727:86 , srv143370682:86 , srv1560655606:86 , srv1666928789:86 , srv1674653169:86 , srv2012260209:86 , srv2054543354:86 , srv556340697:86 , srv979878311:86 , srv990271565:86 , srv1061614083:87 , srv1616801326:87 , srv664036885:87 , srv678867300:87 , srv950878020:87 , srv113608867:88 , srv1208030063:88 , srv160779179:88 , srv2078982632:88 , srv312808312:88 , srv359745042:88 , srv519328222:88 , srv575279058:88 , srv724843662:88 , srv1041196209:89 , srv1167250522:89 , srv1383994212:89 , srv1516912827:89 , srv1658452329:89 , srv1886299656:89 , srv1946143904:89 , srv2073465772:89 , srv37270623:89 , srv659768870:89 , srv968968485:89 , srv1088157759:90 , srv1233572190:90 , srv1685207396:90 , srv181520929:90 , srv2038070926:90 , srv350978349:90 , srv464758319:90 , srv586246885:90 , srv1927638579:91 , srv572440582:91 , srv1888150908:527 }
2024-01-12 00:53:18,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-01-12 00:53:18,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1065408055=7, srv885039482=92, srv1571230506=29, srv1743856763=40, srv350978349=69, srv950878020=95, srv1202682880=12, srv1685207396=37, srv160779179=31, srv958019374=96, srv575279058=80, srv464758319=75, srv968968485=97, srv664036885=83, srv1832417624=46, srv321595032=68, srv1333208922=15, srv519328222=76, srv1684745084=36, srv1007330034=1, srv1438972919=23, srv113608867=9, srv1061614083=6, srv1704851181=38, srv1717170122=39, srv659768870=82, srv724843662=87, srv572440582=79, srv1616801326=32, srv2073465772=60, srv979878311=98, srv1409893727=21, srv312808312=67, srv1560655606=27, srv678867300=86, srv556340697=78, srv37270623=71, srv529988941=77, srv2038070926=58, srv674848624=85, srv1376983795=16, srv1946143904=52, srv865317286=91, srv137743513=17, srv143370682=22, srv2078982632=61, srv897653301=93, srv1989405869=55, srv270047392=65, srv156741662=28, srv37862716=72, srv1674653169=35, srv2089438893=62, srv1088157759=8, srv1458249604=24, srv1050179960=4, srv1887805650=48, srv899779592=94, srv1760391015=42, srv1208030063=13, srv1658452329=33, srv1981765218=53, srv1401910200=20, srv81136344=89, srv1575507527=30, srv2012260209=56, srv2054543354=59, srv359745042=70, srv1038371821=2, srv138385819=18, srv795493483=88, srv1516912827=26, srv1159179891=10, srv1778086725=43, srv181520929=45, srv287772185=66, srv100003479=0, srv221279152=63, srv259355488=64, srv416104250=74, srv674474162=84, srv586246885=81, srv852729558=90, srv990271565=99, srv1756465138=41, srv405912163=73, srv1383994212=19, srv1804243969=44, srv2026133167=57, srv1233572190=14, srv1514997897=25, srv1886299656=47, srv1041196209=3, srv1927638579=51, srv105647069=5, srv1167250522=11, srv1888150908=49, srv1924658647=50, srv1666928789=34, srv1988558144=54} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-01-12 00:53:18,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-01-12 00:53:18,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-01-12 00:53:18,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-01-12 00:53:18,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-01-12 00:53:18,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-01-12 00:53:18,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-01-12 00:53:18,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-01-12 00:53:18,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-01-12 00:53:18,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-01-12 00:53:18,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-01-12 00:53:18,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-01-12 00:53:18,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-01-12 00:53:18,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-01-12 00:53:18,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-01-12 00:53:18,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-01-12 00:53:18,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-01-12 00:53:18,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-01-12 00:53:18,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-01-12 00:53:18,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-01-12 00:53:18,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-01-12 00:53:18,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-01-12 00:53:18,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-01-12 00:53:18,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-01-12 00:53:18,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-01-12 00:53:18,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-01-12 00:53:18,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-01-12 00:53:18,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-01-12 00:53:18,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-01-12 00:53:18,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-01-12 00:53:18,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-01-12 00:53:18,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-01-12 00:53:18,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-01-12 00:53:18,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-01-12 00:53:18,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-01-12 00:53:18,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-01-12 00:53:18,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-01-12 00:53:18,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-01-12 00:53:18,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-01-12 00:53:18,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-01-12 00:53:18,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-01-12 00:53:18,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-01-12 00:53:18,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-01-12 00:53:18,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-01-12 00:53:18,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-01-12 00:53:18,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-01-12 00:53:18,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-01-12 00:53:18,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-01-12 00:53:18,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-01-12 00:53:18,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-01-12 00:53:18,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-01-12 00:53:18,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-01-12 00:53:18,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-01-12 00:53:18,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-01-12 00:53:18,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-01-12 00:53:18,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-01-12 00:53:18,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-01-12 00:53:18,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-01-12 00:53:18,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-01-12 00:53:18,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-01-12 00:53:18,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-01-12 00:53:18,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-01-12 00:53:18,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-01-12 00:53:18,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-01-12 00:53:18,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-01-12 00:53:18,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-01-12 00:53:18,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-01-12 00:53:18,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-01-12 00:53:18,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-01-12 00:53:18,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-01-12 00:53:18,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-01-12 00:53:18,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-01-12 00:53:18,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-01-12 00:53:18,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-01-12 00:53:18,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-01-12 00:53:18,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-01-12 00:53:18,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-01-12 00:53:18,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-01-12 00:53:18,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-01-12 00:53:18,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-01-12 00:53:18,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-01-12 00:53:18,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-01-12 00:53:18,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-01-12 00:53:18,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-01-12 00:53:18,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-01-12 00:53:18,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-01-12 00:53:18,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-01-12 00:53:18,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-01-12 00:53:18,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-01-12 00:53:18,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-01-12 00:53:18,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-01-12 00:53:18,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-01-12 00:53:18,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-01-12 00:53:18,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-01-12 00:53:18,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-01-12 00:53:18,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-01-12 00:53:18,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-01-12 00:53:18,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-01-12 00:53:18,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-01-12 00:53:18,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-01-12 00:53:18,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-01-12 00:53:18,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-01-12 00:53:18,201 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.027774859554904597, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03825310004822698, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.027774859554904597, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0475, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-12 00:53:18,201 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-01-12 00:53:18,202 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.017111128015274576, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.027774859554904597, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03825310004822698, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.027774859554904597, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0475, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-01-12 00:53:18,427 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 333 ms to try 5000 different iterations.  Found a solution that moves 981 regions; Going from a computed imbalance of 0.017111128015274576 to a new imbalance of 0.0010418973117749674. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008340251524128118); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006011586269238994); MoveCostFunction : (multiplier=7.0, imbalance=0.109, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.008340251524128118); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.833333333333334E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004916666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-12 00:53:18,429 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1516912827:82 , srv1685207396:82 , srv1061614083:83 , srv1514997897:83 , srv1658452329:83 , srv1760391015:83 , srv1804243969:83 , srv586246885:83 , srv1038371821:84 , srv113608867:84 , srv1409893727:84 , srv156741662:84 , srv1927638579:84 , srv2026133167:84 , srv321595032:84 , srv464758319:84 , srv519328222:84 , srv572440582:84 , srv664036885:84 , srv968968485:84 , srv979878311:84 , srv1041196209:85 , srv1208030063:85 , srv1233572190:85 , srv137743513:85 , srv1571230506:85 , srv160779179:85 , srv181520929:85 , srv1886299656:85 , srv1887805650:85 , srv1946143904:85 , srv1981765218:85 , srv2012260209:85 , srv2038070926:85 , srv2073465772:85 , srv221279152:85 , srv350978349:85 , srv37270623:85 , srv529988941:85 , srv575279058:85 , srv724843662:85 , srv81136344:85 , srv852729558:85 , srv865317286:85 , srv1050179960:86 , srv1167250522:86 , srv138385819:86 , srv1383994212:86 , srv1438972919:86 , srv1666928789:86 , srv1674653169:86 , srv1743856763:86 , srv1988558144:86 , srv1989405869:86 , srv2054543354:86 , srv2078982632:86 , srv359745042:86 , srv659768870:86 , srv674474162:86 , srv897653301:86 , srv899779592:86 , srv950878020:86 , srv990271565:86 , srv100003479:87 , srv1007330034:87 , srv1065408055:87 , srv1088157759:87 , srv1159179891:87 , srv1401910200:87 , srv143370682:87 , srv1458249604:87 , srv1560655606:87 , srv1575507527:87 , srv1616801326:87 , srv1684745084:87 , srv1704851181:87 , srv1717170122:87 , srv1756465138:87 , srv1832417624:87 , srv1924658647:87 , srv259355488:87 , srv312808312:87 , srv405912163:87 , srv556340697:87 , srv795493483:87 , srv885039482:87 , srv958019374:87 , srv105647069:88 , srv1202682880:88 , srv1333208922:88 , srv1376983795:88 , srv1778086725:88 , srv2089438893:88 , srv287772185:88 , srv416104250:88 , srv674848624:88 , srv678867300:88 , srv270047392:89 , srv37862716:89 , srv1888150908:511 }
2024-01-12 00:53:18,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-01-12 00:53:18,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1065408055=7, srv885039482=92, srv1571230506=29, srv1743856763=40, srv350978349=69, srv950878020=95, srv1202682880=12, srv1685207396=37, srv160779179=31, srv958019374=96, srv575279058=80, srv464758319=75, srv968968485=97, srv664036885=83, srv1832417624=46, srv321595032=68, srv1333208922=15, srv519328222=76, srv1684745084=36, srv1007330034=1, srv1438972919=23, srv113608867=9, srv1061614083=6, srv1704851181=38, srv1717170122=39, srv659768870=82, srv724843662=87, srv572440582=79, srv1616801326=32, srv2073465772=60, srv979878311=98, srv1409893727=21, srv312808312=67, srv1560655606=27, srv678867300=86, srv556340697=78, srv37270623=71, srv529988941=77, srv2038070926=58, srv674848624=85, srv1376983795=16, srv1946143904=52, srv865317286=91, srv137743513=17, srv143370682=22, srv2078982632=61, srv897653301=93, srv1989405869=55, srv270047392=65, srv156741662=28, srv37862716=72, srv1674653169=35, srv2089438893=62, srv1088157759=8, srv1458249604=24, srv1050179960=4, srv1887805650=48, srv899779592=94, srv1760391015=42, srv1208030063=13, srv1658452329=33, srv1981765218=53, srv1401910200=20, srv81136344=89, srv1575507527=30, srv2012260209=56, srv2054543354=59, srv359745042=70, srv1038371821=2, srv138385819=18, srv795493483=88, srv1516912827=26, srv1159179891=10, srv1778086725=43, srv181520929=45, srv287772185=66, srv100003479=0, srv221279152=63, srv259355488=64, srv416104250=74, srv674474162=84, srv586246885=81, srv852729558=90, srv990271565=99, srv1756465138=41, srv405912163=73, srv1383994212=19, srv1804243969=44, srv2026133167=57, srv1233572190=14, srv1514997897=25, srv1886299656=47, srv1041196209=3, srv1927638579=51, srv105647069=5, srv1167250522=11, srv1888150908=49, srv1924658647=50, srv1666928789=34, srv1988558144=54} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-01-12 00:53:18,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-01-12 00:53:18,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-01-12 00:53:18,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-01-12 00:53:18,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-01-12 00:53:18,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-01-12 00:53:18,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-01-12 00:53:18,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-01-12 00:53:18,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-01-12 00:53:18,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-01-12 00:53:18,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-01-12 00:53:18,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-01-12 00:53:18,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-01-12 00:53:18,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-01-12 00:53:18,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-01-12 00:53:18,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-01-12 00:53:18,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-01-12 00:53:18,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-01-12 00:53:18,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-01-12 00:53:18,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-01-12 00:53:18,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-01-12 00:53:18,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-01-12 00:53:18,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-01-12 00:53:18,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-01-12 00:53:18,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-01-12 00:53:18,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-01-12 00:53:18,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-01-12 00:53:18,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-01-12 00:53:18,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-01-12 00:53:18,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-01-12 00:53:18,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-01-12 00:53:18,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-01-12 00:53:18,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-01-12 00:53:18,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-01-12 00:53:18,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-01-12 00:53:18,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-01-12 00:53:18,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-01-12 00:53:18,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-01-12 00:53:18,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-01-12 00:53:18,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-01-12 00:53:18,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-01-12 00:53:18,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-01-12 00:53:18,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-01-12 00:53:18,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-01-12 00:53:18,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-01-12 00:53:18,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-01-12 00:53:18,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-01-12 00:53:18,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-01-12 00:53:18,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-01-12 00:53:18,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-01-12 00:53:18,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-01-12 00:53:18,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-01-12 00:53:18,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-01-12 00:53:18,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-01-12 00:53:18,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-01-12 00:53:18,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-01-12 00:53:18,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-01-12 00:53:18,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-01-12 00:53:18,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-01-12 00:53:18,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-01-12 00:53:18,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-01-12 00:53:18,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-01-12 00:53:18,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-01-12 00:53:18,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-01-12 00:53:18,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-01-12 00:53:18,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-01-12 00:53:18,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-01-12 00:53:18,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-01-12 00:53:18,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-01-12 00:53:18,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-01-12 00:53:18,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-01-12 00:53:18,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-01-12 00:53:18,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-01-12 00:53:18,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-01-12 00:53:18,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-01-12 00:53:18,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-01-12 00:53:18,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-01-12 00:53:18,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-01-12 00:53:18,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-01-12 00:53:18,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-01-12 00:53:18,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-01-12 00:53:18,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-01-12 00:53:18,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-01-12 00:53:18,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-01-12 00:53:18,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-01-12 00:53:18,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-01-12 00:53:18,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-01-12 00:53:18,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-01-12 00:53:18,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-01-12 00:53:18,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-01-12 00:53:18,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-01-12 00:53:18,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-01-12 00:53:18,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-01-12 00:53:18,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-01-12 00:53:18,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-01-12 00:53:18,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-01-12 00:53:18,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-01-12 00:53:18,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-01-12 00:53:18,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-01-12 00:53:18,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-01-12 00:53:18,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-01-12 00:53:18,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-01-12 00:53:18,560 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008340251524128118); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006011586269238994); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.008340251524128118); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.833333333333334E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004916666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-12 00:53:18,561 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-01-12 00:53:18,561 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.0010350282029585607, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008340251524128118); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006011586269238994); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.008340251524128118); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.833333333333334E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004916666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-01-12 00:53:18,897 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 431 ms to try 5000 different iterations.  Found a solution that moves 266 regions; Going from a computed imbalance of 0.0010350282029585607 to a new imbalance of 5.0318719501456985E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0019534423844256277); MoveCostFunction : (multiplier=7.0, imbalance=0.029555555555555557, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=4.166666666666667E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-12 00:53:18,898 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1088157759:83 , srv1616801326:83 , srv1658452329:83 , srv2078982632:83 , srv416104250:83 , srv678867300:83 , srv113608867:84 , srv1159179891:84 , srv1202682880:84 , srv1208030063:84 , srv1233572190:84 , srv1333208922:84 , srv1376983795:84 , srv1383994212:84 , srv143370682:84 , srv156741662:84 , srv1684745084:84 , srv1988558144:84 , srv2038070926:84 , srv221279152:84 , srv270047392:84 , srv350978349:84 , srv359745042:84 , srv37270623:84 , srv37862716:84 , srv519328222:84 , srv572440582:84 , srv586246885:84 , srv659768870:84 , srv674848624:84 , srv885039482:84 , srv897653301:84 , srv979878311:84 , srv990271565:84 , srv100003479:85 , srv1007330034:85 , srv1041196209:85 , srv1050179960:85 , srv105647069:85 , srv1061614083:85 , srv1065408055:85 , srv1167250522:85 , srv137743513:85 , srv138385819:85 , srv1401910200:85 , srv1409893727:85 , srv1458249604:85 , srv1514997897:85 , srv1560655606:85 , srv1571230506:85 , srv1575507527:85 , srv160779179:85 , srv1666928789:85 , srv1685207396:85 , srv1704851181:85 , srv1717170122:85 , srv1743856763:85 , srv1756465138:85 , srv1760391015:85 , srv1778086725:85 , srv181520929:85 , srv1832417624:85 , srv1887805650:85 , srv1924658647:85 , srv1927638579:85 , srv1946143904:85 , srv1981765218:85 , srv2026133167:85 , srv2054543354:85 , srv2073465772:85 , srv2089438893:85 , srv259355488:85 , srv287772185:85 , srv405912163:85 , srv464758319:85 , srv556340697:85 , srv664036885:85 , srv724843662:85 , srv795493483:85 , srv81136344:85 , srv852729558:85 , srv865317286:85 , srv899779592:85 , srv950878020:85 , srv1038371821:86 , srv1438972919:86 , srv1516912827:86 , srv1674653169:86 , srv1804243969:86 , srv1886299656:86 , srv1989405869:86 , srv2012260209:86 , srv312808312:86 , srv321595032:86 , srv529988941:86 , srv575279058:86 , srv674474162:86 , srv958019374:86 , srv968968485:86 , srv1888150908:610 }
2024-01-12 00:53:18,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-01-12 00:53:18,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1065408055=7, srv885039482=92, srv1571230506=29, srv1743856763=40, srv350978349=69, srv950878020=95, srv1202682880=12, srv1685207396=37, srv160779179=31, srv958019374=96, srv575279058=80, srv464758319=75, srv968968485=97, srv664036885=83, srv1832417624=46, srv321595032=68, srv1333208922=15, srv519328222=76, srv1684745084=36, srv1007330034=1, srv1438972919=23, srv113608867=9, srv1061614083=6, srv1704851181=38, srv1717170122=39, srv659768870=82, srv724843662=87, srv572440582=79, srv1616801326=32, srv2073465772=60, srv979878311=98, srv1409893727=21, srv312808312=67, srv1560655606=27, srv678867300=86, srv556340697=78, srv37270623=71, srv529988941=77, srv2038070926=58, srv674848624=85, srv1376983795=16, srv1946143904=52, srv865317286=91, srv137743513=17, srv143370682=22, srv2078982632=61, srv897653301=93, srv1989405869=55, srv270047392=65, srv156741662=28, srv37862716=72, srv1674653169=35, srv2089438893=62, srv1088157759=8, srv1458249604=24, srv1050179960=4, srv1887805650=48, srv899779592=94, srv1760391015=42, srv1208030063=13, srv1658452329=33, srv1981765218=53, srv1401910200=20, srv81136344=89, srv1575507527=30, srv2012260209=56, srv2054543354=59, srv359745042=70, srv1038371821=2, srv138385819=18, srv795493483=88, srv1516912827=26, srv1159179891=10, srv1778086725=43, srv181520929=45, srv287772185=66, srv100003479=0, srv221279152=63, srv259355488=64, srv416104250=74, srv674474162=84, srv586246885=81, srv852729558=90, srv990271565=99, srv1756465138=41, srv405912163=73, srv1383994212=19, srv1804243969=44, srv2026133167=57, srv1233572190=14, srv1514997897=25, srv1886299656=47, srv1041196209=3, srv1927638579=51, srv105647069=5, srv1167250522=11, srv1888150908=49, srv1924658647=50, srv1666928789=34, srv1988558144=54} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-01-12 00:53:18,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-01-12 00:53:18,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-01-12 00:53:18,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-01-12 00:53:18,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-01-12 00:53:18,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-01-12 00:53:18,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-01-12 00:53:18,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-01-12 00:53:18,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-01-12 00:53:18,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-01-12 00:53:18,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-01-12 00:53:18,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-01-12 00:53:18,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-01-12 00:53:18,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-01-12 00:53:18,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-01-12 00:53:18,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-01-12 00:53:18,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-01-12 00:53:18,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-01-12 00:53:18,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-01-12 00:53:18,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-01-12 00:53:18,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-01-12 00:53:18,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-01-12 00:53:18,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-01-12 00:53:18,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-01-12 00:53:18,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-01-12 00:53:18,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-01-12 00:53:18,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-01-12 00:53:18,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-01-12 00:53:18,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-01-12 00:53:18,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-01-12 00:53:18,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-01-12 00:53:18,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-01-12 00:53:18,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-01-12 00:53:18,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-01-12 00:53:18,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-01-12 00:53:18,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-01-12 00:53:18,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-01-12 00:53:18,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-01-12 00:53:18,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-01-12 00:53:18,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-01-12 00:53:18,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-01-12 00:53:18,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-01-12 00:53:18,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-01-12 00:53:18,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-01-12 00:53:18,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-01-12 00:53:18,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-01-12 00:53:18,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-01-12 00:53:18,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-01-12 00:53:18,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-01-12 00:53:18,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-01-12 00:53:18,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-01-12 00:53:18,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-01-12 00:53:18,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-01-12 00:53:18,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-01-12 00:53:18,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-01-12 00:53:18,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-01-12 00:53:18,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-01-12 00:53:18,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-01-12 00:53:18,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-01-12 00:53:18,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-01-12 00:53:18,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-01-12 00:53:18,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-01-12 00:53:18,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-01-12 00:53:18,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-01-12 00:53:18,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-01-12 00:53:18,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-01-12 00:53:18,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-01-12 00:53:18,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-01-12 00:53:18,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-01-12 00:53:18,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-01-12 00:53:18,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-01-12 00:53:18,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-01-12 00:53:18,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-01-12 00:53:18,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-01-12 00:53:18,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-01-12 00:53:18,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-01-12 00:53:18,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-01-12 00:53:18,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-01-12 00:53:18,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-01-12 00:53:18,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-01-12 00:53:18,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-01-12 00:53:18,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-01-12 00:53:18,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-01-12 00:53:18,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-01-12 00:53:18,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-01-12 00:53:18,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-01-12 00:53:18,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-01-12 00:53:18,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-01-12 00:53:18,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-01-12 00:53:18,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-01-12 00:53:18,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-01-12 00:53:18,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-01-12 00:53:18,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-01-12 00:53:18,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-01-12 00:53:18,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-01-12 00:53:18,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-01-12 00:53:18,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-01-12 00:53:18,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-01-12 00:53:18,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-01-12 00:53:18,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-01-12 00:53:18,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-01-12 00:53:18,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-01-12 00:53:19,023 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0019534423844256277); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=4.166666666666667E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-12 00:53:19,023 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-01-12 00:53:19,024 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=4.8456147691911454E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0019534423844256277); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=4.166666666666667E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-01-12 00:53:19,250 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 322 ms to try 5000 different iterations.  Found a solution that moves 32 regions; Going from a computed imbalance of 4.8456147691911454E-5 to a new imbalance of 6.968137842950207E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014982219165849825); MoveCostFunction : (multiplier=7.0, imbalance=0.0035555555555555557); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-12 00:53:19,250 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1516912827:83 , srv1674653169:83 , srv1804243969:83 , srv1886299656:83 , srv287772185:83 , srv312808312:83 , srv575279058:83 , srv674474162:83 , srv100003479:84 , srv1007330034:84 , srv1038371821:84 , srv1041196209:84 , srv1050179960:84 , srv105647069:84 , srv1061614083:84 , srv1065408055:84 , srv1088157759:84 , srv1159179891:84 , srv1167250522:84 , srv1202682880:84 , srv1233572190:84 , srv1333208922:84 , srv137743513:84 , srv138385819:84 , srv1383994212:84 , srv1401910200:84 , srv1409893727:84 , srv143370682:84 , srv1438972919:84 , srv1458249604:84 , srv1514997897:84 , srv1560655606:84 , srv156741662:84 , srv1571230506:84 , srv1575507527:84 , srv160779179:84 , srv1616801326:84 , srv1658452329:84 , srv1666928789:84 , srv1684745084:84 , srv1685207396:84 , srv1704851181:84 , srv1717170122:84 , srv1743856763:84 , srv1756465138:84 , srv1778086725:84 , srv181520929:84 , srv1832417624:84 , srv1887805650:84 , srv1924658647:84 , srv1927638579:84 , srv1946143904:84 , srv1981765218:84 , srv1988558144:84 , srv1989405869:84 , srv2012260209:84 , srv2026133167:84 , srv2038070926:84 , srv2054543354:84 , srv2073465772:84 , srv2089438893:84 , srv221279152:84 , srv259355488:84 , srv270047392:84 , srv321595032:84 , srv359745042:84 , srv37270623:84 , srv37862716:84 , srv405912163:84 , srv416104250:84 , srv464758319:84 , srv519328222:84 , srv529988941:84 , srv556340697:84 , srv572440582:84 , srv586246885:84 , srv659768870:84 , srv664036885:84 , srv678867300:84 , srv724843662:84 , srv795493483:84 , srv81136344:84 , srv852729558:84 , srv865317286:84 , srv885039482:84 , srv899779592:84 , srv950878020:84 , srv958019374:84 , srv968968485:84 , srv979878311:84 , srv990271565:84 , srv113608867:85 , srv1208030063:85 , srv1376983795:85 , srv1760391015:85 , srv2078982632:85 , srv350978349:85 , srv674848624:85 , srv897653301:85 , srv1888150908:684 }
2024-01-12 00:53:19,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-01-12 00:53:19,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1065408055=7, srv885039482=92, srv1571230506=29, srv1743856763=40, srv350978349=69, srv950878020=95, srv1202682880=12, srv1685207396=37, srv160779179=31, srv958019374=96, srv575279058=80, srv464758319=75, srv968968485=97, srv664036885=83, srv1832417624=46, srv321595032=68, srv1333208922=15, srv519328222=76, srv1684745084=36, srv1007330034=1, srv1438972919=23, srv113608867=9, srv1061614083=6, srv1704851181=38, srv1717170122=39, srv659768870=82, srv724843662=87, srv572440582=79, srv1616801326=32, srv2073465772=60, srv979878311=98, srv1409893727=21, srv312808312=67, srv1560655606=27, srv678867300=86, srv556340697=78, srv37270623=71, srv529988941=77, srv2038070926=58, srv674848624=85, srv1376983795=16, srv1946143904=52, srv865317286=91, srv137743513=17, srv143370682=22, srv2078982632=61, srv897653301=93, srv1989405869=55, srv270047392=65, srv156741662=28, srv37862716=72, srv1674653169=35, srv2089438893=62, srv1088157759=8, srv1458249604=24, srv1050179960=4, srv1887805650=48, srv899779592=94, srv1760391015=42, srv1208030063=13, srv1658452329=33, srv1981765218=53, srv1401910200=20, srv81136344=89, srv1575507527=30, srv2012260209=56, srv2054543354=59, srv359745042=70, srv1038371821=2, srv138385819=18, srv795493483=88, srv1516912827=26, srv1159179891=10, srv1778086725=43, srv181520929=45, srv287772185=66, srv100003479=0, srv221279152=63, srv259355488=64, srv416104250=74, srv674474162=84, srv586246885=81, srv852729558=90, srv990271565=99, srv1756465138=41, srv405912163=73, srv1383994212=19, srv1804243969=44, srv2026133167=57, srv1233572190=14, srv1514997897=25, srv1886299656=47, srv1041196209=3, srv1927638579=51, srv105647069=5, srv1167250522=11, srv1888150908=49, srv1924658647=50, srv1666928789=34, srv1988558144=54} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-01-12 00:53:19,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-01-12 00:53:19,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-01-12 00:53:19,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-01-12 00:53:19,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-01-12 00:53:19,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-01-12 00:53:19,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-01-12 00:53:19,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-01-12 00:53:19,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-01-12 00:53:19,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-01-12 00:53:19,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-01-12 00:53:19,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-01-12 00:53:19,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-01-12 00:53:19,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-01-12 00:53:19,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-01-12 00:53:19,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-01-12 00:53:19,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-01-12 00:53:19,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-01-12 00:53:19,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-01-12 00:53:19,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-01-12 00:53:19,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-01-12 00:53:19,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-01-12 00:53:19,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-01-12 00:53:19,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-01-12 00:53:19,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-01-12 00:53:19,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-01-12 00:53:19,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-01-12 00:53:19,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-01-12 00:53:19,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-01-12 00:53:19,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-01-12 00:53:19,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-01-12 00:53:19,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-01-12 00:53:19,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-01-12 00:53:19,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-01-12 00:53:19,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-01-12 00:53:19,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-01-12 00:53:19,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-01-12 00:53:19,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-01-12 00:53:19,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-01-12 00:53:19,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-01-12 00:53:19,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-01-12 00:53:19,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-01-12 00:53:19,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-01-12 00:53:19,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-01-12 00:53:19,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-01-12 00:53:19,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-01-12 00:53:19,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-01-12 00:53:19,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-01-12 00:53:19,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-01-12 00:53:19,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-01-12 00:53:19,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-01-12 00:53:19,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-01-12 00:53:19,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-01-12 00:53:19,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-01-12 00:53:19,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-01-12 00:53:19,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-01-12 00:53:19,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-01-12 00:53:19,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-01-12 00:53:19,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-01-12 00:53:19,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-01-12 00:53:19,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-01-12 00:53:19,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-01-12 00:53:19,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-01-12 00:53:19,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-01-12 00:53:19,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-01-12 00:53:19,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-01-12 00:53:19,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-01-12 00:53:19,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-01-12 00:53:19,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-01-12 00:53:19,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-01-12 00:53:19,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-01-12 00:53:19,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-01-12 00:53:19,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-01-12 00:53:19,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-01-12 00:53:19,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-01-12 00:53:19,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-01-12 00:53:19,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-01-12 00:53:19,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-01-12 00:53:19,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-01-12 00:53:19,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-01-12 00:53:19,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-01-12 00:53:19,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-01-12 00:53:19,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-01-12 00:53:19,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-01-12 00:53:19,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-01-12 00:53:19,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-01-12 00:53:19,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-01-12 00:53:19,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-01-12 00:53:19,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-01-12 00:53:19,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-01-12 00:53:19,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-01-12 00:53:19,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-01-12 00:53:19,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-01-12 00:53:19,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-01-12 00:53:19,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-01-12 00:53:19,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-01-12 00:53:19,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-01-12 00:53:19,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-01-12 00:53:19,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-01-12 00:53:19,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-01-12 00:53:19,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-01-12 00:53:19,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-01-12 00:53:19,386 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=6.744069053831948E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014982219165849825); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-12 00:53:19,386 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1516912827:83 , srv1674653169:83 , srv1804243969:83 , srv1886299656:83 , srv287772185:83 , srv312808312:83 , srv575279058:83 , srv674474162:83 , srv100003479:84 , srv1007330034:84 , srv1038371821:84 , srv1041196209:84 , srv1050179960:84 , srv105647069:84 , srv1061614083:84 , srv1065408055:84 , srv1088157759:84 , srv1159179891:84 , srv1167250522:84 , srv1202682880:84 , srv1233572190:84 , srv1333208922:84 , srv137743513:84 , srv138385819:84 , srv1383994212:84 , srv1401910200:84 , srv1409893727:84 , srv143370682:84 , srv1438972919:84 , srv1458249604:84 , srv1514997897:84 , srv1560655606:84 , srv156741662:84 , srv1571230506:84 , srv1575507527:84 , srv160779179:84 , srv1616801326:84 , srv1658452329:84 , srv1666928789:84 , srv1684745084:84 , srv1685207396:84 , srv1704851181:84 , srv1717170122:84 , srv1743856763:84 , srv1756465138:84 , srv1778086725:84 , srv181520929:84 , srv1832417624:84 , srv1887805650:84 , srv1924658647:84 , srv1927638579:84 , srv1946143904:84 , srv1981765218:84 , srv1988558144:84 , srv1989405869:84 , srv2012260209:84 , srv2026133167:84 , srv2038070926:84 , srv2054543354:84 , srv2073465772:84 , srv2089438893:84 , srv221279152:84 , srv259355488:84 , srv270047392:84 , srv321595032:84 , srv359745042:84 , srv37270623:84 , srv37862716:84 , srv405912163:84 , srv416104250:84 , srv464758319:84 , srv519328222:84 , srv529988941:84 , srv556340697:84 , srv572440582:84 , srv586246885:84 , srv659768870:84 , srv664036885:84 , srv678867300:84 , srv724843662:84 , srv795493483:84 , srv81136344:84 , srv852729558:84 , srv865317286:84 , srv885039482:84 , srv899779592:84 , srv950878020:84 , srv958019374:84 , srv968968485:84 , srv979878311:84 , srv990271565:84 , srv113608867:85 , srv1208030063:85 , srv1376983795:85 , srv1760391015:85 , srv2078982632:85 , srv350978349:85 , srv674848624:85 , srv897653301:85 , srv1888150908:684 }
2024-01-12 00:53:19,411 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=305 (was 270) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 167), AvailableMemoryMB=5037 (was 5643)
2024-01-12 00:53:19,422 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=305, ProcessCount=167, AvailableMemoryMB=5037
2024-01-12 00:53:19,423 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-01-12 00:53:19,423 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2024-01-12 00:53:19,434 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1011077323:84 , srv1015304939:84 , srv1108450021:84 , srv1183850268:84 , srv1197031668:84 , srv1204276950:84 , srv1362457329:84 , srv1380432028:84 , srv1493703350:84 , srv1527707336:84 , srv1553510193:84 , srv1744278962:84 , srv1749853797:84 , srv1796681278:84 , srv1843290802:84 , srv1855322734:84 , srv1883434957:84 , srv2039937483:84 , srv2101879947:84 , srv398597877:84 , srv426968479:84 , srv504618451:84 , srv575989205:84 , srv588396192:84 , srv624828676:84 , srv681173683:84 , srv792245158:84 , srv82958375:84 , srv911709327:84 , srv229201026:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2024-01-12 00:53:19,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-01-12 00:53:19,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1204276950=5, srv1108450021=2, srv1744278962=11, srv1015304939=1, srv575989205=23, srv1855322734=15, srv1883434957=16, srv426968479=21, srv588396192=24, srv1749853797=12, srv1796681278=13, srv2039937483=17, srv2101879947=18, srv82958375=28, srv1527707336=9, srv1553510193=10, srv681173683=26, srv1011077323=0, srv1493703350=8, srv1183850268=3, srv229201026=19, srv504618451=22, srv1197031668=4, srv398597877=20, srv624828676=25, srv792245158=27, srv1362457329=6, srv1380432028=7, srv911709327=29, srv1843290802=14} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-01-12 00:53:19,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-01-12 00:53:19,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-01-12 00:53:19,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-01-12 00:53:19,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-01-12 00:53:19,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-01-12 00:53:19,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-01-12 00:53:19,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-01-12 00:53:19,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-01-12 00:53:19,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-01-12 00:53:19,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-01-12 00:53:19,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-01-12 00:53:19,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-01-12 00:53:19,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-01-12 00:53:19,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-01-12 00:53:19,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-01-12 00:53:19,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-01-12 00:53:19,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-01-12 00:53:19,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-01-12 00:53:19,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-01-12 00:53:19,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-01-12 00:53:19,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-01-12 00:53:19,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-01-12 00:53:19,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-01-12 00:53:19,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-01-12 00:53:19,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-01-12 00:53:19,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-01-12 00:53:19,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-01-12 00:53:19,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-01-12 00:53:19,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-01-12 00:53:19,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-01-12 00:53:19,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-01-12 00:53:19,463 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0953320227364791, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-12 00:53:19,464 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912493431355046, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0953320227364791, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2024-01-12 00:55:19,451 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5940243 different iterations.  Found a solution that moves 1858 regions; Going from a computed imbalance of 0.9912493431355046 to a new imbalance of 4.336664689392977E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6881481481481482, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-12 00:55:19,459 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1011077323:90 , srv1015304939:90 , srv1108450021:90 , srv1183850268:90 , srv1197031668:90 , srv1204276950:90 , srv1362457329:90 , srv1380432028:90 , srv1493703350:90 , srv1527707336:90 , srv1553510193:90 , srv1744278962:90 , srv1749853797:90 , srv1796681278:90 , srv1843290802:90 , srv1855322734:90 , srv1883434957:90 , srv2039937483:90 , srv2101879947:90 , srv229201026:90 , srv398597877:90 , srv426968479:90 , srv504618451:90 , srv575989205:90 , srv588396192:90 , srv624828676:90 , srv681173683:90 , srv792245158:90 , srv82958375:90 , srv911709327:90 }
2024-01-12 00:55:19,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-01-12 00:55:19,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1204276950=5, srv1108450021=2, srv1744278962=11, srv1015304939=1, srv575989205=23, srv1855322734=15, srv1883434957=16, srv426968479=21, srv588396192=24, srv1749853797=12, srv1796681278=13, srv2039937483=17, srv2101879947=18, srv82958375=28, srv1527707336=9, srv1553510193=10, srv681173683=26, srv1011077323=0, srv1493703350=8, srv1183850268=3, srv229201026=19, srv504618451=22, srv1197031668=4, srv398597877=20, srv624828676=25, srv792245158=27, srv1362457329=6, srv1380432028=7, srv911709327=29, srv1843290802=14} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-01-12 00:55:19,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-01-12 00:55:19,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-01-12 00:55:19,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-01-12 00:55:19,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-01-12 00:55:19,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-01-12 00:55:19,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-01-12 00:55:19,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-01-12 00:55:19,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-01-12 00:55:19,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-01-12 00:55:19,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-01-12 00:55:19,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-01-12 00:55:19,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-01-12 00:55:19,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-01-12 00:55:19,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-01-12 00:55:19,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-01-12 00:55:19,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-01-12 00:55:19,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-01-12 00:55:19,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-01-12 00:55:19,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-01-12 00:55:19,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-01-12 00:55:19,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-01-12 00:55:19,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-01-12 00:55:19,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-01-12 00:55:19,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-01-12 00:55:19,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-01-12 00:55:19,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-01-12 00:55:19,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-01-12 00:55:19,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-01-12 00:55:19,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-01-12 00:55:19,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-01-12 00:55:19,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-01-12 00:55:19,477 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-12 00:55:19,477 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1011077323:90 , srv1015304939:90 , srv1108450021:90 , srv1183850268:90 , srv1197031668:90 , srv1204276950:90 , srv1362457329:90 , srv1380432028:90 , srv1493703350:90 , srv1527707336:90 , srv1553510193:90 , srv1744278962:90 , srv1749853797:90 , srv1796681278:90 , srv1843290802:90 , srv1855322734:90 , srv1883434957:90 , srv2039937483:90 , srv2101879947:90 , srv229201026:90 , srv398597877:90 , srv426968479:90 , srv504618451:90 , srv575989205:90 , srv588396192:90 , srv624828676:90 , srv681173683:90 , srv792245158:90 , srv82958375:90 , srv911709327:90 }
2024-01-12 00:55:19,491 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=206 (was 305), ProcessCount=167 (was 167), AvailableMemoryMB=4321 (was 5037)