2024-02-01 17:53:17,518 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2024-02-01 17:53:17,828 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2024-02-01 17:53:17,937 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2024-02-01 17:53:18,005 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-02-01 17:53:18,014 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-02-01 17:53:18,028 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=263, ProcessCount=170, AvailableMemoryMB=2900
2024-02-01 17:53:18,031 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-02-01 17:53:18,031 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-02-01 17:53:18,171 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1007671693:84 , srv1008459418:84 , srv1015772650:84 , srv1018740954:84 , srv1062570027:84 , srv1094075566:84 , srv1130048687:84 , srv1132462253:84 , srv1141555214:84 , srv117003465:84 , srv1179995335:84 , srv1247961301:84 , srv128824318:84 , srv1292580569:84 , srv1333471514:84 , srv13434221:84 , srv1372923351:84 , srv1394287833:84 , srv142467737:84 , srv1458009148:84 , srv14822237:84 , srv1485054741:84 , srv1491476056:84 , srv1515094595:84 , srv1522102701:84 , srv1532851277:84 , srv1542191772:84 , srv1598605738:84 , srv1602804318:84 , srv1604651428:84 , srv1611000270:84 , srv1616732388:84 , srv1629209377:84 , srv164287620:84 , srv1660393700:84 , srv1665504576:84 , srv1681582329:84 , srv1723690852:84 , srv1729607363:84 , srv1746003738:84 , srv176647068:84 , srv1766556972:84 , srv1774956269:84 , srv1776048077:84 , srv1782485663:84 , srv1806846272:84 , srv1871562847:84 , srv1876532591:84 , srv1897016494:84 , srv1931386307:84 , srv1943717118:84 , srv1949946656:84 , srv1958154155:84 , srv1986907377:84 , srv2048138472:84 , srv2053727904:84 , srv2060606803:84 , srv2077712364:84 , srv2085610781:84 , srv2129230689:84 , srv222703231:84 , srv228237314:84 , srv246720929:84 , srv282212503:84 , srv354180372:84 , srv388245995:84 , srv39849286:84 , srv403070617:84 , srv430783529:84 , srv437832369:84 , srv438703811:84 , srv448955297:84 , srv531581802:84 , srv533183853:84 , srv552015165:84 , srv564454507:84 , srv599066935:84 , srv678880411:84 , srv692679892:84 , srv694068103:84 , srv700674263:84 , srv716183572:84 , srv746486083:84 , srv758060520:84 , srv776550150:84 , srv840211089:84 , srv864233999:84 , srv86538157:84 , srv87036496:84 , srv876861808:84 , srv891853087:84 , srv892166019:84 , srv902628583:84 , srv93450218:84 , srv953523509:84 , srv961375741:84 , srv979616142:84 , srv980166726:84 , srv983010675:84 , srv428088960:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2024-02-01 17:53:18,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-01 17:53:18,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1394287833=17, srv678880411=78, srv1130048687=6, srv564454507=76, srv354180372=64, srv1372923351=16, srv39849286=66, srv87036496=89, srv1943717118=50, srv388245995=65, srv1665504576=35, srv552015165=75, srv1542191772=26, srv876861808=90, srv1094075566=5, srv1776048077=43, srv776550150=85, srv430783529=69, srv1766556972=41, srv1629209377=32, srv1491476056=22, srv14822237=20, srv1015772650=2, srv1782485663=44, srv1746003738=39, srv13434221=15, srv2085610781=58, srv86538157=88, srv1604651428=29, srv716183572=82, srv983010675=99, srv246720929=62, srv438703811=71, srv980166726=98, srv1897016494=48, srv692679892=79, srv1007671693=0, srv979616142=97, srv117003465=9, srv694068103=80, srv1485054741=21, srv1931386307=49, srv176647068=40, srv1611000270=30, srv1008459418=1, srv1871562847=46, srv93450218=94, srv1774956269=42, srv1598605738=27, srv1876532591=47, srv1958154155=52, srv1018740954=3, srv1247961301=11, srv2129230689=59, srv403070617=67, srv128824318=12, srv1723690852=37, srv599066935=77, srv1458009148=19, srv1333471514=14, srv164287620=33, srv1522102701=24, srv758060520=84, srv1660393700=34, srv746486083=83, srv1986907377=53, srv2060606803=56, srv1062570027=4, srv428088960=68, srv1532851277=25, srv531581802=73, srv1806846272=45, srv892166019=92, srv142467737=18, srv533183853=74, srv700674263=81, srv840211089=86, srv1949946656=51, srv953523509=95, srv228237314=61, srv1681582329=36, srv961375741=96, srv1616732388=31, srv222703231=60, srv864233999=87, srv1292580569=13, srv2048138472=54, srv1602804318=28, srv2077712364=57, srv1515094595=23, srv282212503=63, srv2053727904=55, srv437832369=70, srv891853087=91, srv1729607363=38, srv902628583=93, srv1179995335=10, srv1141555214=8, srv1132462253=7, srv448955297=72} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-01 17:53:18,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-01 17:53:18,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-01 17:53:18,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-01 17:53:18,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-01 17:53:18,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-01 17:53:18,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-01 17:53:18,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-01 17:53:18,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-01 17:53:18,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-01 17:53:18,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-01 17:53:18,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-01 17:53:18,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-01 17:53:18,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-01 17:53:18,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-01 17:53:18,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-01 17:53:18,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-01 17:53:18,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-01 17:53:18,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-01 17:53:18,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-01 17:53:18,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-01 17:53:18,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-01 17:53:18,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-01 17:53:18,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-01 17:53:18,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-01 17:53:18,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-01 17:53:18,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-01 17:53:18,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-01 17:53:18,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-01 17:53:18,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-01 17:53:18,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-01 17:53:18,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-02-01 17:53:18,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-02-01 17:53:18,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-02-01 17:53:18,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-02-01 17:53:18,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-02-01 17:53:18,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-02-01 17:53:18,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-02-01 17:53:18,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-02-01 17:53:18,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-02-01 17:53:18,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-02-01 17:53:18,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-02-01 17:53:18,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-02-01 17:53:18,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-02-01 17:53:18,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-02-01 17:53:18,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-02-01 17:53:18,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-02-01 17:53:18,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-02-01 17:53:18,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-02-01 17:53:18,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-02-01 17:53:18,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-02-01 17:53:18,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-02-01 17:53:18,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-02-01 17:53:18,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-02-01 17:53:18,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-02-01 17:53:18,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-02-01 17:53:18,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-02-01 17:53:18,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-02-01 17:53:18,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-02-01 17:53:18,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-02-01 17:53:18,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-02-01 17:53:18,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-02-01 17:53:18,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-02-01 17:53:18,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-02-01 17:53:18,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-02-01 17:53:18,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-02-01 17:53:18,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-02-01 17:53:18,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-02-01 17:53:18,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-02-01 17:53:18,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-02-01 17:53:18,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-02-01 17:53:18,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-02-01 17:53:18,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-02-01 17:53:18,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-02-01 17:53:18,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-02-01 17:53:18,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-02-01 17:53:18,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-02-01 17:53:18,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-02-01 17:53:18,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-02-01 17:53:18,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-02-01 17:53:18,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-02-01 17:53:18,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-02-01 17:53:18,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-02-01 17:53:18,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-02-01 17:53:18,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-02-01 17:53:18,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-02-01 17:53:18,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-02-01 17:53:18,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-02-01 17:53:18,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-02-01 17:53:18,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-02-01 17:53:18,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-02-01 17:53:18,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-02-01 17:53:18,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-02-01 17:53:18,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-02-01 17:53:18,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-02-01 17:53:18,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-02-01 17:53:18,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-02-01 17:53:18,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-02-01 17:53:18,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-02-01 17:53:18,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-02-01 17:53:18,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-02-01 17:53:18,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-02-01 17:53:18,647 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-01 17:53:18,648 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-02-01 17:53:18,648 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-02-01 17:53:19,022 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 701 ms to try 5000 different iterations.  Found a solution that moves 4748 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.1705755774601641. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.040592322248356315, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05656060583511695, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5275555555555556, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.040592322248356315, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.16575, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23183333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-01 17:53:19,040 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv117003465:82 , srv1616732388:82 , srv2129230689:82 , srv403070617:82 , srv1522102701:83 , srv1681582329:83 , srv1897016494:83 , srv228237314:83 , srv354180372:83 , srv700674263:83 , srv716183572:83 , srv1130048687:84 , srv1247961301:84 , srv164287620:84 , srv1660393700:84 , srv1958154155:84 , srv93450218:84 , srv980166726:84 , srv1015772650:85 , srv1094075566:85 , srv1132462253:85 , srv1372923351:85 , srv1491476056:85 , srv1515094595:85 , srv1542191772:85 , srv1766556972:85 , srv1782485663:85 , srv1931386307:85 , srv222703231:85 , srv388245995:85 , srv437832369:85 , srv533183853:85 , srv599066935:85 , srv694068103:85 , srv864233999:85 , srv1062570027:86 , srv1179995335:86 , srv142467737:86 , srv1458009148:86 , srv1532851277:86 , srv1723690852:86 , srv1729607363:86 , srv1746003738:86 , srv1774956269:86 , srv1806846272:86 , srv1943717118:86 , srv2060606803:86 , srv246720929:86 , srv282212503:86 , srv430783529:86 , srv531581802:86 , srv692679892:86 , srv891853087:86 , srv983010675:86 , srv1008459418:87 , srv14822237:87 , srv1485054741:87 , srv1598605738:87 , srv176647068:87 , srv1876532591:87 , srv1949946656:87 , srv1986907377:87 , srv2053727904:87 , srv2077712364:87 , srv564454507:87 , srv758060520:87 , srv776550150:87 , srv840211089:87 , srv953523509:87 , srv979616142:87 , srv1018740954:88 , srv1141555214:88 , srv128824318:88 , srv13434221:88 , srv1394287833:88 , srv1611000270:88 , srv1665504576:88 , srv1871562847:88 , srv2048138472:88 , srv2085610781:88 , srv438703811:88 , srv678880411:88 , srv86538157:88 , srv87036496:88 , srv961375741:88 , srv1292580569:89 , srv1602804318:89 , srv1629209377:89 , srv1776048077:89 , srv39849286:89 , srv448955297:89 , srv552015165:89 , srv746486083:89 , srv892166019:90 , srv1604651428:91 , srv876861808:91 , srv1333471514:92 , srv902628583:92 , srv1007671693:93 , srv428088960:451 }
2024-02-01 17:53:19,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-01 17:53:19,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1394287833=17, srv678880411=78, srv1130048687=6, srv564454507=76, srv354180372=64, srv1372923351=16, srv39849286=66, srv87036496=89, srv1943717118=50, srv388245995=65, srv1665504576=35, srv552015165=75, srv1542191772=26, srv876861808=90, srv1094075566=5, srv1776048077=43, srv776550150=85, srv430783529=69, srv1766556972=41, srv1629209377=32, srv1491476056=22, srv14822237=20, srv1015772650=2, srv1782485663=44, srv1746003738=39, srv13434221=15, srv2085610781=58, srv86538157=88, srv1604651428=29, srv716183572=82, srv983010675=99, srv246720929=62, srv438703811=71, srv980166726=98, srv1897016494=48, srv692679892=79, srv1007671693=0, srv979616142=97, srv117003465=9, srv694068103=80, srv1485054741=21, srv1931386307=49, srv176647068=40, srv1611000270=30, srv1008459418=1, srv1871562847=46, srv93450218=94, srv1774956269=42, srv1598605738=27, srv1876532591=47, srv1958154155=52, srv1018740954=3, srv1247961301=11, srv2129230689=59, srv403070617=67, srv128824318=12, srv1723690852=37, srv599066935=77, srv1458009148=19, srv1333471514=14, srv164287620=33, srv1522102701=24, srv758060520=84, srv1660393700=34, srv746486083=83, srv1986907377=53, srv2060606803=56, srv1062570027=4, srv428088960=68, srv1532851277=25, srv531581802=73, srv1806846272=45, srv892166019=92, srv142467737=18, srv533183853=74, srv700674263=81, srv840211089=86, srv1949946656=51, srv953523509=95, srv228237314=61, srv1681582329=36, srv961375741=96, srv1616732388=31, srv222703231=60, srv864233999=87, srv1292580569=13, srv2048138472=54, srv1602804318=28, srv2077712364=57, srv1515094595=23, srv282212503=63, srv2053727904=55, srv437832369=70, srv891853087=91, srv1729607363=38, srv902628583=93, srv1179995335=10, srv1141555214=8, srv1132462253=7, srv448955297=72} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-01 17:53:19,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-01 17:53:19,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-01 17:53:19,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-01 17:53:19,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-01 17:53:19,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-01 17:53:19,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-01 17:53:19,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-01 17:53:19,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-01 17:53:19,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-01 17:53:19,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-01 17:53:19,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-01 17:53:19,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-01 17:53:19,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-01 17:53:19,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-01 17:53:19,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-01 17:53:19,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-01 17:53:19,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-01 17:53:19,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-01 17:53:19,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-01 17:53:19,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-01 17:53:19,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-01 17:53:19,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-01 17:53:19,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-01 17:53:19,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-01 17:53:19,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-01 17:53:19,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-01 17:53:19,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-01 17:53:19,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-01 17:53:19,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-01 17:53:19,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-01 17:53:19,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-02-01 17:53:19,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-02-01 17:53:19,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-02-01 17:53:19,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-02-01 17:53:19,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-02-01 17:53:19,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-02-01 17:53:19,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-02-01 17:53:19,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-02-01 17:53:19,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-02-01 17:53:19,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-02-01 17:53:19,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-02-01 17:53:19,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-02-01 17:53:19,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-02-01 17:53:19,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-02-01 17:53:19,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-02-01 17:53:19,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-02-01 17:53:19,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-02-01 17:53:19,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-02-01 17:53:19,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-02-01 17:53:19,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-02-01 17:53:19,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-02-01 17:53:19,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-02-01 17:53:19,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-02-01 17:53:19,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-02-01 17:53:19,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-02-01 17:53:19,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-02-01 17:53:19,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-02-01 17:53:19,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-02-01 17:53:19,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-02-01 17:53:19,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-02-01 17:53:19,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-02-01 17:53:19,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-02-01 17:53:19,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-02-01 17:53:19,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-02-01 17:53:19,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-02-01 17:53:19,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-02-01 17:53:19,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-02-01 17:53:19,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-02-01 17:53:19,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-02-01 17:53:19,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-02-01 17:53:19,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-02-01 17:53:19,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-02-01 17:53:19,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-02-01 17:53:19,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-02-01 17:53:19,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-02-01 17:53:19,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-02-01 17:53:19,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-02-01 17:53:19,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-02-01 17:53:19,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-02-01 17:53:19,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-02-01 17:53:19,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-02-01 17:53:19,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-02-01 17:53:19,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-02-01 17:53:19,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-02-01 17:53:19,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-02-01 17:53:19,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-02-01 17:53:19,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-02-01 17:53:19,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-02-01 17:53:19,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-02-01 17:53:19,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-02-01 17:53:19,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-02-01 17:53:19,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-02-01 17:53:19,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-02-01 17:53:19,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-02-01 17:53:19,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-02-01 17:53:19,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-02-01 17:53:19,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-02-01 17:53:19,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-02-01 17:53:19,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-02-01 17:53:19,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-02-01 17:53:19,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-02-01 17:53:19,233 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.040592322248356315, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05656060583511695, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.040592322248356315, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.16575, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23183333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-01 17:53:19,233 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-02-01 17:53:19,233 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.1705423312535787, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.040592322248356315, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05656060583511695, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.040592322248356315, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.16575, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23183333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-02-01 17:53:19,548 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 440 ms to try 5000 different iterations.  Found a solution that moves 2603 regions; Going from a computed imbalance of 0.1705423312535787 to a new imbalance of 0.013440873205167703. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.019341961772855312); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0328654024794263, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2892222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.019341961772855312); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01025); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043916666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-01 17:53:19,569 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1333471514:79 , srv902628583:80 , srv1007671693:81 , srv552015165:81 , srv1604651428:82 , srv876861808:82 , srv892166019:82 , srv1602804318:83 , srv1611000270:83 , srv1776048077:83 , srv2053727904:83 , srv39849286:83 , srv87036496:83 , srv961375741:83 , srv1018740954:84 , srv1141555214:84 , srv1292580569:84 , srv1598605738:84 , srv1629209377:84 , srv1871562847:84 , srv1949946656:84 , srv2048138472:84 , srv2085610781:84 , srv438703811:84 , srv448955297:84 , srv678880411:84 , srv758060520:84 , srv953523509:84 , srv1062570027:85 , srv128824318:85 , srv1485054741:85 , srv1532851277:85 , srv1665504576:85 , srv1723690852:85 , srv176647068:85 , srv1774956269:85 , srv1806846272:85 , srv1986907377:85 , srv2077712364:85 , srv531581802:85 , srv746486083:85 , srv979616142:85 , srv983010675:85 , srv1008459418:86 , srv1094075566:86 , srv1132462253:86 , srv1179995335:86 , srv13434221:86 , srv1394287833:86 , srv142467737:86 , srv1458009148:86 , srv1542191772:86 , srv1876532591:86 , srv1931386307:86 , srv1943717118:86 , srv222703231:86 , srv246720929:86 , srv692679892:86 , srv86538157:86 , srv891853087:86 , srv1247961301:87 , srv14822237:87 , srv1729607363:87 , srv1746003738:87 , srv1766556972:87 , srv1782485663:87 , srv1958154155:87 , srv2060606803:87 , srv282212503:87 , srv388245995:87 , srv564454507:87 , srv599066935:87 , srv776550150:87 , srv1372923351:88 , srv1491476056:88 , srv1522102701:88 , srv164287620:88 , srv430783529:88 , srv437832369:88 , srv694068103:88 , srv716183572:88 , srv840211089:88 , srv864233999:88 , srv93450218:88 , srv1015772650:89 , srv1130048687:89 , srv1515094595:89 , srv1660393700:89 , srv1897016494:89 , srv354180372:89 , srv403070617:89 , srv980166726:89 , srv2129230689:90 , srv228237314:90 , srv533183853:90 , srv700674263:90 , srv117003465:91 , srv1616732388:91 , srv1681582329:91 , srv428088960:495 }
2024-02-01 17:53:19,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-01 17:53:19,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1394287833=17, srv678880411=78, srv1130048687=6, srv564454507=76, srv354180372=64, srv1372923351=16, srv39849286=66, srv87036496=89, srv1943717118=50, srv388245995=65, srv1665504576=35, srv552015165=75, srv1542191772=26, srv876861808=90, srv1094075566=5, srv1776048077=43, srv776550150=85, srv430783529=69, srv1766556972=41, srv1629209377=32, srv1491476056=22, srv14822237=20, srv1015772650=2, srv1782485663=44, srv1746003738=39, srv13434221=15, srv2085610781=58, srv86538157=88, srv1604651428=29, srv716183572=82, srv983010675=99, srv246720929=62, srv438703811=71, srv980166726=98, srv1897016494=48, srv692679892=79, srv1007671693=0, srv979616142=97, srv117003465=9, srv694068103=80, srv1485054741=21, srv1931386307=49, srv176647068=40, srv1611000270=30, srv1008459418=1, srv1871562847=46, srv93450218=94, srv1774956269=42, srv1598605738=27, srv1876532591=47, srv1958154155=52, srv1018740954=3, srv1247961301=11, srv2129230689=59, srv403070617=67, srv128824318=12, srv1723690852=37, srv599066935=77, srv1458009148=19, srv1333471514=14, srv164287620=33, srv1522102701=24, srv758060520=84, srv1660393700=34, srv746486083=83, srv1986907377=53, srv2060606803=56, srv1062570027=4, srv428088960=68, srv1532851277=25, srv531581802=73, srv1806846272=45, srv892166019=92, srv142467737=18, srv533183853=74, srv700674263=81, srv840211089=86, srv1949946656=51, srv953523509=95, srv228237314=61, srv1681582329=36, srv961375741=96, srv1616732388=31, srv222703231=60, srv864233999=87, srv1292580569=13, srv2048138472=54, srv1602804318=28, srv2077712364=57, srv1515094595=23, srv282212503=63, srv2053727904=55, srv437832369=70, srv891853087=91, srv1729607363=38, srv902628583=93, srv1179995335=10, srv1141555214=8, srv1132462253=7, srv448955297=72} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-01 17:53:19,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-01 17:53:19,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-01 17:53:19,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-01 17:53:19,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-01 17:53:19,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-01 17:53:19,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-01 17:53:19,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-01 17:53:19,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-01 17:53:19,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-01 17:53:19,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-01 17:53:19,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-01 17:53:19,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-01 17:53:19,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-01 17:53:19,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-01 17:53:19,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-01 17:53:19,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-01 17:53:19,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-01 17:53:19,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-01 17:53:19,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-01 17:53:19,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-01 17:53:19,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-01 17:53:19,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-01 17:53:19,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-01 17:53:19,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-01 17:53:19,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-01 17:53:19,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-01 17:53:19,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-01 17:53:19,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-01 17:53:19,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-01 17:53:19,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-01 17:53:19,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-02-01 17:53:19,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-02-01 17:53:19,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-02-01 17:53:19,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-02-01 17:53:19,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-02-01 17:53:19,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-02-01 17:53:19,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-02-01 17:53:19,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-02-01 17:53:19,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-02-01 17:53:19,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-02-01 17:53:19,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-02-01 17:53:19,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-02-01 17:53:19,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-02-01 17:53:19,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-02-01 17:53:19,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-02-01 17:53:19,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-02-01 17:53:19,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-02-01 17:53:19,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-02-01 17:53:19,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-02-01 17:53:19,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-02-01 17:53:19,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-02-01 17:53:19,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-02-01 17:53:19,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-02-01 17:53:19,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-02-01 17:53:19,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-02-01 17:53:19,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-02-01 17:53:19,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-02-01 17:53:19,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-02-01 17:53:19,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-02-01 17:53:19,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-02-01 17:53:19,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-02-01 17:53:19,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-02-01 17:53:19,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-02-01 17:53:19,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-02-01 17:53:19,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-02-01 17:53:19,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-02-01 17:53:19,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-02-01 17:53:19,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-02-01 17:53:19,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-02-01 17:53:19,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-02-01 17:53:19,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-02-01 17:53:19,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-02-01 17:53:19,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-02-01 17:53:19,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-02-01 17:53:19,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-02-01 17:53:19,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-02-01 17:53:19,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-02-01 17:53:19,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-02-01 17:53:19,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-02-01 17:53:19,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-02-01 17:53:19,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-02-01 17:53:19,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-02-01 17:53:19,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-02-01 17:53:19,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-02-01 17:53:19,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-02-01 17:53:19,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-02-01 17:53:19,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-02-01 17:53:19,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-02-01 17:53:19,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-02-01 17:53:19,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-02-01 17:53:19,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-02-01 17:53:19,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-02-01 17:53:19,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-02-01 17:53:19,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-02-01 17:53:19,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-02-01 17:53:19,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-02-01 17:53:19,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-02-01 17:53:19,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-02-01 17:53:19,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-02-01 17:53:19,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-02-01 17:53:19,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-02-01 17:53:19,765 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.019341961772855312); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0328654024794263, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.019341961772855312); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01025); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043916666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-01 17:53:19,765 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-02-01 17:53:19,765 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.013422646609602866, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.019341961772855312); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0328654024794263, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.019341961772855312); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01025); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043916666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-02-01 17:53:20,004 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 378 ms to try 5000 different iterations.  Found a solution that moves 976 regions; Going from a computed imbalance of 0.013422646609602866 to a new imbalance of 6.446475210360961E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004880413017956434); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00813742790348397); MoveCostFunction : (multiplier=7.0, imbalance=0.10844444444444444, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.004880413017956434); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003916666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-01 17:53:20,006 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv533183853:82 , srv1007671693:83 , srv1394287833:83 , srv1681582329:83 , srv430783529:83 , srv840211089:83 , srv86538157:83 , srv876861808:83 , srv1015772650:84 , srv117003465:84 , srv13434221:84 , srv14822237:84 , srv1491476056:84 , srv1515094595:84 , srv1604651428:84 , srv1616732388:84 , srv1660393700:84 , srv246720929:84 , srv282212503:84 , srv564454507:84 , srv694068103:84 , srv746486083:84 , srv776550150:84 , srv864233999:84 , srv1008459418:85 , srv1130048687:85 , srv1141555214:85 , srv1179995335:85 , srv128824318:85 , srv1372923351:85 , srv1629209377:85 , srv1665504576:85 , srv1729607363:85 , srv1766556972:85 , srv1776048077:85 , srv1782485663:85 , srv1871562847:85 , srv1986907377:85 , srv2048138472:85 , srv2060606803:85 , srv2077712364:85 , srv2085610781:85 , srv228237314:85 , srv354180372:85 , srv39849286:85 , srv437832369:85 , srv448955297:85 , srv678880411:85 , srv692679892:85 , srv700674263:85 , srv93450218:85 , srv961375741:85 , srv979616142:85 , srv980166726:85 , srv1018740954:86 , srv1062570027:86 , srv1132462253:86 , srv1247961301:86 , srv1292580569:86 , srv1333471514:86 , srv142467737:86 , srv1458009148:86 , srv1485054741:86 , srv1522102701:86 , srv1542191772:86 , srv1598605738:86 , srv1602804318:86 , srv164287620:86 , srv1723690852:86 , srv1746003738:86 , srv176647068:86 , srv1806846272:86 , srv1876532591:86 , srv1897016494:86 , srv1943717118:86 , srv1958154155:86 , srv222703231:86 , srv388245995:86 , srv438703811:86 , srv531581802:86 , srv599066935:86 , srv758060520:86 , srv891853087:86 , srv902628583:86 , srv1094075566:87 , srv1532851277:87 , srv1611000270:87 , srv1774956269:87 , srv1931386307:87 , srv1949946656:87 , srv2129230689:87 , srv403070617:87 , srv716183572:87 , srv892166019:87 , srv953523509:87 , srv983010675:87 , srv2053727904:88 , srv552015165:88 , srv87036496:88 , srv428088960:555 }
2024-02-01 17:53:20,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-01 17:53:20,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1394287833=17, srv678880411=78, srv1130048687=6, srv564454507=76, srv354180372=64, srv1372923351=16, srv39849286=66, srv87036496=89, srv1943717118=50, srv388245995=65, srv1665504576=35, srv552015165=75, srv1542191772=26, srv876861808=90, srv1094075566=5, srv1776048077=43, srv776550150=85, srv430783529=69, srv1766556972=41, srv1629209377=32, srv1491476056=22, srv14822237=20, srv1015772650=2, srv1782485663=44, srv1746003738=39, srv13434221=15, srv2085610781=58, srv86538157=88, srv1604651428=29, srv716183572=82, srv983010675=99, srv246720929=62, srv438703811=71, srv980166726=98, srv1897016494=48, srv692679892=79, srv1007671693=0, srv979616142=97, srv117003465=9, srv694068103=80, srv1485054741=21, srv1931386307=49, srv176647068=40, srv1611000270=30, srv1008459418=1, srv1871562847=46, srv93450218=94, srv1774956269=42, srv1598605738=27, srv1876532591=47, srv1958154155=52, srv1018740954=3, srv1247961301=11, srv2129230689=59, srv403070617=67, srv128824318=12, srv1723690852=37, srv599066935=77, srv1458009148=19, srv1333471514=14, srv164287620=33, srv1522102701=24, srv758060520=84, srv1660393700=34, srv746486083=83, srv1986907377=53, srv2060606803=56, srv1062570027=4, srv428088960=68, srv1532851277=25, srv531581802=73, srv1806846272=45, srv892166019=92, srv142467737=18, srv533183853=74, srv700674263=81, srv840211089=86, srv1949946656=51, srv953523509=95, srv228237314=61, srv1681582329=36, srv961375741=96, srv1616732388=31, srv222703231=60, srv864233999=87, srv1292580569=13, srv2048138472=54, srv1602804318=28, srv2077712364=57, srv1515094595=23, srv282212503=63, srv2053727904=55, srv437832369=70, srv891853087=91, srv1729607363=38, srv902628583=93, srv1179995335=10, srv1141555214=8, srv1132462253=7, srv448955297=72} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-01 17:53:20,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-01 17:53:20,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-01 17:53:20,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-01 17:53:20,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-01 17:53:20,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-01 17:53:20,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-01 17:53:20,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-01 17:53:20,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-01 17:53:20,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-01 17:53:20,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-01 17:53:20,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-01 17:53:20,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-01 17:53:20,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-01 17:53:20,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-01 17:53:20,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-01 17:53:20,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-01 17:53:20,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-01 17:53:20,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-01 17:53:20,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-01 17:53:20,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-01 17:53:20,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-01 17:53:20,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-01 17:53:20,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-01 17:53:20,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-01 17:53:20,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-01 17:53:20,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-01 17:53:20,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-01 17:53:20,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-01 17:53:20,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-01 17:53:20,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-01 17:53:20,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-02-01 17:53:20,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-02-01 17:53:20,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-02-01 17:53:20,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-02-01 17:53:20,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-02-01 17:53:20,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-02-01 17:53:20,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-02-01 17:53:20,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-02-01 17:53:20,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-02-01 17:53:20,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-02-01 17:53:20,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-02-01 17:53:20,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-02-01 17:53:20,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-02-01 17:53:20,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-02-01 17:53:20,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-02-01 17:53:20,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-02-01 17:53:20,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-02-01 17:53:20,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-02-01 17:53:20,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-02-01 17:53:20,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-02-01 17:53:20,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-02-01 17:53:20,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-02-01 17:53:20,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-02-01 17:53:20,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-02-01 17:53:20,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-02-01 17:53:20,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-02-01 17:53:20,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-02-01 17:53:20,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-02-01 17:53:20,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-02-01 17:53:20,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-02-01 17:53:20,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-02-01 17:53:20,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-02-01 17:53:20,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-02-01 17:53:20,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-02-01 17:53:20,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-02-01 17:53:20,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-02-01 17:53:20,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-02-01 17:53:20,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-02-01 17:53:20,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-02-01 17:53:20,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-02-01 17:53:20,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-02-01 17:53:20,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-02-01 17:53:20,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-02-01 17:53:20,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-02-01 17:53:20,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-02-01 17:53:20,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-02-01 17:53:20,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-02-01 17:53:20,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-02-01 17:53:20,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-02-01 17:53:20,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-02-01 17:53:20,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-02-01 17:53:20,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-02-01 17:53:20,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-02-01 17:53:20,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-02-01 17:53:20,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-02-01 17:53:20,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-02-01 17:53:20,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-02-01 17:53:20,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-02-01 17:53:20,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-02-01 17:53:20,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-02-01 17:53:20,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-02-01 17:53:20,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-02-01 17:53:20,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-02-01 17:53:20,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-02-01 17:53:20,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-02-01 17:53:20,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-02-01 17:53:20,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-02-01 17:53:20,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-02-01 17:53:20,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-02-01 17:53:20,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-02-01 17:53:20,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-02-01 17:53:20,182 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004880413017956434); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00813742790348397); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.004880413017956434); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003916666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-01 17:53:20,182 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-02-01 17:53:20,183 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=6.378134229679892E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004880413017956434); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00813742790348397); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.004880413017956434); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003916666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-02-01 17:53:20,608 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 554 ms to try 5000 different iterations.  Found a solution that moves 227 regions; Going from a computed imbalance of 6.378134229679892E-4 to a new imbalance of 4.291467972282225E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0019534423844256277); MoveCostFunction : (multiplier=7.0, imbalance=0.025222222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-01 17:53:20,609 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1141555214:83 , srv128824318:83 , srv1746003738:83 , srv2129230689:83 , srv448955297:83 , srv87036496:83 , srv892166019:83 , srv1008459418:84 , srv1015772650:84 , srv1018740954:84 , srv1094075566:84 , srv1130048687:84 , srv1292580569:84 , srv1333471514:84 , srv13434221:84 , srv1372923351:84 , srv142467737:84 , srv1458009148:84 , srv14822237:84 , srv1515094595:84 , srv1532851277:84 , srv1542191772:84 , srv1598605738:84 , srv1602804318:84 , srv1611000270:84 , srv1629209377:84 , srv164287620:84 , srv1665504576:84 , srv1729607363:84 , srv176647068:84 , srv1876532591:84 , srv1897016494:84 , srv1931386307:84 , srv1949946656:84 , srv1958154155:84 , srv2060606803:84 , srv222703231:84 , srv228237314:84 , srv388245995:84 , srv403070617:84 , srv437832369:84 , srv438703811:84 , srv552015165:84 , srv564454507:84 , srv599066935:84 , srv700674263:84 , srv746486083:84 , srv776550150:84 , srv891853087:84 , srv902628583:84 , srv980166726:84 , srv983010675:84 , srv1007671693:85 , srv1062570027:85 , srv1132462253:85 , srv117003465:85 , srv1179995335:85 , srv1247961301:85 , srv1394287833:85 , srv1485054741:85 , srv1491476056:85 , srv1522102701:85 , srv1604651428:85 , srv1616732388:85 , srv1660393700:85 , srv1681582329:85 , srv1723690852:85 , srv1766556972:85 , srv1774956269:85 , srv1776048077:85 , srv1782485663:85 , srv1806846272:85 , srv1871562847:85 , srv1943717118:85 , srv1986907377:85 , srv2048138472:85 , srv2053727904:85 , srv2077712364:85 , srv2085610781:85 , srv282212503:85 , srv354180372:85 , srv39849286:85 , srv531581802:85 , srv533183853:85 , srv678880411:85 , srv692679892:85 , srv694068103:85 , srv716183572:85 , srv758060520:85 , srv840211089:85 , srv864233999:85 , srv86538157:85 , srv93450218:85 , srv953523509:85 , srv961375741:85 , srv979616142:85 , srv246720929:86 , srv430783529:86 , srv876861808:86 , srv428088960:641 }
2024-02-01 17:53:20,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-01 17:53:20,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1394287833=17, srv678880411=78, srv1130048687=6, srv564454507=76, srv354180372=64, srv1372923351=16, srv39849286=66, srv87036496=89, srv1943717118=50, srv388245995=65, srv1665504576=35, srv552015165=75, srv1542191772=26, srv876861808=90, srv1094075566=5, srv1776048077=43, srv776550150=85, srv430783529=69, srv1766556972=41, srv1629209377=32, srv1491476056=22, srv14822237=20, srv1015772650=2, srv1782485663=44, srv1746003738=39, srv13434221=15, srv2085610781=58, srv86538157=88, srv1604651428=29, srv716183572=82, srv983010675=99, srv246720929=62, srv438703811=71, srv980166726=98, srv1897016494=48, srv692679892=79, srv1007671693=0, srv979616142=97, srv117003465=9, srv694068103=80, srv1485054741=21, srv1931386307=49, srv176647068=40, srv1611000270=30, srv1008459418=1, srv1871562847=46, srv93450218=94, srv1774956269=42, srv1598605738=27, srv1876532591=47, srv1958154155=52, srv1018740954=3, srv1247961301=11, srv2129230689=59, srv403070617=67, srv128824318=12, srv1723690852=37, srv599066935=77, srv1458009148=19, srv1333471514=14, srv164287620=33, srv1522102701=24, srv758060520=84, srv1660393700=34, srv746486083=83, srv1986907377=53, srv2060606803=56, srv1062570027=4, srv428088960=68, srv1532851277=25, srv531581802=73, srv1806846272=45, srv892166019=92, srv142467737=18, srv533183853=74, srv700674263=81, srv840211089=86, srv1949946656=51, srv953523509=95, srv228237314=61, srv1681582329=36, srv961375741=96, srv1616732388=31, srv222703231=60, srv864233999=87, srv1292580569=13, srv2048138472=54, srv1602804318=28, srv2077712364=57, srv1515094595=23, srv282212503=63, srv2053727904=55, srv437832369=70, srv891853087=91, srv1729607363=38, srv902628583=93, srv1179995335=10, srv1141555214=8, srv1132462253=7, srv448955297=72} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-01 17:53:20,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-01 17:53:20,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-01 17:53:20,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-01 17:53:20,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-01 17:53:20,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-01 17:53:20,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-01 17:53:20,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-01 17:53:20,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-01 17:53:20,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-01 17:53:20,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-01 17:53:20,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-01 17:53:20,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-01 17:53:20,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-01 17:53:20,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-01 17:53:20,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-01 17:53:20,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-01 17:53:20,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-01 17:53:20,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-01 17:53:20,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-01 17:53:20,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-01 17:53:20,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-01 17:53:20,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-01 17:53:20,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-01 17:53:20,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-01 17:53:20,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-01 17:53:20,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-01 17:53:20,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-01 17:53:20,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-01 17:53:20,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-01 17:53:20,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-01 17:53:20,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-02-01 17:53:20,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-02-01 17:53:20,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-02-01 17:53:20,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-02-01 17:53:20,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-02-01 17:53:20,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-02-01 17:53:20,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-02-01 17:53:20,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-02-01 17:53:20,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-02-01 17:53:20,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-02-01 17:53:20,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-02-01 17:53:20,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-02-01 17:53:20,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-02-01 17:53:20,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-02-01 17:53:20,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-02-01 17:53:20,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-02-01 17:53:20,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-02-01 17:53:20,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-02-01 17:53:20,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-02-01 17:53:20,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-02-01 17:53:20,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-02-01 17:53:20,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-02-01 17:53:20,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-02-01 17:53:20,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-02-01 17:53:20,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-02-01 17:53:20,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-02-01 17:53:20,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-02-01 17:53:20,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-02-01 17:53:20,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-02-01 17:53:20,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-02-01 17:53:20,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-02-01 17:53:20,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-02-01 17:53:20,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-02-01 17:53:20,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-02-01 17:53:20,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-02-01 17:53:20,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-02-01 17:53:20,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-02-01 17:53:20,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-02-01 17:53:20,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-02-01 17:53:20,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-02-01 17:53:20,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-02-01 17:53:20,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-02-01 17:53:20,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-02-01 17:53:20,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-02-01 17:53:20,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-02-01 17:53:20,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-02-01 17:53:20,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-02-01 17:53:20,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-02-01 17:53:20,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-02-01 17:53:20,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-02-01 17:53:20,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-02-01 17:53:20,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-02-01 17:53:20,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-02-01 17:53:20,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-02-01 17:53:20,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-02-01 17:53:20,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-02-01 17:53:20,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-02-01 17:53:20,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-02-01 17:53:20,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-02-01 17:53:20,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-02-01 17:53:20,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-02-01 17:53:20,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-02-01 17:53:20,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-02-01 17:53:20,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-02-01 17:53:20,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-02-01 17:53:20,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-02-01 17:53:20,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-02-01 17:53:20,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-02-01 17:53:20,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-02-01 17:53:20,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-02-01 17:53:20,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-02-01 17:53:20,778 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0019534423844256277); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-01 17:53:20,778 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-02-01 17:53:20,778 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=4.13251917500146E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0019534423844256277); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-02-01 17:53:21,045 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 385 ms to try 5000 different iterations.  Found a solution that moves 33 regions; Going from a computed imbalance of 4.13251917500146E-5 to a new imbalance of 6.975139992610152E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014982219165849825); MoveCostFunction : (multiplier=7.0, imbalance=0.0036666666666666666); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-01 17:53:21,046 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1292580569:83 , srv1485054741:83 , srv1774956269:83 , srv1876532591:83 , srv1943717118:83 , srv2053727904:83 , srv430783529:83 , srv716183572:83 , srv840211089:83 , srv953523509:83 , srv1007671693:84 , srv1008459418:84 , srv1015772650:84 , srv1018740954:84 , srv1062570027:84 , srv1094075566:84 , srv1130048687:84 , srv1132462253:84 , srv117003465:84 , srv1179995335:84 , srv1247961301:84 , srv13434221:84 , srv1372923351:84 , srv1394287833:84 , srv142467737:84 , srv1458009148:84 , srv14822237:84 , srv1491476056:84 , srv1515094595:84 , srv1522102701:84 , srv1532851277:84 , srv1602804318:84 , srv1604651428:84 , srv1611000270:84 , srv1616732388:84 , srv1629209377:84 , srv164287620:84 , srv1660393700:84 , srv1665504576:84 , srv1681582329:84 , srv1723690852:84 , srv1729607363:84 , srv1746003738:84 , srv176647068:84 , srv1766556972:84 , srv1776048077:84 , srv1782485663:84 , srv1806846272:84 , srv1871562847:84 , srv1897016494:84 , srv1931386307:84 , srv1949946656:84 , srv1986907377:84 , srv2048138472:84 , srv2060606803:84 , srv2077712364:84 , srv2085610781:84 , srv2129230689:84 , srv228237314:84 , srv246720929:84 , srv282212503:84 , srv354180372:84 , srv388245995:84 , srv39849286:84 , srv403070617:84 , srv437832369:84 , srv438703811:84 , srv531581802:84 , srv533183853:84 , srv552015165:84 , srv564454507:84 , srv599066935:84 , srv678880411:84 , srv692679892:84 , srv694068103:84 , srv700674263:84 , srv746486083:84 , srv758060520:84 , srv776550150:84 , srv864233999:84 , srv86538157:84 , srv87036496:84 , srv876861808:84 , srv891853087:84 , srv892166019:84 , srv902628583:84 , srv93450218:84 , srv979616142:84 , srv980166726:84 , srv983010675:84 , srv128824318:85 , srv1333471514:85 , srv1542191772:85 , srv1598605738:85 , srv1958154155:85 , srv222703231:85 , srv448955297:85 , srv961375741:85 , srv1141555214:86 , srv428088960:684 }
2024-02-01 17:53:21,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-01 17:53:21,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1394287833=17, srv678880411=78, srv1130048687=6, srv564454507=76, srv354180372=64, srv1372923351=16, srv39849286=66, srv87036496=89, srv1943717118=50, srv388245995=65, srv1665504576=35, srv552015165=75, srv1542191772=26, srv876861808=90, srv1094075566=5, srv1776048077=43, srv776550150=85, srv430783529=69, srv1766556972=41, srv1629209377=32, srv1491476056=22, srv14822237=20, srv1015772650=2, srv1782485663=44, srv1746003738=39, srv13434221=15, srv2085610781=58, srv86538157=88, srv1604651428=29, srv716183572=82, srv983010675=99, srv246720929=62, srv438703811=71, srv980166726=98, srv1897016494=48, srv692679892=79, srv1007671693=0, srv979616142=97, srv117003465=9, srv694068103=80, srv1485054741=21, srv1931386307=49, srv176647068=40, srv1611000270=30, srv1008459418=1, srv1871562847=46, srv93450218=94, srv1774956269=42, srv1598605738=27, srv1876532591=47, srv1958154155=52, srv1018740954=3, srv1247961301=11, srv2129230689=59, srv403070617=67, srv128824318=12, srv1723690852=37, srv599066935=77, srv1458009148=19, srv1333471514=14, srv164287620=33, srv1522102701=24, srv758060520=84, srv1660393700=34, srv746486083=83, srv1986907377=53, srv2060606803=56, srv1062570027=4, srv428088960=68, srv1532851277=25, srv531581802=73, srv1806846272=45, srv892166019=92, srv142467737=18, srv533183853=74, srv700674263=81, srv840211089=86, srv1949946656=51, srv953523509=95, srv228237314=61, srv1681582329=36, srv961375741=96, srv1616732388=31, srv222703231=60, srv864233999=87, srv1292580569=13, srv2048138472=54, srv1602804318=28, srv2077712364=57, srv1515094595=23, srv282212503=63, srv2053727904=55, srv437832369=70, srv891853087=91, srv1729607363=38, srv902628583=93, srv1179995335=10, srv1141555214=8, srv1132462253=7, srv448955297=72} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-01 17:53:21,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-01 17:53:21,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-01 17:53:21,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-01 17:53:21,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-01 17:53:21,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-01 17:53:21,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-01 17:53:21,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-01 17:53:21,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-01 17:53:21,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-01 17:53:21,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-01 17:53:21,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-01 17:53:21,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-01 17:53:21,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-01 17:53:21,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-01 17:53:21,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-01 17:53:21,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-01 17:53:21,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-01 17:53:21,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-01 17:53:21,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-01 17:53:21,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-01 17:53:21,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-01 17:53:21,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-01 17:53:21,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-01 17:53:21,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-01 17:53:21,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-01 17:53:21,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-01 17:53:21,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-01 17:53:21,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-01 17:53:21,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-01 17:53:21,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-01 17:53:21,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-02-01 17:53:21,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-02-01 17:53:21,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-02-01 17:53:21,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-02-01 17:53:21,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-02-01 17:53:21,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-02-01 17:53:21,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-02-01 17:53:21,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-02-01 17:53:21,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-02-01 17:53:21,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-02-01 17:53:21,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-02-01 17:53:21,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-02-01 17:53:21,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-02-01 17:53:21,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-02-01 17:53:21,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-02-01 17:53:21,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-02-01 17:53:21,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-02-01 17:53:21,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-02-01 17:53:21,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-02-01 17:53:21,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-02-01 17:53:21,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-02-01 17:53:21,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-02-01 17:53:21,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-02-01 17:53:21,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-02-01 17:53:21,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-02-01 17:53:21,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-02-01 17:53:21,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-02-01 17:53:21,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-02-01 17:53:21,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-02-01 17:53:21,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-02-01 17:53:21,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-02-01 17:53:21,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-02-01 17:53:21,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-02-01 17:53:21,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-02-01 17:53:21,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-02-01 17:53:21,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-02-01 17:53:21,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-02-01 17:53:21,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-02-01 17:53:21,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-02-01 17:53:21,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-02-01 17:53:21,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-02-01 17:53:21,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-02-01 17:53:21,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-02-01 17:53:21,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-02-01 17:53:21,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-02-01 17:53:21,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-02-01 17:53:21,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-02-01 17:53:21,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-02-01 17:53:21,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-02-01 17:53:21,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-02-01 17:53:21,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-02-01 17:53:21,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-02-01 17:53:21,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-02-01 17:53:21,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-02-01 17:53:21,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-02-01 17:53:21,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-02-01 17:53:21,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-02-01 17:53:21,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-02-01 17:53:21,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-02-01 17:53:21,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-02-01 17:53:21,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-02-01 17:53:21,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-02-01 17:53:21,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-02-01 17:53:21,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-02-01 17:53:21,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-02-01 17:53:21,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-02-01 17:53:21,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-02-01 17:53:21,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-02-01 17:53:21,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-02-01 17:53:21,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-02-01 17:53:21,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-02-01 17:53:21,191 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=6.744069053831948E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014982219165849825); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-01 17:53:21,192 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1292580569:83 , srv1485054741:83 , srv1774956269:83 , srv1876532591:83 , srv1943717118:83 , srv2053727904:83 , srv430783529:83 , srv716183572:83 , srv840211089:83 , srv953523509:83 , srv1007671693:84 , srv1008459418:84 , srv1015772650:84 , srv1018740954:84 , srv1062570027:84 , srv1094075566:84 , srv1130048687:84 , srv1132462253:84 , srv117003465:84 , srv1179995335:84 , srv1247961301:84 , srv13434221:84 , srv1372923351:84 , srv1394287833:84 , srv142467737:84 , srv1458009148:84 , srv14822237:84 , srv1491476056:84 , srv1515094595:84 , srv1522102701:84 , srv1532851277:84 , srv1602804318:84 , srv1604651428:84 , srv1611000270:84 , srv1616732388:84 , srv1629209377:84 , srv164287620:84 , srv1660393700:84 , srv1665504576:84 , srv1681582329:84 , srv1723690852:84 , srv1729607363:84 , srv1746003738:84 , srv176647068:84 , srv1766556972:84 , srv1776048077:84 , srv1782485663:84 , srv1806846272:84 , srv1871562847:84 , srv1897016494:84 , srv1931386307:84 , srv1949946656:84 , srv1986907377:84 , srv2048138472:84 , srv2060606803:84 , srv2077712364:84 , srv2085610781:84 , srv2129230689:84 , srv228237314:84 , srv246720929:84 , srv282212503:84 , srv354180372:84 , srv388245995:84 , srv39849286:84 , srv403070617:84 , srv437832369:84 , srv438703811:84 , srv531581802:84 , srv533183853:84 , srv552015165:84 , srv564454507:84 , srv599066935:84 , srv678880411:84 , srv692679892:84 , srv694068103:84 , srv700674263:84 , srv746486083:84 , srv758060520:84 , srv776550150:84 , srv864233999:84 , srv86538157:84 , srv87036496:84 , srv876861808:84 , srv891853087:84 , srv892166019:84 , srv902628583:84 , srv93450218:84 , srv979616142:84 , srv980166726:84 , srv983010675:84 , srv128824318:85 , srv1333471514:85 , srv1542191772:85 , srv1598605738:85 , srv1958154155:85 , srv222703231:85 , srv448955297:85 , srv961375741:85 , srv1141555214:86 , srv428088960:684 }
2024-02-01 17:53:21,227 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=274 (was 263) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 170), AvailableMemoryMB=1995 (was 2900)
2024-02-01 17:53:21,235 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=274, ProcessCount=170, AvailableMemoryMB=1993
2024-02-01 17:53:21,236 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-02-01 17:53:21,236 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2024-02-01 17:53:21,250 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1004671840:84 , srv1042118693:84 , srv105360552:84 , srv1262600956:84 , srv1268405689:84 , srv1303987311:84 , srv1312077900:84 , srv135680056:84 , srv1384210151:84 , srv1482463901:84 , srv1603538401:84 , srv1640554494:84 , srv1672697084:84 , srv1710737115:84 , srv1745088481:84 , srv182746703:84 , srv1871875330:84 , srv1939605833:84 , srv1953812403:84 , srv2065169810:84 , srv238394841:84 , srv473703400:84 , srv522081770:84 , srv64415148:84 , srv67319602:84 , srv812470195:84 , srv888136980:84 , srv922073863:84 , srv984591509:84 , srv336627335:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2024-02-01 17:53:21,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-01 17:53:21,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv812470195=26, srv1384210151=8, srv984591509=29, srv473703400=22, srv1312077900=6, srv522081770=23, srv64415148=24, srv1672697084=12, srv182746703=15, srv1268405689=4, srv1262600956=3, srv1482463901=9, srv888136980=27, srv1042118693=1, srv1603538401=10, srv1303987311=5, srv1939605833=17, srv1640554494=11, srv135680056=7, srv67319602=25, srv336627335=21, srv105360552=2, srv1745088481=14, srv1871875330=16, srv1953812403=18, srv1710737115=13, srv1004671840=0, srv2065169810=19, srv922073863=28, srv238394841=20} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-01 17:53:21,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-01 17:53:21,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-01 17:53:21,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-01 17:53:21,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-01 17:53:21,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-01 17:53:21,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-01 17:53:21,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-01 17:53:21,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-01 17:53:21,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-01 17:53:21,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-01 17:53:21,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-01 17:53:21,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-01 17:53:21,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-01 17:53:21,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-01 17:53:21,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-01 17:53:21,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-01 17:53:21,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-01 17:53:21,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-01 17:53:21,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-01 17:53:21,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-01 17:53:21,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-01 17:53:21,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-01 17:53:21,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-01 17:53:21,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-01 17:53:21,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-01 17:53:21,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-01 17:53:21,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-01 17:53:21,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-01 17:53:21,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-01 17:53:21,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-01 17:53:21,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-02-01 17:53:21,291 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1673899355200368, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-01 17:53:21,292 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912720483485318, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1673899355200368, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2024-02-01 17:55:21,273 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6907678 different iterations.  Found a solution that moves 1853 regions; Going from a computed imbalance of 0.9912720483485318 to a new imbalance of 4.324994439959734E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6862962962962963, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-01 17:55:21,280 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1004671840:90 , srv1042118693:90 , srv105360552:90 , srv1262600956:90 , srv1268405689:90 , srv1303987311:90 , srv1312077900:90 , srv135680056:90 , srv1384210151:90 , srv1482463901:90 , srv1603538401:90 , srv1640554494:90 , srv1672697084:90 , srv1710737115:90 , srv1745088481:90 , srv182746703:90 , srv1871875330:90 , srv1939605833:90 , srv1953812403:90 , srv2065169810:90 , srv238394841:90 , srv336627335:90 , srv473703400:90 , srv522081770:90 , srv64415148:90 , srv67319602:90 , srv812470195:90 , srv888136980:90 , srv922073863:90 , srv984591509:90 }
2024-02-01 17:55:21,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-01 17:55:21,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv812470195=26, srv1384210151=8, srv984591509=29, srv473703400=22, srv1312077900=6, srv522081770=23, srv64415148=24, srv1672697084=12, srv182746703=15, srv1268405689=4, srv1262600956=3, srv1482463901=9, srv888136980=27, srv1042118693=1, srv1603538401=10, srv1303987311=5, srv1939605833=17, srv1640554494=11, srv135680056=7, srv67319602=25, srv336627335=21, srv105360552=2, srv1745088481=14, srv1871875330=16, srv1953812403=18, srv1710737115=13, srv1004671840=0, srv2065169810=19, srv922073863=28, srv238394841=20} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-01 17:55:21,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-01 17:55:21,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-01 17:55:21,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-01 17:55:21,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-01 17:55:21,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-01 17:55:21,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-01 17:55:21,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-01 17:55:21,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-01 17:55:21,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-01 17:55:21,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-01 17:55:21,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-01 17:55:21,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-01 17:55:21,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-01 17:55:21,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-01 17:55:21,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-01 17:55:21,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-01 17:55:21,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-01 17:55:21,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-01 17:55:21,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-01 17:55:21,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-01 17:55:21,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-01 17:55:21,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-01 17:55:21,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-01 17:55:21,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-01 17:55:21,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-01 17:55:21,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-01 17:55:21,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-01 17:55:21,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-01 17:55:21,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-01 17:55:21,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-01 17:55:21,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-02-01 17:55:21,301 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-01 17:55:21,302 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1004671840:90 , srv1042118693:90 , srv105360552:90 , srv1262600956:90 , srv1268405689:90 , srv1303987311:90 , srv1312077900:90 , srv135680056:90 , srv1384210151:90 , srv1482463901:90 , srv1603538401:90 , srv1640554494:90 , srv1672697084:90 , srv1710737115:90 , srv1745088481:90 , srv182746703:90 , srv1871875330:90 , srv1939605833:90 , srv1953812403:90 , srv2065169810:90 , srv238394841:90 , srv336627335:90 , srv473703400:90 , srv522081770:90 , srv64415148:90 , srv67319602:90 , srv812470195:90 , srv888136980:90 , srv922073863:90 , srv984591509:90 }
2024-02-01 17:55:21,319 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=214 (was 274), ProcessCount=168 (was 170), AvailableMemoryMB=1616 (was 1993)