2023-10-21 12:53:30,231 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-10-21 12:53:30,551 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-10-21 12:53:30,664 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-10-21 12:53:30,734 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-21 12:53:30,741 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-10-21 12:53:30,755 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=394, ProcessCount=169, AvailableMemoryMB=8537
2023-10-21 12:53:30,757 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-21 12:53:30,757 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-10-21 12:53:30,871 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1004091010:84 , srv1036564002:84 , srv1053615459:84 , srv1068352822:84 , srv1100183078:84 , srv1124370603:84 , srv1130024055:84 , srv1146046704:84 , srv1154619431:84 , srv1162769704:84 , srv1192930424:84 , srv1207754388:84 , srv1207937159:84 , srv1259120015:84 , srv1275401027:84 , srv1292815979:84 , srv1301173131:84 , srv1336706340:84 , srv1350544078:84 , srv1372362974:84 , srv1387412914:84 , srv1443169964:84 , srv1446797564:84 , srv1452187599:84 , srv1497894703:84 , srv1526135533:84 , srv1529102754:84 , srv1551292315:84 , srv1615730542:84 , srv1637678156:84 , srv1646695037:84 , srv1651776250:84 , srv1668223239:84 , srv1672874496:84 , srv1694651792:84 , srv1727108606:84 , srv1766207854:84 , srv1813413153:84 , srv1817071388:84 , srv1818182406:84 , srv1867585236:84 , srv1896056489:84 , srv1896671301:84 , srv1922803761:84 , srv1925111573:84 , srv1976041539:84 , srv1991927986:84 , srv2007527891:84 , srv2047548569:84 , srv2053513115:84 , srv2055904262:84 , srv2116213777:84 , srv225528460:84 , srv247094772:84 , srv272017481:84 , srv294172726:84 , srv300919167:84 , srv305046845:84 , srv319620898:84 , srv339912147:84 , srv353728440:84 , srv357016338:84 , srv360423484:84 , srv390601888:84 , srv465215323:84 , srv469495183:84 , srv474861327:84 , srv486944983:84 , srv490562152:84 , srv500959746:84 , srv511361048:84 , srv555840245:84 , srv565082449:84 , srv598569259:84 , srv661683491:84 , srv680486186:84 , srv68255096:84 , srv685679499:84 , srv689975649:84 , srv703384534:84 , srv715006439:84 , srv717375950:84 , srv742593276:84 , srv746234250:84 , srv755715503:84 , srv759350782:84 , srv760526686:84 , srv766425320:84 , srv780254667:84 , srv807745701:84 , srv838093634:84 , srv866452256:84 , srv89074917:84 , srv90400928:84 , srv906961131:84 , srv924108703:84 , srv951123853:84 , srv984999:84 , srv994601822:84 , srv1466724998:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-10-21 12:53:30,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-21 12:53:30,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1668223239=33, srv1004091010=0, srv490562152=69, srv565082449=73, srv486944983=68, srv500959746=70, srv924108703=96, srv465215323=65, srv703384534=80, srv294172726=56, srv906961131=95, srv469495183=66, srv755715503=85, srv1818182406=40, srv760526686=87, srv1637678156=30, srv272017481=55, srv1068352822=3, srv1036564002=1, srv984999=98, srv598569259=74, srv474861327=67, srv685679499=78, srv1551292315=28, srv1925111573=45, srv225528460=53, srv1130024055=6, srv2116213777=52, srv390601888=64, srv661683491=75, srv1100183078=4, srv357016338=62, srv339912147=60, srv1146046704=7, srv1922803761=44, srv319620898=59, srv353728440=61, srv766425320=88, srv1526135533=26, srv1124370603=5, srv780254667=89, srv1646695037=31, srv1991927986=47, srv1350544078=18, srv1154619431=8, srv715006439=81, srv1896056489=42, srv2053513115=50, srv759350782=86, srv2047548569=49, srv1053615459=2, srv717375950=82, srv1497894703=25, srv1275401027=14, srv866452256=92, srv838093634=91, srv360423484=63, srv1529102754=27, srv90400928=94, srv2007527891=48, srv300919167=57, srv1207937159=12, srv807745701=90, srv1813413153=38, srv89074917=93, srv1651776250=32, srv247094772=54, srv689975649=79, srv1372362974=19, srv2055904262=51, srv1443169964=21, srv1867585236=41, srv1466724998=24, srv951123853=97, srv746234250=84, srv555840245=72, srv305046845=58, srv680486186=76, srv1817071388=39, srv742593276=83, srv1336706340=17, srv68255096=77, srv1694651792=35, srv1192930424=10, srv994601822=99, srv1766207854=37, srv1301173131=16, srv1259120015=13, srv1452187599=23, srv1446797564=22, srv1207754388=11, srv511361048=71, srv1387412914=20, srv1292815979=15, srv1672874496=34, srv1976041539=46, srv1727108606=36, srv1162769704=9, srv1615730542=29, srv1896671301=43} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-21 12:53:30,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-21 12:53:30,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-21 12:53:30,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-21 12:53:30,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-21 12:53:30,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-21 12:53:30,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-21 12:53:30,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-21 12:53:30,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-21 12:53:30,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-21 12:53:30,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-21 12:53:30,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-21 12:53:30,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-21 12:53:30,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-21 12:53:30,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-21 12:53:30,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-21 12:53:30,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-21 12:53:30,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-21 12:53:30,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-21 12:53:30,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-21 12:53:30,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-21 12:53:30,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-21 12:53:30,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-21 12:53:30,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-21 12:53:30,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-21 12:53:30,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-21 12:53:30,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-21 12:53:30,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-21 12:53:30,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-21 12:53:30,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-21 12:53:30,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-21 12:53:30,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-21 12:53:30,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-21 12:53:30,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-21 12:53:30,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-21 12:53:30,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-21 12:53:30,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-21 12:53:30,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-21 12:53:30,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-21 12:53:30,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-21 12:53:30,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-21 12:53:30,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-21 12:53:30,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-21 12:53:30,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-21 12:53:30,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-21 12:53:30,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-21 12:53:30,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-21 12:53:30,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-21 12:53:30,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-21 12:53:30,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-21 12:53:30,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-21 12:53:30,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-21 12:53:30,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-21 12:53:30,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-21 12:53:30,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-21 12:53:30,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-21 12:53:30,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-21 12:53:30,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-21 12:53:30,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-21 12:53:30,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-21 12:53:30,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-21 12:53:30,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-21 12:53:30,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-21 12:53:30,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-21 12:53:30,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-21 12:53:30,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-21 12:53:30,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-21 12:53:30,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-21 12:53:30,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-21 12:53:30,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-21 12:53:30,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-21 12:53:30,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-21 12:53:30,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-21 12:53:30,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-21 12:53:30,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-21 12:53:30,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-21 12:53:30,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-21 12:53:30,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-21 12:53:30,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-21 12:53:30,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-21 12:53:30,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-21 12:53:30,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-21 12:53:30,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-21 12:53:30,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-21 12:53:30,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-21 12:53:30,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-21 12:53:30,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-21 12:53:30,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-21 12:53:30,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-21 12:53:30,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-21 12:53:30,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-21 12:53:30,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-21 12:53:30,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-21 12:53:30,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-21 12:53:30,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-21 12:53:30,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-21 12:53:30,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-21 12:53:30,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-21 12:53:30,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-21 12:53:30,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-21 12:53:30,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-21 12:53:30,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-21 12:53:31,179 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-21 12:53:31,179 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-21 12:53:31,180 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-21 12:53:31,569 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 554 ms to try 5000 different iterations.  Found a solution that moves 4724 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.174929880239833. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04028022555354821, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05759099567978878, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5248888888888888, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04028022555354821, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17008333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23683333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-21 12:53:31,587 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1350544078:82 , srv1551292315:82 , srv1124370603:83 , srv1192930424:83 , srv1497894703:83 , srv1615730542:83 , srv1813413153:83 , srv357016338:83 , srv474861327:83 , srv486944983:83 , srv565082449:83 , srv717375950:83 , srv760526686:83 , srv90400928:83 , srv1207754388:84 , srv1259120015:84 , srv1446797564:84 , srv1452187599:84 , srv1817071388:84 , srv1896671301:84 , srv1976041539:84 , srv272017481:84 , srv703384534:84 , srv780254667:84 , srv1275401027:85 , srv1292815979:85 , srv1336706340:85 , srv1443169964:85 , srv1727108606:85 , srv1925111573:85 , srv2053513115:85 , srv247094772:85 , srv360423484:85 , srv390601888:85 , srv465215323:85 , srv555840245:85 , srv715006439:85 , srv838093634:85 , srv1162769704:86 , srv1301173131:86 , srv1646695037:86 , srv1668223239:86 , srv1818182406:86 , srv1896056489:86 , srv1991927986:86 , srv300919167:86 , srv305046845:86 , srv353728440:86 , srv500959746:86 , srv680486186:86 , srv746234250:86 , srv766425320:86 , srv89074917:86 , srv951123853:86 , srv994601822:86 , srv1036564002:87 , srv1100183078:87 , srv1372362974:87 , srv1526135533:87 , srv1651776250:87 , srv225528460:87 , srv294172726:87 , srv339912147:87 , srv490562152:87 , srv511361048:87 , srv755715503:87 , srv759350782:87 , srv807745701:87 , srv866452256:87 , srv906961131:87 , srv1068352822:88 , srv1130024055:88 , srv1154619431:88 , srv1387412914:88 , srv1672874496:88 , srv1694651792:88 , srv1867585236:88 , srv319620898:88 , srv661683491:88 , srv68255096:88 , srv685679499:88 , srv689975649:88 , srv924108703:88 , srv984999:88 , srv1053615459:89 , srv1766207854:89 , srv1004091010:90 , srv1207937159:90 , srv1529102754:90 , srv1922803761:90 , srv2047548569:90 , srv598569259:90 , srv2007527891:91 , srv2055904262:91 , srv2116213777:91 , srv469495183:91 , srv742593276:92 , srv1637678156:93 , srv1146046704:96 , srv1466724998:448 }
2023-10-21 12:53:31,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-21 12:53:31,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1668223239=33, srv1004091010=0, srv490562152=69, srv565082449=73, srv486944983=68, srv500959746=70, srv924108703=96, srv465215323=65, srv703384534=80, srv294172726=56, srv906961131=95, srv469495183=66, srv755715503=85, srv1818182406=40, srv760526686=87, srv1637678156=30, srv272017481=55, srv1068352822=3, srv1036564002=1, srv984999=98, srv598569259=74, srv474861327=67, srv685679499=78, srv1551292315=28, srv1925111573=45, srv225528460=53, srv1130024055=6, srv2116213777=52, srv390601888=64, srv661683491=75, srv1100183078=4, srv357016338=62, srv339912147=60, srv1146046704=7, srv1922803761=44, srv319620898=59, srv353728440=61, srv766425320=88, srv1526135533=26, srv1124370603=5, srv780254667=89, srv1646695037=31, srv1991927986=47, srv1350544078=18, srv1154619431=8, srv715006439=81, srv1896056489=42, srv2053513115=50, srv759350782=86, srv2047548569=49, srv1053615459=2, srv717375950=82, srv1497894703=25, srv1275401027=14, srv866452256=92, srv838093634=91, srv360423484=63, srv1529102754=27, srv90400928=94, srv2007527891=48, srv300919167=57, srv1207937159=12, srv807745701=90, srv1813413153=38, srv89074917=93, srv1651776250=32, srv247094772=54, srv689975649=79, srv1372362974=19, srv2055904262=51, srv1443169964=21, srv1867585236=41, srv1466724998=24, srv951123853=97, srv746234250=84, srv555840245=72, srv305046845=58, srv680486186=76, srv1817071388=39, srv742593276=83, srv1336706340=17, srv68255096=77, srv1694651792=35, srv1192930424=10, srv994601822=99, srv1766207854=37, srv1301173131=16, srv1259120015=13, srv1452187599=23, srv1446797564=22, srv1207754388=11, srv511361048=71, srv1387412914=20, srv1292815979=15, srv1672874496=34, srv1976041539=46, srv1727108606=36, srv1162769704=9, srv1615730542=29, srv1896671301=43} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-21 12:53:31,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-21 12:53:31,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-21 12:53:31,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-21 12:53:31,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-21 12:53:31,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-21 12:53:31,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-21 12:53:31,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-21 12:53:31,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-21 12:53:31,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-21 12:53:31,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-21 12:53:31,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-21 12:53:31,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-21 12:53:31,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-21 12:53:31,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-21 12:53:31,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-21 12:53:31,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-21 12:53:31,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-21 12:53:31,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-21 12:53:31,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-21 12:53:31,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-21 12:53:31,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-21 12:53:31,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-21 12:53:31,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-21 12:53:31,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-21 12:53:31,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-21 12:53:31,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-21 12:53:31,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-21 12:53:31,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-21 12:53:31,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-21 12:53:31,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-21 12:53:31,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-21 12:53:31,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-21 12:53:31,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-21 12:53:31,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-21 12:53:31,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-21 12:53:31,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-21 12:53:31,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-21 12:53:31,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-21 12:53:31,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-21 12:53:31,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-21 12:53:31,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-21 12:53:31,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-21 12:53:31,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-21 12:53:31,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-21 12:53:31,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-21 12:53:31,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-21 12:53:31,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-21 12:53:31,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-21 12:53:31,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-21 12:53:31,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-21 12:53:31,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-21 12:53:31,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-21 12:53:31,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-21 12:53:31,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-21 12:53:31,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-21 12:53:31,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-21 12:53:31,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-21 12:53:31,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-21 12:53:31,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-21 12:53:31,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-21 12:53:31,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-21 12:53:31,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-21 12:53:31,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-21 12:53:31,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-21 12:53:31,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-21 12:53:31,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-21 12:53:31,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-21 12:53:31,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-21 12:53:31,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-21 12:53:31,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-21 12:53:31,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-21 12:53:31,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-21 12:53:31,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-21 12:53:31,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-21 12:53:31,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-21 12:53:31,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-21 12:53:31,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-21 12:53:31,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-21 12:53:31,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-21 12:53:31,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-21 12:53:31,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-21 12:53:31,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-21 12:53:31,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-21 12:53:31,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-21 12:53:31,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-21 12:53:31,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-21 12:53:31,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-21 12:53:31,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-21 12:53:31,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-21 12:53:31,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-21 12:53:31,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-21 12:53:31,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-21 12:53:31,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-21 12:53:31,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-21 12:53:31,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-21 12:53:31,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-21 12:53:31,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-21 12:53:31,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-21 12:53:31,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-21 12:53:31,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-21 12:53:31,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-21 12:53:31,822 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04028022555354821, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05759099567978878, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04028022555354821, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17008333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23683333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-21 12:53:31,822 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-21 12:53:31,822 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.1748968020848394, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04028022555354821, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05759099567978878, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04028022555354821, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17008333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23683333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-21 12:53:32,116 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 449 ms to try 5000 different iterations.  Found a solution that moves 2565 regions; Going from a computed imbalance of 0.1748968020848394 to a new imbalance of 0.01529929994731955. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022048705283166246); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.036218565843839146, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.285, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022048705283166246); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012583333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.040916666666666664, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-21 12:53:32,126 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1146046704:78 , srv1637678156:78 , srv2007527891:80 , srv469495183:80 , srv1529102754:81 , srv1922803761:81 , srv2116213777:81 , srv742593276:81 , srv2047548569:82 , srv2055904262:82 , srv685679499:82 , srv1004091010:83 , srv1053615459:83 , srv1154619431:83 , srv1207937159:83 , srv1668223239:83 , srv1694651792:83 , srv1766207854:83 , srv598569259:83 , srv755715503:83 , srv1068352822:84 , srv1387412914:84 , srv1651776250:84 , srv1672874496:84 , srv1818182406:84 , srv1867585236:84 , srv339912147:84 , srv490562152:84 , srv68255096:84 , srv759350782:84 , srv807745701:84 , srv866452256:84 , srv89074917:84 , srv924108703:84 , srv984999:84 , srv1301173131:85 , srv1526135533:85 , srv1896671301:85 , srv1991927986:85 , srv319620898:85 , srv661683491:85 , srv689975649:85 , srv766425320:85 , srv1036564002:86 , srv1100183078:86 , srv1130024055:86 , srv1162769704:86 , srv1372362974:86 , srv1446797564:86 , srv1452187599:86 , srv1896056489:86 , srv1925111573:86 , srv2053513115:86 , srv225528460:86 , srv305046845:86 , srv353728440:86 , srv360423484:86 , srv500959746:86 , srv680486186:86 , srv715006439:86 , srv951123853:86 , srv994601822:86 , srv1192930424:87 , srv1646695037:87 , srv1727108606:87 , srv247094772:87 , srv272017481:87 , srv294172726:87 , srv300919167:87 , srv465215323:87 , srv474861327:87 , srv511361048:87 , srv703384534:87 , srv780254667:87 , srv906961131:87 , srv1207754388:88 , srv1259120015:88 , srv1275401027:88 , srv1336706340:88 , srv357016338:88 , srv390601888:88 , srv486944983:88 , srv90400928:88 , srv1551292315:89 , srv1813413153:89 , srv1817071388:89 , srv1976041539:89 , srv555840245:89 , srv565082449:89 , srv717375950:89 , srv746234250:89 , srv1124370603:90 , srv1350544078:90 , srv760526686:90 , srv838093634:90 , srv1292815979:91 , srv1443169964:91 , srv1497894703:91 , srv1615730542:91 , srv1466724998:522 }
2023-10-21 12:53:32,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-21 12:53:32,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1668223239=33, srv1004091010=0, srv490562152=69, srv565082449=73, srv486944983=68, srv500959746=70, srv924108703=96, srv465215323=65, srv703384534=80, srv294172726=56, srv906961131=95, srv469495183=66, srv755715503=85, srv1818182406=40, srv760526686=87, srv1637678156=30, srv272017481=55, srv1068352822=3, srv1036564002=1, srv984999=98, srv598569259=74, srv474861327=67, srv685679499=78, srv1551292315=28, srv1925111573=45, srv225528460=53, srv1130024055=6, srv2116213777=52, srv390601888=64, srv661683491=75, srv1100183078=4, srv357016338=62, srv339912147=60, srv1146046704=7, srv1922803761=44, srv319620898=59, srv353728440=61, srv766425320=88, srv1526135533=26, srv1124370603=5, srv780254667=89, srv1646695037=31, srv1991927986=47, srv1350544078=18, srv1154619431=8, srv715006439=81, srv1896056489=42, srv2053513115=50, srv759350782=86, srv2047548569=49, srv1053615459=2, srv717375950=82, srv1497894703=25, srv1275401027=14, srv866452256=92, srv838093634=91, srv360423484=63, srv1529102754=27, srv90400928=94, srv2007527891=48, srv300919167=57, srv1207937159=12, srv807745701=90, srv1813413153=38, srv89074917=93, srv1651776250=32, srv247094772=54, srv689975649=79, srv1372362974=19, srv2055904262=51, srv1443169964=21, srv1867585236=41, srv1466724998=24, srv951123853=97, srv746234250=84, srv555840245=72, srv305046845=58, srv680486186=76, srv1817071388=39, srv742593276=83, srv1336706340=17, srv68255096=77, srv1694651792=35, srv1192930424=10, srv994601822=99, srv1766207854=37, srv1301173131=16, srv1259120015=13, srv1452187599=23, srv1446797564=22, srv1207754388=11, srv511361048=71, srv1387412914=20, srv1292815979=15, srv1672874496=34, srv1976041539=46, srv1727108606=36, srv1162769704=9, srv1615730542=29, srv1896671301=43} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-21 12:53:32,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-21 12:53:32,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-21 12:53:32,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-21 12:53:32,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-21 12:53:32,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-21 12:53:32,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-21 12:53:32,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-21 12:53:32,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-21 12:53:32,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-21 12:53:32,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-21 12:53:32,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-21 12:53:32,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-21 12:53:32,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-21 12:53:32,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-21 12:53:32,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-21 12:53:32,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-21 12:53:32,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-21 12:53:32,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-21 12:53:32,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-21 12:53:32,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-21 12:53:32,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-21 12:53:32,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-21 12:53:32,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-21 12:53:32,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-21 12:53:32,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-21 12:53:32,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-21 12:53:32,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-21 12:53:32,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-21 12:53:32,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-21 12:53:32,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-21 12:53:32,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-21 12:53:32,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-21 12:53:32,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-21 12:53:32,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-21 12:53:32,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-21 12:53:32,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-21 12:53:32,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-21 12:53:32,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-21 12:53:32,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-21 12:53:32,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-21 12:53:32,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-21 12:53:32,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-21 12:53:32,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-21 12:53:32,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-21 12:53:32,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-21 12:53:32,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-21 12:53:32,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-21 12:53:32,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-21 12:53:32,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-21 12:53:32,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-21 12:53:32,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-21 12:53:32,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-21 12:53:32,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-21 12:53:32,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-21 12:53:32,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-21 12:53:32,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-21 12:53:32,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-21 12:53:32,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-21 12:53:32,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-21 12:53:32,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-21 12:53:32,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-21 12:53:32,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-21 12:53:32,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-21 12:53:32,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-21 12:53:32,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-21 12:53:32,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-21 12:53:32,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-21 12:53:32,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-21 12:53:32,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-21 12:53:32,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-21 12:53:32,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-21 12:53:32,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-21 12:53:32,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-21 12:53:32,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-21 12:53:32,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-21 12:53:32,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-21 12:53:32,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-21 12:53:32,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-21 12:53:32,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-21 12:53:32,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-21 12:53:32,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-21 12:53:32,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-21 12:53:32,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-21 12:53:32,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-21 12:53:32,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-21 12:53:32,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-21 12:53:32,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-21 12:53:32,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-21 12:53:32,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-21 12:53:32,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-21 12:53:32,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-21 12:53:32,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-21 12:53:32,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-21 12:53:32,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-21 12:53:32,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-21 12:53:32,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-21 12:53:32,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-21 12:53:32,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-21 12:53:32,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-21 12:53:32,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-21 12:53:32,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-21 12:53:32,298 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022048705283166246); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.036218565843839146, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022048705283166246); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012583333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.040916666666666664, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-21 12:53:32,298 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-21 12:53:32,298 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.015281339433441786, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022048705283166246); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.036218565843839146, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022048705283166246); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012583333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.040916666666666664, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-21 12:53:32,623 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 437 ms to try 5000 different iterations.  Found a solution that moves 921 regions; Going from a computed imbalance of 0.015281339433441786 to a new imbalance of 5.630408181840597E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005545445345984163); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006048810069325199); MoveCostFunction : (multiplier=7.0, imbalance=0.10233333333333333, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005545445345984163); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003916666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-21 12:53:32,626 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1292815979:82 , srv1443169964:82 , srv746234250:82 , srv838093634:82 , srv1004091010:83 , srv1100183078:83 , srv1130024055:83 , srv1497894703:83 , srv294172726:83 , srv390601888:83 , srv1036564002:84 , srv1146046704:84 , srv1615730542:84 , srv1976041539:84 , srv2055904262:84 , srv225528460:84 , srv555840245:84 , srv906961131:84 , srv1053615459:85 , srv1068352822:85 , srv1124370603:85 , srv1162769704:85 , srv1207754388:85 , srv1207937159:85 , srv1275401027:85 , srv1336706340:85 , srv1372362974:85 , srv1646695037:85 , srv1672874496:85 , srv1813413153:85 , srv1817071388:85 , srv2116213777:85 , srv247094772:85 , srv300919167:85 , srv305046845:85 , srv319620898:85 , srv353728440:85 , srv500959746:85 , srv511361048:85 , srv598569259:85 , srv661683491:85 , srv680486186:85 , srv689975649:85 , srv717375950:85 , srv742593276:85 , srv760526686:85 , srv951123853:85 , srv984999:85 , srv1154619431:86 , srv1192930424:86 , srv1259120015:86 , srv1301173131:86 , srv1350544078:86 , srv1387412914:86 , srv1551292315:86 , srv1766207854:86 , srv1867585236:86 , srv1896056489:86 , srv1922803761:86 , srv1925111573:86 , srv1991927986:86 , srv2047548569:86 , srv2053513115:86 , srv272017481:86 , srv339912147:86 , srv360423484:86 , srv465215323:86 , srv469495183:86 , srv486944983:86 , srv490562152:86 , srv565082449:86 , srv68255096:86 , srv703384534:86 , srv715006439:86 , srv766425320:86 , srv780254667:86 , srv807745701:86 , srv866452256:86 , srv924108703:86 , srv994601822:86 , srv1452187599:87 , srv1526135533:87 , srv1529102754:87 , srv1651776250:87 , srv1694651792:87 , srv1727108606:87 , srv1818182406:87 , srv2007527891:87 , srv357016338:87 , srv759350782:87 , srv90400928:87 , srv1446797564:88 , srv1637678156:88 , srv474861327:88 , srv685679499:88 , srv755715503:88 , srv89074917:88 , srv1668223239:89 , srv1896671301:89 , srv1466724998:537 }
2023-10-21 12:53:32,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-21 12:53:32,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1668223239=33, srv1004091010=0, srv490562152=69, srv565082449=73, srv486944983=68, srv500959746=70, srv924108703=96, srv465215323=65, srv703384534=80, srv294172726=56, srv906961131=95, srv469495183=66, srv755715503=85, srv1818182406=40, srv760526686=87, srv1637678156=30, srv272017481=55, srv1068352822=3, srv1036564002=1, srv984999=98, srv598569259=74, srv474861327=67, srv685679499=78, srv1551292315=28, srv1925111573=45, srv225528460=53, srv1130024055=6, srv2116213777=52, srv390601888=64, srv661683491=75, srv1100183078=4, srv357016338=62, srv339912147=60, srv1146046704=7, srv1922803761=44, srv319620898=59, srv353728440=61, srv766425320=88, srv1526135533=26, srv1124370603=5, srv780254667=89, srv1646695037=31, srv1991927986=47, srv1350544078=18, srv1154619431=8, srv715006439=81, srv1896056489=42, srv2053513115=50, srv759350782=86, srv2047548569=49, srv1053615459=2, srv717375950=82, srv1497894703=25, srv1275401027=14, srv866452256=92, srv838093634=91, srv360423484=63, srv1529102754=27, srv90400928=94, srv2007527891=48, srv300919167=57, srv1207937159=12, srv807745701=90, srv1813413153=38, srv89074917=93, srv1651776250=32, srv247094772=54, srv689975649=79, srv1372362974=19, srv2055904262=51, srv1443169964=21, srv1867585236=41, srv1466724998=24, srv951123853=97, srv746234250=84, srv555840245=72, srv305046845=58, srv680486186=76, srv1817071388=39, srv742593276=83, srv1336706340=17, srv68255096=77, srv1694651792=35, srv1192930424=10, srv994601822=99, srv1766207854=37, srv1301173131=16, srv1259120015=13, srv1452187599=23, srv1446797564=22, srv1207754388=11, srv511361048=71, srv1387412914=20, srv1292815979=15, srv1672874496=34, srv1976041539=46, srv1727108606=36, srv1162769704=9, srv1615730542=29, srv1896671301=43} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-21 12:53:32,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-21 12:53:32,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-21 12:53:32,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-21 12:53:32,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-21 12:53:32,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-21 12:53:32,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-21 12:53:32,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-21 12:53:32,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-21 12:53:32,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-21 12:53:32,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-21 12:53:32,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-21 12:53:32,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-21 12:53:32,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-21 12:53:32,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-21 12:53:32,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-21 12:53:32,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-21 12:53:32,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-21 12:53:32,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-21 12:53:32,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-21 12:53:32,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-21 12:53:32,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-21 12:53:32,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-21 12:53:32,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-21 12:53:32,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-21 12:53:32,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-21 12:53:32,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-21 12:53:32,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-21 12:53:32,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-21 12:53:32,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-21 12:53:32,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-21 12:53:32,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-21 12:53:32,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-21 12:53:32,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-21 12:53:32,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-21 12:53:32,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-21 12:53:32,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-21 12:53:32,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-21 12:53:32,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-21 12:53:32,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-21 12:53:32,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-21 12:53:32,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-21 12:53:32,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-21 12:53:32,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-21 12:53:32,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-21 12:53:32,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-21 12:53:32,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-21 12:53:32,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-21 12:53:32,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-21 12:53:32,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-21 12:53:32,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-21 12:53:32,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-21 12:53:32,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-21 12:53:32,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-21 12:53:32,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-21 12:53:32,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-21 12:53:32,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-21 12:53:32,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-21 12:53:32,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-21 12:53:32,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-21 12:53:32,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-21 12:53:32,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-21 12:53:32,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-21 12:53:32,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-21 12:53:32,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-21 12:53:32,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-21 12:53:32,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-21 12:53:32,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-21 12:53:32,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-21 12:53:32,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-21 12:53:32,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-21 12:53:32,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-21 12:53:32,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-21 12:53:32,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-21 12:53:32,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-21 12:53:32,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-21 12:53:32,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-21 12:53:32,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-21 12:53:32,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-21 12:53:32,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-21 12:53:32,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-21 12:53:32,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-21 12:53:32,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-21 12:53:32,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-21 12:53:32,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-21 12:53:32,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-21 12:53:32,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-21 12:53:32,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-21 12:53:32,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-21 12:53:32,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-21 12:53:32,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-21 12:53:32,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-21 12:53:32,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-21 12:53:32,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-21 12:53:32,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-21 12:53:32,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-21 12:53:32,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-21 12:53:32,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-21 12:53:32,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-21 12:53:32,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-21 12:53:32,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-21 12:53:32,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-21 12:53:32,791 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005545445345984163); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006048810069325199); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005545445345984163); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003916666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-21 12:53:32,791 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-21 12:53:32,791 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=5.565918383472497E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005545445345984163); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006048810069325199); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005545445345984163); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003916666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-21 12:53:33,192 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 526 ms to try 5000 different iterations.  Found a solution that moves 210 regions; Going from a computed imbalance of 5.565918383472497E-4 to a new imbalance of 3.3887907232512364E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0016412198797244363); MoveCostFunction : (multiplier=7.0, imbalance=0.023333333333333334); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-21 12:53:33,193 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1207937159:83 , srv1387412914:83 , srv1526135533:83 , srv1727108606:83 , srv2007527891:83 , srv511361048:83 , srv924108703:83 , srv1124370603:84 , srv1146046704:84 , srv1154619431:84 , srv1259120015:84 , srv1275401027:84 , srv1292815979:84 , srv1301173131:84 , srv1350544078:84 , srv1372362974:84 , srv1443169964:84 , srv1446797564:84 , srv1615730542:84 , srv1637678156:84 , srv1646695037:84 , srv1668223239:84 , srv1817071388:84 , srv1867585236:84 , srv1896056489:84 , srv1896671301:84 , srv1922803761:84 , srv2047548569:84 , srv2116213777:84 , srv300919167:84 , srv319620898:84 , srv357016338:84 , srv465215323:84 , srv474861327:84 , srv555840245:84 , srv565082449:84 , srv598569259:84 , srv685679499:84 , srv689975649:84 , srv717375950:84 , srv742593276:84 , srv755715503:84 , srv759350782:84 , srv760526686:84 , srv89074917:84 , srv90400928:84 , srv906961131:84 , srv994601822:84 , srv1004091010:85 , srv1036564002:85 , srv1053615459:85 , srv1068352822:85 , srv1100183078:85 , srv1130024055:85 , srv1162769704:85 , srv1207754388:85 , srv1336706340:85 , srv1452187599:85 , srv1497894703:85 , srv1529102754:85 , srv1551292315:85 , srv1651776250:85 , srv1672874496:85 , srv1694651792:85 , srv1766207854:85 , srv1813413153:85 , srv1818182406:85 , srv1925111573:85 , srv1976041539:85 , srv1991927986:85 , srv2053513115:85 , srv2055904262:85 , srv225528460:85 , srv247094772:85 , srv294172726:85 , srv339912147:85 , srv353728440:85 , srv360423484:85 , srv469495183:85 , srv486944983:85 , srv500959746:85 , srv661683491:85 , srv680486186:85 , srv68255096:85 , srv703384534:85 , srv715006439:85 , srv746234250:85 , srv766425320:85 , srv780254667:85 , srv807745701:85 , srv838093634:85 , srv866452256:85 , srv951123853:85 , srv984999:85 , srv1192930424:86 , srv272017481:86 , srv305046845:86 , srv390601888:86 , srv490562152:86 , srv1466724998:635 }
2023-10-21 12:53:33,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-21 12:53:33,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1668223239=33, srv1004091010=0, srv490562152=69, srv565082449=73, srv486944983=68, srv500959746=70, srv924108703=96, srv465215323=65, srv703384534=80, srv294172726=56, srv906961131=95, srv469495183=66, srv755715503=85, srv1818182406=40, srv760526686=87, srv1637678156=30, srv272017481=55, srv1068352822=3, srv1036564002=1, srv984999=98, srv598569259=74, srv474861327=67, srv685679499=78, srv1551292315=28, srv1925111573=45, srv225528460=53, srv1130024055=6, srv2116213777=52, srv390601888=64, srv661683491=75, srv1100183078=4, srv357016338=62, srv339912147=60, srv1146046704=7, srv1922803761=44, srv319620898=59, srv353728440=61, srv766425320=88, srv1526135533=26, srv1124370603=5, srv780254667=89, srv1646695037=31, srv1991927986=47, srv1350544078=18, srv1154619431=8, srv715006439=81, srv1896056489=42, srv2053513115=50, srv759350782=86, srv2047548569=49, srv1053615459=2, srv717375950=82, srv1497894703=25, srv1275401027=14, srv866452256=92, srv838093634=91, srv360423484=63, srv1529102754=27, srv90400928=94, srv2007527891=48, srv300919167=57, srv1207937159=12, srv807745701=90, srv1813413153=38, srv89074917=93, srv1651776250=32, srv247094772=54, srv689975649=79, srv1372362974=19, srv2055904262=51, srv1443169964=21, srv1867585236=41, srv1466724998=24, srv951123853=97, srv746234250=84, srv555840245=72, srv305046845=58, srv680486186=76, srv1817071388=39, srv742593276=83, srv1336706340=17, srv68255096=77, srv1694651792=35, srv1192930424=10, srv994601822=99, srv1766207854=37, srv1301173131=16, srv1259120015=13, srv1452187599=23, srv1446797564=22, srv1207754388=11, srv511361048=71, srv1387412914=20, srv1292815979=15, srv1672874496=34, srv1976041539=46, srv1727108606=36, srv1162769704=9, srv1615730542=29, srv1896671301=43} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-21 12:53:33,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-21 12:53:33,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-21 12:53:33,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-21 12:53:33,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-21 12:53:33,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-21 12:53:33,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-21 12:53:33,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-21 12:53:33,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-21 12:53:33,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-21 12:53:33,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-21 12:53:33,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-21 12:53:33,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-21 12:53:33,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-21 12:53:33,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-21 12:53:33,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-21 12:53:33,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-21 12:53:33,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-21 12:53:33,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-21 12:53:33,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-21 12:53:33,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-21 12:53:33,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-21 12:53:33,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-21 12:53:33,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-21 12:53:33,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-21 12:53:33,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-21 12:53:33,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-21 12:53:33,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-21 12:53:33,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-21 12:53:33,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-21 12:53:33,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-21 12:53:33,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-21 12:53:33,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-21 12:53:33,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-21 12:53:33,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-21 12:53:33,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-21 12:53:33,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-21 12:53:33,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-21 12:53:33,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-21 12:53:33,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-21 12:53:33,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-21 12:53:33,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-21 12:53:33,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-21 12:53:33,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-21 12:53:33,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-21 12:53:33,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-21 12:53:33,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-21 12:53:33,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-21 12:53:33,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-21 12:53:33,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-21 12:53:33,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-21 12:53:33,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-21 12:53:33,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-21 12:53:33,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-21 12:53:33,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-21 12:53:33,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-21 12:53:33,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-21 12:53:33,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-21 12:53:33,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-21 12:53:33,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-21 12:53:33,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-21 12:53:33,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-21 12:53:33,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-21 12:53:33,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-21 12:53:33,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-21 12:53:33,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-21 12:53:33,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-21 12:53:33,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-21 12:53:33,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-21 12:53:33,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-21 12:53:33,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-21 12:53:33,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-21 12:53:33,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-21 12:53:33,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-21 12:53:33,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-21 12:53:33,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-21 12:53:33,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-21 12:53:33,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-21 12:53:33,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-21 12:53:33,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-21 12:53:33,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-21 12:53:33,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-21 12:53:33,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-21 12:53:33,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-21 12:53:33,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-21 12:53:33,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-21 12:53:33,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-21 12:53:33,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-21 12:53:33,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-21 12:53:33,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-21 12:53:33,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-21 12:53:33,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-21 12:53:33,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-21 12:53:33,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-21 12:53:33,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-21 12:53:33,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-21 12:53:33,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-21 12:53:33,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-21 12:53:33,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-21 12:53:33,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-21 12:53:33,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-21 12:53:33,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-21 12:53:33,338 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0016412198797244363); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-21 12:53:33,338 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-21 12:53:33,338 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=3.2417455803923784E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0016412198797244363); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-21 12:53:33,605 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 374 ms to try 5000 different iterations.  Found a solution that moves 25 regions; Going from a computed imbalance of 3.2417455803923784E-5 to a new imbalance of 6.5730394137683395E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014213381090374027); MoveCostFunction : (multiplier=7.0, imbalance=0.002777777777777778); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-21 12:53:33,605 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1336706340:83 , srv1529102754:83 , srv1637678156:83 , srv1651776250:83 , srv1694651792:83 , srv1766207854:83 , srv272017481:83 , srv305046845:83 , srv490562152:83 , srv661683491:83 , srv68255096:83 , srv1036564002:84 , srv1053615459:84 , srv1068352822:84 , srv1124370603:84 , srv1130024055:84 , srv1146046704:84 , srv1162769704:84 , srv1192930424:84 , srv1207754388:84 , srv1259120015:84 , srv1275401027:84 , srv1292815979:84 , srv1350544078:84 , srv1372362974:84 , srv1443169964:84 , srv1446797564:84 , srv1452187599:84 , srv1497894703:84 , srv1526135533:84 , srv1551292315:84 , srv1615730542:84 , srv1646695037:84 , srv1668223239:84 , srv1672874496:84 , srv1727108606:84 , srv1813413153:84 , srv1817071388:84 , srv1818182406:84 , srv1867585236:84 , srv1896056489:84 , srv1896671301:84 , srv1925111573:84 , srv1976041539:84 , srv1991927986:84 , srv2047548569:84 , srv2053513115:84 , srv2055904262:84 , srv225528460:84 , srv247094772:84 , srv294172726:84 , srv300919167:84 , srv319620898:84 , srv339912147:84 , srv353728440:84 , srv357016338:84 , srv360423484:84 , srv390601888:84 , srv465215323:84 , srv469495183:84 , srv474861327:84 , srv486944983:84 , srv500959746:84 , srv511361048:84 , srv555840245:84 , srv565082449:84 , srv598569259:84 , srv680486186:84 , srv685679499:84 , srv689975649:84 , srv703384534:84 , srv715006439:84 , srv742593276:84 , srv746234250:84 , srv755715503:84 , srv759350782:84 , srv760526686:84 , srv766425320:84 , srv780254667:84 , srv807745701:84 , srv838093634:84 , srv866452256:84 , srv89074917:84 , srv90400928:84 , srv906961131:84 , srv951123853:84 , srv984999:84 , srv994601822:84 , srv1004091010:85 , srv1100183078:85 , srv1154619431:85 , srv1207937159:85 , srv1301173131:85 , srv1387412914:85 , srv1922803761:85 , srv2007527891:85 , srv2116213777:85 , srv717375950:85 , srv924108703:85 , srv1466724998:684 }
2023-10-21 12:53:33,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-21 12:53:33,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1668223239=33, srv1004091010=0, srv490562152=69, srv565082449=73, srv486944983=68, srv500959746=70, srv924108703=96, srv465215323=65, srv703384534=80, srv294172726=56, srv906961131=95, srv469495183=66, srv755715503=85, srv1818182406=40, srv760526686=87, srv1637678156=30, srv272017481=55, srv1068352822=3, srv1036564002=1, srv984999=98, srv598569259=74, srv474861327=67, srv685679499=78, srv1551292315=28, srv1925111573=45, srv225528460=53, srv1130024055=6, srv2116213777=52, srv390601888=64, srv661683491=75, srv1100183078=4, srv357016338=62, srv339912147=60, srv1146046704=7, srv1922803761=44, srv319620898=59, srv353728440=61, srv766425320=88, srv1526135533=26, srv1124370603=5, srv780254667=89, srv1646695037=31, srv1991927986=47, srv1350544078=18, srv1154619431=8, srv715006439=81, srv1896056489=42, srv2053513115=50, srv759350782=86, srv2047548569=49, srv1053615459=2, srv717375950=82, srv1497894703=25, srv1275401027=14, srv866452256=92, srv838093634=91, srv360423484=63, srv1529102754=27, srv90400928=94, srv2007527891=48, srv300919167=57, srv1207937159=12, srv807745701=90, srv1813413153=38, srv89074917=93, srv1651776250=32, srv247094772=54, srv689975649=79, srv1372362974=19, srv2055904262=51, srv1443169964=21, srv1867585236=41, srv1466724998=24, srv951123853=97, srv746234250=84, srv555840245=72, srv305046845=58, srv680486186=76, srv1817071388=39, srv742593276=83, srv1336706340=17, srv68255096=77, srv1694651792=35, srv1192930424=10, srv994601822=99, srv1766207854=37, srv1301173131=16, srv1259120015=13, srv1452187599=23, srv1446797564=22, srv1207754388=11, srv511361048=71, srv1387412914=20, srv1292815979=15, srv1672874496=34, srv1976041539=46, srv1727108606=36, srv1162769704=9, srv1615730542=29, srv1896671301=43} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-21 12:53:33,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-21 12:53:33,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-21 12:53:33,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-21 12:53:33,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-21 12:53:33,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-21 12:53:33,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-21 12:53:33,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-21 12:53:33,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-21 12:53:33,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-21 12:53:33,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-21 12:53:33,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-21 12:53:33,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-21 12:53:33,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-21 12:53:33,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-21 12:53:33,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-21 12:53:33,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-21 12:53:33,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-21 12:53:33,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-21 12:53:33,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-21 12:53:33,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-21 12:53:33,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-21 12:53:33,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-21 12:53:33,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-21 12:53:33,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-21 12:53:33,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-21 12:53:33,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-21 12:53:33,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-21 12:53:33,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-21 12:53:33,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-21 12:53:33,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-21 12:53:33,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-21 12:53:33,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-21 12:53:33,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-21 12:53:33,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-21 12:53:33,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-21 12:53:33,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-21 12:53:33,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-21 12:53:33,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-21 12:53:33,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-21 12:53:33,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-21 12:53:33,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-21 12:53:33,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-21 12:53:33,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-21 12:53:33,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-21 12:53:33,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-21 12:53:33,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-21 12:53:33,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-21 12:53:33,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-21 12:53:33,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-21 12:53:33,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-21 12:53:33,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-21 12:53:33,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-21 12:53:33,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-21 12:53:33,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-21 12:53:33,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-21 12:53:33,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-21 12:53:33,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-21 12:53:33,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-21 12:53:33,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-21 12:53:33,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-21 12:53:33,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-21 12:53:33,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-21 12:53:33,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-21 12:53:33,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-21 12:53:33,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-21 12:53:33,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-21 12:53:33,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-21 12:53:33,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-21 12:53:33,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-21 12:53:33,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-21 12:53:33,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-21 12:53:33,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-21 12:53:33,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-21 12:53:33,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-21 12:53:33,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-21 12:53:33,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-21 12:53:33,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-21 12:53:33,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-21 12:53:33,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-21 12:53:33,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-21 12:53:33,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-21 12:53:33,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-21 12:53:33,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-21 12:53:33,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-21 12:53:33,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-21 12:53:33,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-21 12:53:33,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-21 12:53:33,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-21 12:53:33,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-21 12:53:33,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-21 12:53:33,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-21 12:53:33,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-21 12:53:33,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-21 12:53:33,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-21 12:53:33,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-21 12:53:33,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-21 12:53:33,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-21 12:53:33,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-21 12:53:33,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-21 12:53:33,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-21 12:53:33,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-21 12:53:33,762 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=6.397985672269699E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014213381090374027); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-21 12:53:33,763 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1336706340:83 , srv1529102754:83 , srv1637678156:83 , srv1651776250:83 , srv1694651792:83 , srv1766207854:83 , srv272017481:83 , srv305046845:83 , srv490562152:83 , srv661683491:83 , srv68255096:83 , srv1036564002:84 , srv1053615459:84 , srv1068352822:84 , srv1124370603:84 , srv1130024055:84 , srv1146046704:84 , srv1162769704:84 , srv1192930424:84 , srv1207754388:84 , srv1259120015:84 , srv1275401027:84 , srv1292815979:84 , srv1350544078:84 , srv1372362974:84 , srv1443169964:84 , srv1446797564:84 , srv1452187599:84 , srv1497894703:84 , srv1526135533:84 , srv1551292315:84 , srv1615730542:84 , srv1646695037:84 , srv1668223239:84 , srv1672874496:84 , srv1727108606:84 , srv1813413153:84 , srv1817071388:84 , srv1818182406:84 , srv1867585236:84 , srv1896056489:84 , srv1896671301:84 , srv1925111573:84 , srv1976041539:84 , srv1991927986:84 , srv2047548569:84 , srv2053513115:84 , srv2055904262:84 , srv225528460:84 , srv247094772:84 , srv294172726:84 , srv300919167:84 , srv319620898:84 , srv339912147:84 , srv353728440:84 , srv357016338:84 , srv360423484:84 , srv390601888:84 , srv465215323:84 , srv469495183:84 , srv474861327:84 , srv486944983:84 , srv500959746:84 , srv511361048:84 , srv555840245:84 , srv565082449:84 , srv598569259:84 , srv680486186:84 , srv685679499:84 , srv689975649:84 , srv703384534:84 , srv715006439:84 , srv742593276:84 , srv746234250:84 , srv755715503:84 , srv759350782:84 , srv760526686:84 , srv766425320:84 , srv780254667:84 , srv807745701:84 , srv838093634:84 , srv866452256:84 , srv89074917:84 , srv90400928:84 , srv906961131:84 , srv951123853:84 , srv984999:84 , srv994601822:84 , srv1004091010:85 , srv1100183078:85 , srv1154619431:85 , srv1207937159:85 , srv1301173131:85 , srv1387412914:85 , srv1922803761:85 , srv2007527891:85 , srv2116213777:85 , srv717375950:85 , srv924108703:85 , srv1466724998:684 }
2023-10-21 12:53:33,796 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=395 (was 394) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 169) - ProcessCount LEAK? -, AvailableMemoryMB=8014 (was 8537)
2023-10-21 12:53:33,808 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=395, ProcessCount=170, AvailableMemoryMB=8014
2023-10-21 12:53:33,809 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-21 12:53:33,809 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-10-21 12:53:33,822 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1048958878:84 , srv1248635821:84 , srv1399887795:84 , srv161310107:84 , srv1658214495:84 , srv1662345708:84 , srv1662652750:84 , srv1808679943:84 , srv1866684253:84 , srv1927793219:84 , srv2025906202:84 , srv2063296379:84 , srv2108465903:84 , srv228653638:84 , srv261933422:84 , srv264645809:84 , srv304456236:84 , srv312868433:84 , srv349347748:84 , srv363753026:84 , srv41439188:84 , srv429530384:84 , srv440420311:84 , srv494198088:84 , srv576613976:84 , srv597688104:84 , srv839153071:84 , srv956023363:84 , srv969145616:84 , srv1998551221:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-10-21 12:53:33,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-21 12:53:33,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1399887795=2, srv161310107=3, srv1808679943=7, srv312868433=18, srv363753026=20, srv1662652750=6, srv261933422=15, srv956023363=28, srv1248635821=1, srv2108465903=13, srv839153071=27, srv440420311=23, srv304456236=17, srv1998551221=10, srv969145616=29, srv1658214495=4, srv2063296379=12, srv597688104=26, srv41439188=21, srv1662345708=5, srv1866684253=8, srv228653638=14, srv576613976=25, srv2025906202=11, srv264645809=16, srv429530384=22, srv1927793219=9, srv349347748=19, srv1048958878=0, srv494198088=24} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-21 12:53:33,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-21 12:53:33,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-21 12:53:33,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-21 12:53:33,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-21 12:53:33,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-21 12:53:33,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-21 12:53:33,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-21 12:53:33,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-21 12:53:33,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-21 12:53:33,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-21 12:53:33,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-21 12:53:33,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-21 12:53:33,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-21 12:53:33,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-21 12:53:33,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-21 12:53:33,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-21 12:53:33,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-21 12:53:33,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-21 12:53:33,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-21 12:53:33,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-21 12:53:33,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-21 12:53:33,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-21 12:53:33,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-21 12:53:33,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-21 12:53:33,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-21 12:53:33,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-21 12:53:33,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-21 12:53:33,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-21 12:53:33,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-21 12:53:33,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-21 12:53:33,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-10-21 12:53:33,860 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0617050867476945, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-21 12:53:33,860 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912387473977766, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0617050867476945, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-10-21 12:55:33,846 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5432139 different iterations.  Found a solution that moves 1861 regions; Going from a computed imbalance of 0.9912387473977766 to a new imbalance of 4.3436668390529226E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6892592592592592, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-21 12:55:33,851 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1048958878:90 , srv1248635821:90 , srv1399887795:90 , srv161310107:90 , srv1658214495:90 , srv1662345708:90 , srv1662652750:90 , srv1808679943:90 , srv1866684253:90 , srv1927793219:90 , srv1998551221:90 , srv2025906202:90 , srv2063296379:90 , srv2108465903:90 , srv228653638:90 , srv261933422:90 , srv264645809:90 , srv304456236:90 , srv312868433:90 , srv349347748:90 , srv363753026:90 , srv41439188:90 , srv429530384:90 , srv440420311:90 , srv494198088:90 , srv576613976:90 , srv597688104:90 , srv839153071:90 , srv956023363:90 , srv969145616:90 }
2023-10-21 12:55:33,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-21 12:55:33,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1399887795=2, srv161310107=3, srv1808679943=7, srv312868433=18, srv363753026=20, srv1662652750=6, srv261933422=15, srv956023363=28, srv1248635821=1, srv2108465903=13, srv839153071=27, srv440420311=23, srv304456236=17, srv1998551221=10, srv969145616=29, srv1658214495=4, srv2063296379=12, srv597688104=26, srv41439188=21, srv1662345708=5, srv1866684253=8, srv228653638=14, srv576613976=25, srv2025906202=11, srv264645809=16, srv429530384=22, srv1927793219=9, srv349347748=19, srv1048958878=0, srv494198088=24} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-21 12:55:33,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-21 12:55:33,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-21 12:55:33,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-21 12:55:33,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-21 12:55:33,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-21 12:55:33,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-21 12:55:33,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-21 12:55:33,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-21 12:55:33,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-21 12:55:33,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-21 12:55:33,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-21 12:55:33,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-21 12:55:33,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-21 12:55:33,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-21 12:55:33,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-21 12:55:33,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-21 12:55:33,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-21 12:55:33,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-21 12:55:33,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-21 12:55:33,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-21 12:55:33,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-21 12:55:33,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-21 12:55:33,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-21 12:55:33,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-21 12:55:33,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-21 12:55:33,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-21 12:55:33,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-21 12:55:33,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-21 12:55:33,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-21 12:55:33,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-21 12:55:33,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-10-21 12:55:33,869 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-21 12:55:33,870 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1048958878:90 , srv1248635821:90 , srv1399887795:90 , srv161310107:90 , srv1658214495:90 , srv1662345708:90 , srv1662652750:90 , srv1808679943:90 , srv1866684253:90 , srv1927793219:90 , srv1998551221:90 , srv2025906202:90 , srv2063296379:90 , srv2108465903:90 , srv228653638:90 , srv261933422:90 , srv264645809:90 , srv304456236:90 , srv312868433:90 , srv349347748:90 , srv363753026:90 , srv41439188:90 , srv429530384:90 , srv440420311:90 , srv494198088:90 , srv576613976:90 , srv597688104:90 , srv839153071:90 , srv956023363:90 , srv969145616:90 }
2023-10-21 12:55:33,885 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=189 (was 395), ProcessCount=172 (was 170) - ProcessCount LEAK? -, AvailableMemoryMB=7957 (was 8014)