2023-04-03 11:00:52,528 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-04-03 11:00:52,836 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-04-03 11:00:52,935 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-04-03 11:00:52,996 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-03 11:00:53,005 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-04-03 11:00:53,021 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=263, ProcessCount=165, AvailableMemoryMB=4679
2023-04-03 11:00:53,024 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-03 11:00:53,024 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-04-03 11:00:53,158 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1008054101:84 , srv1011196136:84 , srv1022751683:84 , srv1031614275:84 , srv1038867446:84 , srv1043311691:84 , srv1048556365:84 , srv1072463925:84 , srv1103171389:84 , srv1151137121:84 , srv1154677314:84 , srv1199991994:84 , srv1236621634:84 , srv1246920255:84 , srv1263569937:84 , srv1266689451:84 , srv1289111951:84 , srv1289891918:84 , srv1295635343:84 , srv1301109821:84 , srv1339334810:84 , srv1396509321:84 , srv1406145511:84 , srv1445732744:84 , srv1483956460:84 , srv1487110653:84 , srv1500932965:84 , srv1558556275:84 , srv1564706864:84 , srv1590762230:84 , srv1631508425:84 , srv1744359142:84 , srv1763553462:84 , srv1833910648:84 , srv1845201197:84 , srv1860558183:84 , srv186865290:84 , srv1872790797:84 , srv1892860255:84 , srv1915745432:84 , srv1915793142:84 , srv1918121672:84 , srv192446761:84 , srv1924815713:84 , srv1936578328:84 , srv1939801284:84 , srv1988691483:84 , srv1996402949:84 , srv2002553268:84 , srv2005121587:84 , srv2021999587:84 , srv2035494086:84 , srv2043332323:84 , srv2044109158:84 , srv2070469579:84 , srv2101208337:84 , srv2101915743:84 , srv2120938751:84 , srv2125478063:84 , srv2128116527:84 , srv2138285032:84 , srv215756500:84 , srv221292844:84 , srv236119228:84 , srv321089258:84 , srv356502321:84 , srv38218824:84 , srv386937801:84 , srv413838780:84 , srv415300493:84 , srv45244649:84 , srv460027241:84 , srv461904873:84 , srv49570699:84 , srv506212035:84 , srv543014041:84 , srv597026112:84 , srv624425231:84 , srv640497386:84 , srv64687857:84 , srv652323021:84 , srv736028396:84 , srv744405216:84 , srv74882064:84 , srv759834176:84 , srv805655531:84 , srv805946024:84 , srv809338542:84 , srv809620327:84 , srv828526360:84 , srv844598413:84 , srv868818469:84 , srv878760421:84 , srv892434577:84 , srv905993505:84 , srv917871211:84 , srv958692333:84 , srv96775226:84 , srv976418488:84 , srv819845757:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-04-03 11:00:53,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-03 11:00:53,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv186865290=36, srv1445732744=23, srv506212035=74, srv1939801284=45, srv1936578328=44, srv2120938751=57, srv1151137121=9, srv2138285032=60, srv1924815713=43, srv805655531=85, srv1246920255=13, srv1763553462=32, srv460027241=71, srv828526360=90, srv2044109158=53, srv356502321=65, srv1487110653=25, srv45244649=70, srv543014041=75, srv2128116527=59, srv868818469=92, srv1038867446=4, srv1918121672=41, srv958692333=97, srv1022751683=2, srv1043311691=5, srv2043332323=52, srv809620327=88, srv1236621634=12, srv1845201197=34, srv1915793142=40, srv1263569937=14, srv192446761=42, srv74882064=83, srv819845757=89, srv221292844=62, srv652323021=80, srv624425231=77, srv1396509321=21, srv2101915743=56, srv1915745432=39, srv1048556365=6, srv1339334810=20, srv215756500=61, srv2125478063=58, srv1860558183=35, srv1744359142=31, srv1031614275=3, srv1631508425=30, srv1301109821=19, srv905993505=95, srv1289891918=17, srv386937801=67, srv461904873=72, srv96775226=98, srv1564706864=28, srv49570699=73, srv976418488=99, srv1500932965=26, srv1872790797=37, srv1483956460=24, srv2005121587=49, srv1996402949=47, srv413838780=68, srv1988691483=46, srv64687857=79, srv892434577=94, srv917871211=96, srv2021999587=50, srv744405216=82, srv1199991994=11, srv640497386=78, srv1011196136=1, srv1103171389=8, srv2101208337=55, srv1154677314=10, srv844598413=91, srv1289111951=16, srv2002553268=48, srv236119228=63, srv38218824=66, srv1833910648=33, srv759834176=84, srv415300493=69, srv2035494086=51, srv321089258=64, srv597026112=76, srv1266689451=15, srv2070469579=54, srv1295635343=18, srv809338542=87, srv1008054101=0, srv805946024=86, srv1406145511=22, srv1558556275=27, srv1892860255=38, srv1072463925=7, srv1590762230=29, srv878760421=93, srv736028396=81} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-03 11:00:53,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-03 11:00:53,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-03 11:00:53,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-03 11:00:53,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-03 11:00:53,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-03 11:00:53,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-03 11:00:53,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-03 11:00:53,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-03 11:00:53,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-03 11:00:53,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-03 11:00:53,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-03 11:00:53,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-03 11:00:53,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-03 11:00:53,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-03 11:00:53,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-03 11:00:53,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-03 11:00:53,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-03 11:00:53,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-03 11:00:53,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-03 11:00:53,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-03 11:00:53,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-03 11:00:53,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-03 11:00:53,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-03 11:00:53,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-03 11:00:53,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-03 11:00:53,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-03 11:00:53,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-03 11:00:53,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-03 11:00:53,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-03 11:00:53,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-03 11:00:53,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-03 11:00:53,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-03 11:00:53,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-03 11:00:53,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-03 11:00:53,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-03 11:00:53,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-03 11:00:53,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-03 11:00:53,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-03 11:00:53,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-03 11:00:53,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-03 11:00:53,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-03 11:00:53,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-03 11:00:53,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-03 11:00:53,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-03 11:00:53,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-03 11:00:53,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-03 11:00:53,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-03 11:00:53,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-03 11:00:53,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-03 11:00:53,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-03 11:00:53,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-03 11:00:53,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-03 11:00:53,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-03 11:00:53,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-03 11:00:53,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-03 11:00:53,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-03 11:00:53,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-03 11:00:53,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-03 11:00:53,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-03 11:00:53,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-03 11:00:53,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-03 11:00:53,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-03 11:00:53,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-03 11:00:53,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-03 11:00:53,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-03 11:00:53,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-03 11:00:53,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-03 11:00:53,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-03 11:00:53,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-03 11:00:53,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-03 11:00:53,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-03 11:00:53,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-03 11:00:53,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-03 11:00:53,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-03 11:00:53,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-03 11:00:53,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-03 11:00:53,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-03 11:00:53,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-03 11:00:53,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-03 11:00:53,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-03 11:00:53,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-03 11:00:53,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-03 11:00:53,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-03 11:00:53,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-03 11:00:53,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-03 11:00:53,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-03 11:00:53,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-03 11:00:53,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-03 11:00:53,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-03 11:00:53,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-03 11:00:53,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-03 11:00:53,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-03 11:00:53,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-03 11:00:53,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-03 11:00:53,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-03 11:00:53,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-03 11:00:53,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-03 11:00:53,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-03 11:00:53,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-03 11:00:53,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-03 11:00:53,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-03 11:00:53,554 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-03 11:00:53,555 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-03 11:00:53,555 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-03 11:00:53,814 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 532 ms to try 5000 different iterations.  Found a solution that moves 4655 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18463693967509096. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04015961420126708, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0559561316070187, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5172222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04015961420126708, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17958333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24975, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-03 11:00:53,848 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1103171389:82 , srv1558556275:82 , srv64687857:82 , srv1289111951:83 , srv1289891918:83 , srv1339334810:83 , srv1445732744:83 , srv1845201197:83 , srv460027241:83 , srv640497386:83 , srv1199991994:84 , srv1396509321:84 , srv1763553462:84 , srv1892860255:84 , srv1924815713:84 , srv2021999587:84 , srv2035494086:84 , srv2070469579:84 , srv38218824:84 , srv413838780:84 , srv624425231:84 , srv805655531:84 , srv96775226:84 , srv1500932965:85 , srv1564706864:85 , srv1590762230:85 , srv1744359142:85 , srv1915793142:85 , srv2005121587:85 , srv2101915743:85 , srv2120938751:85 , srv236119228:85 , srv543014041:85 , srv74882064:85 , srv809338542:85 , srv868818469:85 , srv878760421:85 , srv958692333:85 , srv1031614275:86 , srv1048556365:86 , srv1263569937:86 , srv1301109821:86 , srv1406145511:86 , srv1833910648:86 , srv1860558183:86 , srv186865290:86 , srv1915745432:86 , srv1936578328:86 , srv1988691483:86 , srv2044109158:86 , srv2138285032:86 , srv356502321:86 , srv49570699:86 , srv506212035:86 , srv736028396:86 , srv805946024:86 , srv809620327:86 , srv828526360:86 , srv844598413:86 , srv1246920255:87 , srv1266689451:87 , srv1483956460:87 , srv1487110653:87 , srv2043332323:87 , srv2101208337:87 , srv386937801:87 , srv597026112:87 , srv744405216:87 , srv759834176:87 , srv917871211:87 , srv1022751683:88 , srv1038867446:88 , srv1043311691:88 , srv1236621634:88 , srv1295635343:88 , srv2002553268:88 , srv2128116527:88 , srv45244649:88 , srv905993505:88 , srv1008054101:89 , srv1011196136:89 , srv1154677314:89 , srv192446761:89 , srv2125478063:89 , srv221292844:89 , srv461904873:89 , srv652323021:89 , srv1151137121:90 , srv1996402949:90 , srv321089258:90 , srv415300493:90 , srv976418488:90 , srv1939801284:91 , srv215756500:91 , srv892434577:91 , srv1072463925:92 , srv1631508425:92 , srv1918121672:92 , srv1872790797:93 , srv819845757:447 }
2023-04-03 11:00:53,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-03 11:00:53,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv186865290=36, srv1445732744=23, srv506212035=74, srv1939801284=45, srv1936578328=44, srv2120938751=57, srv1151137121=9, srv2138285032=60, srv1924815713=43, srv805655531=85, srv1246920255=13, srv1763553462=32, srv460027241=71, srv828526360=90, srv2044109158=53, srv356502321=65, srv1487110653=25, srv45244649=70, srv543014041=75, srv2128116527=59, srv868818469=92, srv1038867446=4, srv1918121672=41, srv958692333=97, srv1022751683=2, srv1043311691=5, srv2043332323=52, srv809620327=88, srv1236621634=12, srv1845201197=34, srv1915793142=40, srv1263569937=14, srv192446761=42, srv74882064=83, srv819845757=89, srv221292844=62, srv652323021=80, srv624425231=77, srv1396509321=21, srv2101915743=56, srv1915745432=39, srv1048556365=6, srv1339334810=20, srv215756500=61, srv2125478063=58, srv1860558183=35, srv1744359142=31, srv1031614275=3, srv1631508425=30, srv1301109821=19, srv905993505=95, srv1289891918=17, srv386937801=67, srv461904873=72, srv96775226=98, srv1564706864=28, srv49570699=73, srv976418488=99, srv1500932965=26, srv1872790797=37, srv1483956460=24, srv2005121587=49, srv1996402949=47, srv413838780=68, srv1988691483=46, srv64687857=79, srv892434577=94, srv917871211=96, srv2021999587=50, srv744405216=82, srv1199991994=11, srv640497386=78, srv1011196136=1, srv1103171389=8, srv2101208337=55, srv1154677314=10, srv844598413=91, srv1289111951=16, srv2002553268=48, srv236119228=63, srv38218824=66, srv1833910648=33, srv759834176=84, srv415300493=69, srv2035494086=51, srv321089258=64, srv597026112=76, srv1266689451=15, srv2070469579=54, srv1295635343=18, srv809338542=87, srv1008054101=0, srv805946024=86, srv1406145511=22, srv1558556275=27, srv1892860255=38, srv1072463925=7, srv1590762230=29, srv878760421=93, srv736028396=81} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-03 11:00:53,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-03 11:00:53,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-03 11:00:53,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-03 11:00:53,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-03 11:00:53,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-03 11:00:53,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-03 11:00:53,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-03 11:00:53,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-03 11:00:53,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-03 11:00:53,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-03 11:00:53,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-03 11:00:53,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-03 11:00:53,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-03 11:00:53,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-03 11:00:53,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-03 11:00:53,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-03 11:00:53,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-03 11:00:53,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-03 11:00:53,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-03 11:00:53,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-03 11:00:53,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-03 11:00:53,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-03 11:00:53,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-03 11:00:53,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-03 11:00:53,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-03 11:00:53,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-03 11:00:53,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-03 11:00:53,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-03 11:00:53,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-03 11:00:53,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-03 11:00:53,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-03 11:00:53,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-03 11:00:53,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-03 11:00:53,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-03 11:00:53,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-03 11:00:53,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-03 11:00:53,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-03 11:00:53,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-03 11:00:53,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-03 11:00:53,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-03 11:00:53,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-03 11:00:53,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-03 11:00:53,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-03 11:00:53,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-03 11:00:53,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-03 11:00:53,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-03 11:00:53,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-03 11:00:53,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-03 11:00:53,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-03 11:00:53,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-03 11:00:53,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-03 11:00:53,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-03 11:00:53,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-03 11:00:53,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-03 11:00:53,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-03 11:00:53,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-03 11:00:53,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-03 11:00:53,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-03 11:00:53,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-03 11:00:53,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-03 11:00:53,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-03 11:00:53,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-03 11:00:53,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-03 11:00:53,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-03 11:00:53,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-03 11:00:53,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-03 11:00:53,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-03 11:00:53,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-03 11:00:53,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-03 11:00:53,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-03 11:00:53,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-03 11:00:53,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-03 11:00:53,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-03 11:00:53,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-03 11:00:53,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-03 11:00:53,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-03 11:00:53,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-03 11:00:53,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-03 11:00:53,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-03 11:00:53,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-03 11:00:53,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-03 11:00:53,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-03 11:00:53,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-03 11:00:53,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-03 11:00:53,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-03 11:00:53,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-03 11:00:53,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-03 11:00:53,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-03 11:00:53,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-03 11:00:53,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-03 11:00:53,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-03 11:00:53,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-03 11:00:53,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-03 11:00:53,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-03 11:00:53,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-03 11:00:53,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-03 11:00:53,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-03 11:00:53,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-03 11:00:53,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-03 11:00:53,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-03 11:00:53,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-03 11:00:54,031 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04015961420126708, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0559561316070187, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04015961420126708, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17958333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24975, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-03 11:00:54,031 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-03 11:00:54,031 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18460434466842393, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04015961420126708, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0559561316070187, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04015961420126708, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17958333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24975, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-03 11:00:54,225 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 306 ms to try 5000 different iterations.  Found a solution that moves 2694 regions; Going from a computed imbalance of 0.18460434466842393 to a new imbalance of 0.015310459624797126. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020950121585879878); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03633921739028952, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29933333333333334, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020950121585879878); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012166666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04525, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-03 11:00:54,241 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1872790797:78 , srv1939801284:78 , srv1631508425:79 , srv215756500:79 , srv1918121672:80 , srv1008054101:81 , srv1996402949:81 , srv321089258:81 , srv892434577:81 , srv976418488:81 , srv1072463925:82 , srv1151137121:82 , srv1154677314:82 , srv192446761:82 , srv221292844:82 , srv415300493:82 , srv1022751683:83 , srv1483956460:83 , srv45244649:83 , srv461904873:83 , srv905993505:83 , srv1011196136:84 , srv1038867446:84 , srv1236621634:84 , srv1487110653:84 , srv1043311691:85 , srv1048556365:85 , srv1246920255:85 , srv1301109821:85 , srv1500932965:85 , srv1564706864:85 , srv1833910648:85 , srv186865290:85 , srv1936578328:85 , srv1988691483:85 , srv2002553268:85 , srv2044109158:85 , srv2125478063:85 , srv2128116527:85 , srv356502321:85 , srv652323021:85 , srv736028396:85 , srv744405216:85 , srv809338542:85 , srv96775226:85 , srv1263569937:86 , srv1295635343:86 , srv1339334810:86 , srv1396509321:86 , srv1445732744:86 , srv1860558183:86 , srv1915745432:86 , srv2101208337:86 , srv2101915743:86 , srv2138285032:86 , srv413838780:86 , srv506212035:86 , srv597026112:86 , srv759834176:86 , srv805946024:86 , srv828526360:86 , srv958692333:86 , srv1031614275:87 , srv1406145511:87 , srv1892860255:87 , srv1915793142:87 , srv2070469579:87 , srv386937801:87 , srv74882064:87 , srv844598413:87 , srv878760421:87 , srv917871211:87 , srv1289111951:88 , srv1590762230:88 , srv1763553462:88 , srv236119228:88 , srv49570699:88 , srv809620327:88 , srv1266689451:89 , srv1744359142:89 , srv1845201197:89 , srv1924815713:89 , srv2043332323:89 , srv2120938751:89 , srv38218824:89 , srv624425231:89 , srv640497386:89 , srv64687857:89 , srv868818469:89 , srv1103171389:90 , srv1289891918:90 , srv2005121587:90 , srv2021999587:90 , srv460027241:90 , srv543014041:90 , srv805655531:90 , srv1199991994:91 , srv1558556275:92 , srv2035494086:93 , srv819845757:513 }
2023-04-03 11:00:54,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-03 11:00:54,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv186865290=36, srv1445732744=23, srv506212035=74, srv1939801284=45, srv1936578328=44, srv2120938751=57, srv1151137121=9, srv2138285032=60, srv1924815713=43, srv805655531=85, srv1246920255=13, srv1763553462=32, srv460027241=71, srv828526360=90, srv2044109158=53, srv356502321=65, srv1487110653=25, srv45244649=70, srv543014041=75, srv2128116527=59, srv868818469=92, srv1038867446=4, srv1918121672=41, srv958692333=97, srv1022751683=2, srv1043311691=5, srv2043332323=52, srv809620327=88, srv1236621634=12, srv1845201197=34, srv1915793142=40, srv1263569937=14, srv192446761=42, srv74882064=83, srv819845757=89, srv221292844=62, srv652323021=80, srv624425231=77, srv1396509321=21, srv2101915743=56, srv1915745432=39, srv1048556365=6, srv1339334810=20, srv215756500=61, srv2125478063=58, srv1860558183=35, srv1744359142=31, srv1031614275=3, srv1631508425=30, srv1301109821=19, srv905993505=95, srv1289891918=17, srv386937801=67, srv461904873=72, srv96775226=98, srv1564706864=28, srv49570699=73, srv976418488=99, srv1500932965=26, srv1872790797=37, srv1483956460=24, srv2005121587=49, srv1996402949=47, srv413838780=68, srv1988691483=46, srv64687857=79, srv892434577=94, srv917871211=96, srv2021999587=50, srv744405216=82, srv1199991994=11, srv640497386=78, srv1011196136=1, srv1103171389=8, srv2101208337=55, srv1154677314=10, srv844598413=91, srv1289111951=16, srv2002553268=48, srv236119228=63, srv38218824=66, srv1833910648=33, srv759834176=84, srv415300493=69, srv2035494086=51, srv321089258=64, srv597026112=76, srv1266689451=15, srv2070469579=54, srv1295635343=18, srv809338542=87, srv1008054101=0, srv805946024=86, srv1406145511=22, srv1558556275=27, srv1892860255=38, srv1072463925=7, srv1590762230=29, srv878760421=93, srv736028396=81} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-03 11:00:54,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-03 11:00:54,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-03 11:00:54,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-03 11:00:54,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-03 11:00:54,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-03 11:00:54,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-03 11:00:54,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-03 11:00:54,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-03 11:00:54,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-03 11:00:54,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-03 11:00:54,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-03 11:00:54,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-03 11:00:54,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-03 11:00:54,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-03 11:00:54,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-03 11:00:54,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-03 11:00:54,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-03 11:00:54,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-03 11:00:54,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-03 11:00:54,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-03 11:00:54,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-03 11:00:54,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-03 11:00:54,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-03 11:00:54,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-03 11:00:54,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-03 11:00:54,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-03 11:00:54,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-03 11:00:54,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-03 11:00:54,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-03 11:00:54,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-03 11:00:54,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-03 11:00:54,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-03 11:00:54,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-03 11:00:54,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-03 11:00:54,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-03 11:00:54,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-03 11:00:54,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-03 11:00:54,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-03 11:00:54,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-03 11:00:54,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-03 11:00:54,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-03 11:00:54,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-03 11:00:54,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-03 11:00:54,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-03 11:00:54,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-03 11:00:54,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-03 11:00:54,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-03 11:00:54,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-03 11:00:54,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-03 11:00:54,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-03 11:00:54,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-03 11:00:54,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-03 11:00:54,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-03 11:00:54,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-03 11:00:54,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-03 11:00:54,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-03 11:00:54,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-03 11:00:54,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-03 11:00:54,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-03 11:00:54,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-03 11:00:54,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-03 11:00:54,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-03 11:00:54,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-03 11:00:54,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-03 11:00:54,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-03 11:00:54,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-03 11:00:54,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-03 11:00:54,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-03 11:00:54,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-03 11:00:54,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-03 11:00:54,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-03 11:00:54,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-03 11:00:54,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-03 11:00:54,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-03 11:00:54,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-03 11:00:54,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-03 11:00:54,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-03 11:00:54,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-03 11:00:54,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-03 11:00:54,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-03 11:00:54,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-03 11:00:54,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-03 11:00:54,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-03 11:00:54,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-03 11:00:54,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-03 11:00:54,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-03 11:00:54,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-03 11:00:54,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-03 11:00:54,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-03 11:00:54,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-03 11:00:54,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-03 11:00:54,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-03 11:00:54,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-03 11:00:54,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-03 11:00:54,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-03 11:00:54,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-03 11:00:54,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-03 11:00:54,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-03 11:00:54,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-03 11:00:54,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-03 11:00:54,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-03 11:00:54,401 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020950121585879878); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03633921739028952, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020950121585879878); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012166666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04525, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-03 11:00:54,401 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-03 11:00:54,401 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.015291595833613234, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020950121585879878); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03633921739028952, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020950121585879878); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012166666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04525, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-03 11:00:54,574 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 272 ms to try 5000 different iterations.  Found a solution that moves 999 regions; Going from a computed imbalance of 0.015291595833613234 to a new imbalance of 8.626274367071595E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0044275774217583195); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007011294399627586); MoveCostFunction : (multiplier=7.0, imbalance=0.111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0044275774217583195); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.0E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003916666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-03 11:00:54,575 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv2035494086:81 , srv2043332323:82 , srv1199991994:83 , srv1266689451:83 , srv1295635343:83 , srv2005121587:83 , srv2120938751:83 , srv49570699:83 , srv543014041:83 , srv652323021:83 , srv805655531:83 , srv809620327:83 , srv1011196136:84 , srv1031614275:84 , srv1072463925:84 , srv1289891918:84 , srv1406145511:84 , srv1558556275:84 , srv1590762230:84 , srv1744359142:84 , srv1924815713:84 , srv2021999587:84 , srv2125478063:84 , srv386937801:84 , srv460027241:84 , srv597026112:84 , srv844598413:84 , srv917871211:84 , srv1038867446:85 , srv1043311691:85 , srv1103171389:85 , srv1151137121:85 , srv1263569937:85 , srv1289111951:85 , srv1915793142:85 , srv2101208337:85 , srv2128116527:85 , srv236119228:85 , srv38218824:85 , srv415300493:85 , srv624425231:85 , srv640497386:85 , srv759834176:85 , srv828526360:85 , srv868818469:85 , srv892434577:85 , srv1048556365:86 , srv1236621634:86 , srv1246920255:86 , srv1487110653:86 , srv1763553462:86 , srv1833910648:86 , srv1845201197:86 , srv1860558183:86 , srv186865290:86 , srv1872790797:86 , srv1892860255:86 , srv1915745432:86 , srv1918121672:86 , srv192446761:86 , srv1988691483:86 , srv2002553268:86 , srv2044109158:86 , srv2101915743:86 , srv2138285032:86 , srv221292844:86 , srv321089258:86 , srv356502321:86 , srv45244649:86 , srv461904873:86 , srv506212035:86 , srv736028396:86 , srv744405216:86 , srv74882064:86 , srv805946024:86 , srv878760421:86 , srv1022751683:87 , srv1154677314:87 , srv1301109821:87 , srv1500932965:87 , srv1936578328:87 , srv1996402949:87 , srv2070469579:87 , srv64687857:87 , srv905993505:87 , srv958692333:87 , srv976418488:87 , srv1008054101:88 , srv1396509321:88 , srv1483956460:88 , srv1564706864:88 , srv1631508425:88 , srv1939801284:88 , srv215756500:88 , srv413838780:88 , srv96775226:88 , srv1339334810:89 , srv1445732744:89 , srv809338542:89 , srv819845757:537 }
2023-04-03 11:00:54,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-03 11:00:54,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv186865290=36, srv1445732744=23, srv506212035=74, srv1939801284=45, srv1936578328=44, srv2120938751=57, srv1151137121=9, srv2138285032=60, srv1924815713=43, srv805655531=85, srv1246920255=13, srv1763553462=32, srv460027241=71, srv828526360=90, srv2044109158=53, srv356502321=65, srv1487110653=25, srv45244649=70, srv543014041=75, srv2128116527=59, srv868818469=92, srv1038867446=4, srv1918121672=41, srv958692333=97, srv1022751683=2, srv1043311691=5, srv2043332323=52, srv809620327=88, srv1236621634=12, srv1845201197=34, srv1915793142=40, srv1263569937=14, srv192446761=42, srv74882064=83, srv819845757=89, srv221292844=62, srv652323021=80, srv624425231=77, srv1396509321=21, srv2101915743=56, srv1915745432=39, srv1048556365=6, srv1339334810=20, srv215756500=61, srv2125478063=58, srv1860558183=35, srv1744359142=31, srv1031614275=3, srv1631508425=30, srv1301109821=19, srv905993505=95, srv1289891918=17, srv386937801=67, srv461904873=72, srv96775226=98, srv1564706864=28, srv49570699=73, srv976418488=99, srv1500932965=26, srv1872790797=37, srv1483956460=24, srv2005121587=49, srv1996402949=47, srv413838780=68, srv1988691483=46, srv64687857=79, srv892434577=94, srv917871211=96, srv2021999587=50, srv744405216=82, srv1199991994=11, srv640497386=78, srv1011196136=1, srv1103171389=8, srv2101208337=55, srv1154677314=10, srv844598413=91, srv1289111951=16, srv2002553268=48, srv236119228=63, srv38218824=66, srv1833910648=33, srv759834176=84, srv415300493=69, srv2035494086=51, srv321089258=64, srv597026112=76, srv1266689451=15, srv2070469579=54, srv1295635343=18, srv809338542=87, srv1008054101=0, srv805946024=86, srv1406145511=22, srv1558556275=27, srv1892860255=38, srv1072463925=7, srv1590762230=29, srv878760421=93, srv736028396=81} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-03 11:00:54,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-03 11:00:54,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-03 11:00:54,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-03 11:00:54,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-03 11:00:54,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-03 11:00:54,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-03 11:00:54,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-03 11:00:54,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-03 11:00:54,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-03 11:00:54,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-03 11:00:54,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-03 11:00:54,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-03 11:00:54,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-03 11:00:54,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-03 11:00:54,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-03 11:00:54,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-03 11:00:54,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-03 11:00:54,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-03 11:00:54,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-03 11:00:54,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-03 11:00:54,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-03 11:00:54,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-03 11:00:54,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-03 11:00:54,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-03 11:00:54,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-03 11:00:54,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-03 11:00:54,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-03 11:00:54,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-03 11:00:54,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-03 11:00:54,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-03 11:00:54,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-03 11:00:54,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-03 11:00:54,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-03 11:00:54,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-03 11:00:54,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-03 11:00:54,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-03 11:00:54,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-03 11:00:54,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-03 11:00:54,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-03 11:00:54,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-03 11:00:54,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-03 11:00:54,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-03 11:00:54,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-03 11:00:54,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-03 11:00:54,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-03 11:00:54,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-03 11:00:54,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-03 11:00:54,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-03 11:00:54,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-03 11:00:54,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-03 11:00:54,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-03 11:00:54,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-03 11:00:54,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-03 11:00:54,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-03 11:00:54,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-03 11:00:54,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-03 11:00:54,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-03 11:00:54,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-03 11:00:54,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-03 11:00:54,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-03 11:00:54,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-03 11:00:54,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-03 11:00:54,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-03 11:00:54,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-03 11:00:54,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-03 11:00:54,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-03 11:00:54,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-03 11:00:54,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-03 11:00:54,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-03 11:00:54,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-03 11:00:54,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-03 11:00:54,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-03 11:00:54,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-03 11:00:54,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-03 11:00:54,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-03 11:00:54,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-03 11:00:54,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-03 11:00:54,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-03 11:00:54,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-03 11:00:54,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-03 11:00:54,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-03 11:00:54,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-03 11:00:54,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-03 11:00:54,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-03 11:00:54,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-03 11:00:54,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-03 11:00:54,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-03 11:00:54,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-03 11:00:54,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-03 11:00:54,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-03 11:00:54,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-03 11:00:54,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-03 11:00:54,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-03 11:00:54,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-03 11:00:54,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-03 11:00:54,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-03 11:00:54,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-03 11:00:54,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-03 11:00:54,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-03 11:00:54,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-03 11:00:54,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-03 11:00:54,689 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0044275774217583195); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007011294399627586); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0044275774217583195); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.0E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003916666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-03 11:00:54,689 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-03 11:00:54,689 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=8.55632289196874E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0044275774217583195); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007011294399627586); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0044275774217583195); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.0E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003916666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-03 11:00:54,933 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 327 ms to try 5000 different iterations.  Found a solution that moves 214 regions; Going from a computed imbalance of 8.55632289196874E-4 to a new imbalance of 1.5505984469205055E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002551379987942442); MoveCostFunction : (multiplier=7.0, imbalance=0.023777777777777776); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-03 11:00:54,934 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1246920255:83 , srv1266689451:83 , srv1396509321:83 , srv1631508425:83 , srv2021999587:83 , srv215756500:83 , srv809338542:83 , srv868818469:83 , srv958692333:83 , srv1022751683:84 , srv1043311691:84 , srv1072463925:84 , srv1151137121:84 , srv1154677314:84 , srv1199991994:84 , srv1236621634:84 , srv1295635343:84 , srv1301109821:84 , srv1445732744:84 , srv1483956460:84 , srv1564706864:84 , srv1744359142:84 , srv1763553462:84 , srv1845201197:84 , srv1860558183:84 , srv1915745432:84 , srv1918121672:84 , srv1936578328:84 , srv1996402949:84 , srv2002553268:84 , srv2005121587:84 , srv2035494086:84 , srv2043332323:84 , srv2070469579:84 , srv2101208337:84 , srv2120938751:84 , srv2125478063:84 , srv2128116527:84 , srv2138285032:84 , srv236119228:84 , srv356502321:84 , srv386937801:84 , srv413838780:84 , srv461904873:84 , srv506212035:84 , srv624425231:84 , srv64687857:84 , srv744405216:84 , srv74882064:84 , srv759834176:84 , srv805655531:84 , srv805946024:84 , srv878760421:84 , srv917871211:84 , srv96775226:84 , srv976418488:84 , srv1008054101:85 , srv1011196136:85 , srv1031614275:85 , srv1048556365:85 , srv1263569937:85 , srv1289891918:85 , srv1339334810:85 , srv1406145511:85 , srv1487110653:85 , srv1500932965:85 , srv1558556275:85 , srv1590762230:85 , srv1833910648:85 , srv186865290:85 , srv1872790797:85 , srv1892860255:85 , srv1915793142:85 , srv192446761:85 , srv1924815713:85 , srv1939801284:85 , srv1988691483:85 , srv2044109158:85 , srv2101915743:85 , srv221292844:85 , srv321089258:85 , srv38218824:85 , srv45244649:85 , srv460027241:85 , srv49570699:85 , srv543014041:85 , srv597026112:85 , srv640497386:85 , srv652323021:85 , srv736028396:85 , srv809620327:85 , srv828526360:85 , srv844598413:85 , srv892434577:85 , srv905993505:85 , srv1038867446:86 , srv1103171389:86 , srv415300493:86 , srv1289111951:87 , srv819845757:645 }
2023-04-03 11:00:54,937 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-03 11:00:54,938 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv186865290=36, srv1445732744=23, srv506212035=74, srv1939801284=45, srv1936578328=44, srv2120938751=57, srv1151137121=9, srv2138285032=60, srv1924815713=43, srv805655531=85, srv1246920255=13, srv1763553462=32, srv460027241=71, srv828526360=90, srv2044109158=53, srv356502321=65, srv1487110653=25, srv45244649=70, srv543014041=75, srv2128116527=59, srv868818469=92, srv1038867446=4, srv1918121672=41, srv958692333=97, srv1022751683=2, srv1043311691=5, srv2043332323=52, srv809620327=88, srv1236621634=12, srv1845201197=34, srv1915793142=40, srv1263569937=14, srv192446761=42, srv74882064=83, srv819845757=89, srv221292844=62, srv652323021=80, srv624425231=77, srv1396509321=21, srv2101915743=56, srv1915745432=39, srv1048556365=6, srv1339334810=20, srv215756500=61, srv2125478063=58, srv1860558183=35, srv1744359142=31, srv1031614275=3, srv1631508425=30, srv1301109821=19, srv905993505=95, srv1289891918=17, srv386937801=67, srv461904873=72, srv96775226=98, srv1564706864=28, srv49570699=73, srv976418488=99, srv1500932965=26, srv1872790797=37, srv1483956460=24, srv2005121587=49, srv1996402949=47, srv413838780=68, srv1988691483=46, srv64687857=79, srv892434577=94, srv917871211=96, srv2021999587=50, srv744405216=82, srv1199991994=11, srv640497386=78, srv1011196136=1, srv1103171389=8, srv2101208337=55, srv1154677314=10, srv844598413=91, srv1289111951=16, srv2002553268=48, srv236119228=63, srv38218824=66, srv1833910648=33, srv759834176=84, srv415300493=69, srv2035494086=51, srv321089258=64, srv597026112=76, srv1266689451=15, srv2070469579=54, srv1295635343=18, srv809338542=87, srv1008054101=0, srv805946024=86, srv1406145511=22, srv1558556275=27, srv1892860255=38, srv1072463925=7, srv1590762230=29, srv878760421=93, srv736028396=81} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-03 11:00:54,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-03 11:00:54,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-03 11:00:54,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-03 11:00:54,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-03 11:00:54,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-03 11:00:54,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-03 11:00:54,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-03 11:00:54,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-03 11:00:54,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-03 11:00:54,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-03 11:00:54,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-03 11:00:54,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-03 11:00:54,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-03 11:00:54,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-03 11:00:54,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-03 11:00:54,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-03 11:00:54,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-03 11:00:54,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-03 11:00:54,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-03 11:00:54,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-03 11:00:54,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-03 11:00:54,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-03 11:00:54,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-03 11:00:54,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-03 11:00:54,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-03 11:00:54,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-03 11:00:54,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-03 11:00:54,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-03 11:00:54,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-03 11:00:54,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-03 11:00:54,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-03 11:00:54,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-03 11:00:54,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-03 11:00:54,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-03 11:00:54,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-03 11:00:54,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-03 11:00:54,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-03 11:00:54,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-03 11:00:54,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-03 11:00:54,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-03 11:00:54,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-03 11:00:54,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-03 11:00:54,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-03 11:00:54,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-03 11:00:54,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-03 11:00:54,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-03 11:00:54,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-03 11:00:54,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-03 11:00:54,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-03 11:00:54,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-03 11:00:54,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-03 11:00:54,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-03 11:00:54,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-03 11:00:54,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-03 11:00:54,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-03 11:00:54,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-03 11:00:54,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-03 11:00:54,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-03 11:00:54,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-03 11:00:54,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-03 11:00:54,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-03 11:00:54,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-03 11:00:54,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-03 11:00:54,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-03 11:00:54,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-03 11:00:54,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-03 11:00:54,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-03 11:00:54,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-03 11:00:54,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-03 11:00:54,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-03 11:00:54,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-03 11:00:54,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-03 11:00:54,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-03 11:00:54,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-03 11:00:54,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-03 11:00:54,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-03 11:00:54,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-03 11:00:54,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-03 11:00:54,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-03 11:00:54,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-03 11:00:54,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-03 11:00:54,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-03 11:00:54,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-03 11:00:54,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-03 11:00:54,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-03 11:00:54,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-03 11:00:54,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-03 11:00:54,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-03 11:00:54,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-03 11:00:54,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-03 11:00:54,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-03 11:00:54,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-03 11:00:54,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-03 11:00:54,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-03 11:00:54,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-03 11:00:54,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-03 11:00:54,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-03 11:00:54,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-03 11:00:54,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-03 11:00:54,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-03 11:00:54,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-03 11:00:55,036 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=1.4007524441976696E-5 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002551379987942442); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-03 11:00:55,036 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1246920255:83 , srv1266689451:83 , srv1396509321:83 , srv1631508425:83 , srv2021999587:83 , srv215756500:83 , srv809338542:83 , srv868818469:83 , srv958692333:83 , srv1022751683:84 , srv1043311691:84 , srv1072463925:84 , srv1151137121:84 , srv1154677314:84 , srv1199991994:84 , srv1236621634:84 , srv1295635343:84 , srv1301109821:84 , srv1445732744:84 , srv1483956460:84 , srv1564706864:84 , srv1744359142:84 , srv1763553462:84 , srv1845201197:84 , srv1860558183:84 , srv1915745432:84 , srv1918121672:84 , srv1936578328:84 , srv1996402949:84 , srv2002553268:84 , srv2005121587:84 , srv2035494086:84 , srv2043332323:84 , srv2070469579:84 , srv2101208337:84 , srv2120938751:84 , srv2125478063:84 , srv2128116527:84 , srv2138285032:84 , srv236119228:84 , srv356502321:84 , srv386937801:84 , srv413838780:84 , srv461904873:84 , srv506212035:84 , srv624425231:84 , srv64687857:84 , srv744405216:84 , srv74882064:84 , srv759834176:84 , srv805655531:84 , srv805946024:84 , srv878760421:84 , srv917871211:84 , srv96775226:84 , srv976418488:84 , srv1008054101:85 , srv1011196136:85 , srv1031614275:85 , srv1048556365:85 , srv1263569937:85 , srv1289891918:85 , srv1339334810:85 , srv1406145511:85 , srv1487110653:85 , srv1500932965:85 , srv1558556275:85 , srv1590762230:85 , srv1833910648:85 , srv186865290:85 , srv1872790797:85 , srv1892860255:85 , srv1915793142:85 , srv192446761:85 , srv1924815713:85 , srv1939801284:85 , srv1988691483:85 , srv2044109158:85 , srv2101915743:85 , srv221292844:85 , srv321089258:85 , srv38218824:85 , srv45244649:85 , srv460027241:85 , srv49570699:85 , srv543014041:85 , srv597026112:85 , srv640497386:85 , srv652323021:85 , srv736028396:85 , srv809620327:85 , srv828526360:85 , srv844598413:85 , srv892434577:85 , srv905993505:85 , srv1038867446:86 , srv1103171389:86 , srv415300493:86 , srv1289111951:87 , srv819845757:645 }
2023-04-03 11:00:55,056 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=274 (was 263) - SystemLoadAverage LEAK? -, ProcessCount=165 (was 165), AvailableMemoryMB=4196 (was 4679)
2023-04-03 11:00:55,063 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=274, ProcessCount=165, AvailableMemoryMB=4196
2023-04-03 11:00:55,064 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-03 11:00:55,064 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-04-03 11:00:55,071 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1007178387:84 , srv1023089593:84 , srv1026424441:84 , srv1100567293:84 , srv1185598717:84 , srv1380316279:84 , srv1384190126:84 , srv1642707926:84 , srv1731029904:84 , srv176837145:84 , srv1804554552:84 , srv1852328652:84 , srv2023322319:84 , srv2066775739:84 , srv2107488183:84 , srv2112559744:84 , srv242359720:84 , srv260678566:84 , srv282190806:84 , srv321637900:84 , srv3694732:84 , srv374634557:84 , srv380449507:84 , srv501237237:84 , srv602144357:84 , srv611504442:84 , srv667888558:84 , srv773926506:84 , srv88335759:84 , srv226551948:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-04-03 11:00:55,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-03 11:00:55,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv3694732=21, srv321637900=20, srv2066775739=13, srv242359720=17, srv374634557=22, srv1007178387=0, srv176837145=9, srv2112559744=15, srv602144357=25, srv88335759=29, srv1852328652=11, srv773926506=28, srv2107488183=14, srv1100567293=3, srv260678566=18, srv1380316279=5, srv611504442=26, srv1023089593=1, srv667888558=27, srv282190806=19, srv1384190126=6, srv1026424441=2, srv226551948=16, srv501237237=24, srv1642707926=7, srv1731029904=8, srv380449507=23, srv2023322319=12, srv1185598717=4, srv1804554552=10} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-03 11:00:55,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-03 11:00:55,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-03 11:00:55,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-03 11:00:55,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-03 11:00:55,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-03 11:00:55,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-03 11:00:55,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-03 11:00:55,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-03 11:00:55,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-03 11:00:55,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-03 11:00:55,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-03 11:00:55,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-03 11:00:55,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-03 11:00:55,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-03 11:00:55,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-03 11:00:55,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-03 11:00:55,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-03 11:00:55,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-03 11:00:55,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-03 11:00:55,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-03 11:00:55,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-03 11:00:55,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-03 11:00:55,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-03 11:00:55,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-03 11:00:55,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-03 11:00:55,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-03 11:00:55,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-03 11:00:55,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-03 11:00:55,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-03 11:00:55,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-03 11:00:55,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-04-03 11:00:55,092 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0935829831361326, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-03 11:00:55,093 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912487920188376, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0935829831361326, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-04-03 11:02:55,084 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 9201144 different iterations.  Found a solution that moves 1831 regions; Going from a computed imbalance of 0.9912487920188376 to a new imbalance of 4.2736453424534666E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6781481481481482, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-03 11:02:55,089 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1007178387:90 , srv1023089593:90 , srv1026424441:90 , srv1100567293:90 , srv1185598717:90 , srv1380316279:90 , srv1384190126:90 , srv1642707926:90 , srv1731029904:90 , srv176837145:90 , srv1804554552:90 , srv1852328652:90 , srv2023322319:90 , srv2066775739:90 , srv2107488183:90 , srv2112559744:90 , srv226551948:90 , srv242359720:90 , srv260678566:90 , srv282190806:90 , srv321637900:90 , srv3694732:90 , srv374634557:90 , srv380449507:90 , srv501237237:90 , srv602144357:90 , srv611504442:90 , srv667888558:90 , srv773926506:90 , srv88335759:90 }
2023-04-03 11:02:55,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-03 11:02:55,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv3694732=21, srv321637900=20, srv2066775739=13, srv242359720=17, srv374634557=22, srv1007178387=0, srv176837145=9, srv2112559744=15, srv602144357=25, srv88335759=29, srv1852328652=11, srv773926506=28, srv2107488183=14, srv1100567293=3, srv260678566=18, srv1380316279=5, srv611504442=26, srv1023089593=1, srv667888558=27, srv282190806=19, srv1384190126=6, srv1026424441=2, srv226551948=16, srv501237237=24, srv1642707926=7, srv1731029904=8, srv380449507=23, srv2023322319=12, srv1185598717=4, srv1804554552=10} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-03 11:02:55,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-03 11:02:55,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-03 11:02:55,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-03 11:02:55,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-03 11:02:55,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-03 11:02:55,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-03 11:02:55,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-03 11:02:55,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-03 11:02:55,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-03 11:02:55,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-03 11:02:55,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-03 11:02:55,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-03 11:02:55,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-03 11:02:55,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-03 11:02:55,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-03 11:02:55,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-03 11:02:55,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-03 11:02:55,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-03 11:02:55,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-03 11:02:55,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-03 11:02:55,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-03 11:02:55,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-03 11:02:55,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-03 11:02:55,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-03 11:02:55,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-03 11:02:55,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-03 11:02:55,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-03 11:02:55,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-03 11:02:55,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-03 11:02:55,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-03 11:02:55,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-04-03 11:02:55,103 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-03 11:02:55,103 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1007178387:90 , srv1023089593:90 , srv1026424441:90 , srv1100567293:90 , srv1185598717:90 , srv1380316279:90 , srv1384190126:90 , srv1642707926:90 , srv1731029904:90 , srv176837145:90 , srv1804554552:90 , srv1852328652:90 , srv2023322319:90 , srv2066775739:90 , srv2107488183:90 , srv2112559744:90 , srv226551948:90 , srv242359720:90 , srv260678566:90 , srv282190806:90 , srv321637900:90 , srv3694732:90 , srv374634557:90 , srv380449507:90 , srv501237237:90 , srv602144357:90 , srv611504442:90 , srv667888558:90 , srv773926506:90 , srv88335759:90 }
2023-04-03 11:02:55,113 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=9 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=193 (was 274), ProcessCount=165 (was 165), AvailableMemoryMB=4070 (was 4196)