2023-06-06 08:53:24,397 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-06-06 08:53:24,665 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-06-06 08:53:24,764 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-06-06 08:53:24,819 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-06-06 08:53:24,826 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-06-06 08:53:24,838 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=400, ProcessCount=177, AvailableMemoryMB=8210
2023-06-06 08:53:24,840 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-06-06 08:53:24,841 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-06-06 08:53:24,959 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1003413249:84 , srv1013651395:84 , srv103007289:84 , srv1077719315:84 , srv1085299235:84 , srv1098610983:84 , srv1156363772:84 , srv11594084:84 , srv1159990755:84 , srv1191095953:84 , srv1202738944:84 , srv1229556977:84 , srv123613404:84 , srv124916237:84 , srv1270137378:84 , srv1288150606:84 , srv1293068586:84 , srv1345314549:84 , srv13464797:84 , srv1354875913:84 , srv1358140724:84 , srv1358885320:84 , srv1361689495:84 , srv1363292937:84 , srv1389538630:84 , srv1452801414:84 , srv1453822736:84 , srv146472816:84 , srv1470249648:84 , srv1477736799:84 , srv1490483860:84 , srv1557564034:84 , srv1681957682:84 , srv1711752447:84 , srv1711923108:84 , srv1720176110:84 , srv1749714313:84 , srv1750284377:84 , srv1769720177:84 , srv1781070920:84 , srv1781647063:84 , srv1782504583:84 , srv1790590003:84 , srv1794858086:84 , srv1806104207:84 , srv1817544242:84 , srv1829706189:84 , srv184035776:84 , srv1857435470:84 , srv1884819110:84 , srv1905326230:84 , srv1941658159:84 , srv1961516968:84 , srv1984145033:84 , srv1999005261:84 , srv2019324906:84 , srv2054660140:84 , srv2057713889:84 , srv2058511510:84 , srv2059857268:84 , srv2140342374:84 , srv225589968:84 , srv235825327:84 , srv241637343:84 , srv246148354:84 , srv263072224:84 , srv276947149:84 , srv290375543:84 , srv330734731:84 , srv347300443:84 , srv352579354:84 , srv373403493:84 , srv402648216:84 , srv41030017:84 , srv429607479:84 , srv434461584:84 , srv448230014:84 , srv494854160:84 , srv539863997:84 , srv554585789:84 , srv606499608:84 , srv622130346:84 , srv668655589:84 , srv702223797:84 , srv721541723:84 , srv727296575:84 , srv747427490:84 , srv774084824:84 , srv804668101:84 , srv829021266:84 , srv895344431:84 , srv90751534:84 , srv917104273:84 , srv919148626:84 , srv930647353:84 , srv95826760:84 , srv969543998:84 , srv974782919:84 , srv985792094:84 , srv1896097710:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-06-06 08:53:24,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-06-06 08:53:24,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1896097710=50, srv225589968=62, srv919148626=94, srv1288150606=15, srv1806104207=44, srv2140342374=61, srv1077719315=3, srv2019324906=56, srv1857435470=48, srv1749714313=36, srv90751534=92, srv1490483860=30, srv1941658159=52, srv246148354=65, srv290375543=68, srv622130346=82, srv930647353=95, srv969543998=97, srv1999005261=55, srv448230014=77, srv804668101=89, srv1794858086=43, srv1202738944=10, srv1781647063=40, srv1470249648=28, srv13464797=18, srv276947149=67, srv606499608=81, srv1961516968=53, srv1769720177=38, srv1477736799=29, srv1557564034=31, srv402648216=73, srv1720176110=35, srv1085299235=4, srv1781070920=39, srv330734731=69, srv263072224=66, srv1229556977=11, srv774084824=88, srv554585789=80, srv747427490=87, srv539863997=79, srv1345314549=17, srv124916237=13, srv2058511510=59, srv1358140724=20, srv2059857268=60, srv373403493=72, srv1293068586=16, srv727296575=86, srv95826760=96, srv1984145033=54, srv1098610983=5, srv1452801414=25, srv1829706189=46, srv721541723=85, srv1156363772=6, srv1711752447=33, srv1270137378=14, srv1711923108=34, srv1013651395=1, srv235825327=63, srv123613404=12, srv352579354=71, srv1782504583=41, srv985792094=99, srv347300443=70, srv974782919=98, srv103007289=2, srv434461584=76, srv494854160=78, srv668655589=83, srv1681957682=32, srv895344431=91, srv829021266=90, srv1817544242=45, srv1884819110=49, srv41030017=74, srv1790590003=42, srv241637343=64, srv146472816=27, srv1358885320=21, srv1003413249=0, srv1191095953=9, srv1354875913=19, srv429607479=75, srv2057713889=58, srv11594084=7, srv1453822736=26, srv1389538630=24, srv917104273=93, srv702223797=84, srv1159990755=8, srv1905326230=51, srv1750284377=37, srv1361689495=22, srv184035776=47, srv1363292937=23, srv2054660140=57} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-06-06 08:53:25,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-06-06 08:53:25,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-06-06 08:53:25,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-06-06 08:53:25,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-06-06 08:53:25,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-06-06 08:53:25,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-06-06 08:53:25,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-06-06 08:53:25,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-06-06 08:53:25,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-06-06 08:53:25,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-06-06 08:53:25,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-06-06 08:53:25,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-06-06 08:53:25,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-06-06 08:53:25,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-06-06 08:53:25,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-06-06 08:53:25,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-06-06 08:53:25,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-06-06 08:53:25,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-06-06 08:53:25,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-06-06 08:53:25,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-06-06 08:53:25,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-06-06 08:53:25,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-06-06 08:53:25,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-06-06 08:53:25,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-06-06 08:53:25,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-06-06 08:53:25,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-06-06 08:53:25,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-06-06 08:53:25,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-06-06 08:53:25,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-06-06 08:53:25,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-06-06 08:53:25,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-06-06 08:53:25,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-06-06 08:53:25,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-06-06 08:53:25,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-06-06 08:53:25,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-06-06 08:53:25,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-06-06 08:53:25,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-06-06 08:53:25,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-06-06 08:53:25,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-06-06 08:53:25,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-06-06 08:53:25,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-06-06 08:53:25,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-06-06 08:53:25,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-06-06 08:53:25,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-06-06 08:53:25,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-06-06 08:53:25,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-06-06 08:53:25,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-06-06 08:53:25,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-06-06 08:53:25,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-06-06 08:53:25,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-06-06 08:53:25,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-06-06 08:53:25,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-06-06 08:53:25,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-06-06 08:53:25,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-06-06 08:53:25,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-06-06 08:53:25,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-06-06 08:53:25,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-06-06 08:53:25,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-06-06 08:53:25,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-06-06 08:53:25,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-06-06 08:53:25,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-06-06 08:53:25,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-06-06 08:53:25,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-06-06 08:53:25,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-06-06 08:53:25,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-06-06 08:53:25,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-06-06 08:53:25,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-06-06 08:53:25,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-06-06 08:53:25,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-06-06 08:53:25,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-06-06 08:53:25,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-06-06 08:53:25,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-06-06 08:53:25,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-06-06 08:53:25,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-06-06 08:53:25,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-06-06 08:53:25,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-06-06 08:53:25,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-06-06 08:53:25,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-06-06 08:53:25,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-06-06 08:53:25,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-06-06 08:53:25,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-06-06 08:53:25,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-06-06 08:53:25,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-06-06 08:53:25,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-06-06 08:53:25,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-06-06 08:53:25,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-06-06 08:53:25,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-06-06 08:53:25,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-06-06 08:53:25,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-06-06 08:53:25,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-06-06 08:53:25,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-06-06 08:53:25,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-06-06 08:53:25,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-06-06 08:53:25,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-06-06 08:53:25,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-06-06 08:53:25,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-06-06 08:53:25,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-06-06 08:53:25,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-06-06 08:53:25,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-06-06 08:53:25,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-06-06 08:53:25,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-06-06 08:53:25,208 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-06-06 08:53:25,208 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-06-06 08:53:25,208 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-06-06 08:53:25,559 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 477 ms to try 5000 different iterations.  Found a solution that moves 4690 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17935102050951784. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.035676002498298984, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05141106537602234, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5211111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.035676002498298984, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17483333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.239, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-06-06 08:53:25,568 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv895344431:82 , srv1354875913:83 , srv1363292937:83 , srv1711752447:83 , srv1749714313:83 , srv2058511510:83 , srv235825327:83 , srv241637343:83 , srv41030017:83 , srv539863997:83 , srv95826760:83 , srv1013651395:84 , srv1077719315:84 , srv1229556977:84 , srv123613404:84 , srv1720176110:84 , srv1857435470:84 , srv668655589:84 , srv930647353:84 , srv1345314549:85 , srv1453822736:85 , srv1477736799:85 , srv1781070920:85 , srv1781647063:85 , srv2140342374:85 , srv276947149:85 , srv373403493:85 , srv747427490:85 , srv774084824:85 , srv985792094:85 , srv11594084:86 , srv1293068586:86 , srv1358140724:86 , srv1490483860:86 , srv184035776:86 , srv1961516968:86 , srv1984145033:86 , srv2059857268:86 , srv721541723:86 , srv727296575:86 , srv804668101:86 , srv919148626:86 , srv1003413249:87 , srv1098610983:87 , srv1202738944:87 , srv1358885320:87 , srv1389538630:87 , srv1452801414:87 , srv1470249648:87 , srv1711923108:87 , srv1750284377:87 , srv1769720177:87 , srv1884819110:87 , srv1941658159:87 , srv1999005261:87 , srv225589968:87 , srv246148354:87 , srv290375543:87 , srv352579354:87 , srv554585789:87 , srv702223797:87 , srv1159990755:88 , srv1270137378:88 , srv1288150606:88 , srv1681957682:88 , srv1782504583:88 , srv1817544242:88 , srv1829706189:88 , srv1905326230:88 , srv2019324906:88 , srv347300443:88 , srv448230014:88 , srv494854160:88 , srv606499608:88 , srv829021266:88 , srv90751534:88 , srv103007289:89 , srv1156363772:89 , srv1191095953:89 , srv124916237:89 , srv13464797:89 , srv1794858086:89 , srv1806104207:89 , srv2054660140:89 , srv330734731:89 , srv429607479:89 , srv917104273:89 , srv1557564034:90 , srv1790590003:90 , srv2057713889:90 , srv434461584:90 , srv622130346:90 , srv969543998:90 , srv1085299235:91 , srv146472816:91 , srv402648216:91 , srv974782919:91 , srv1361689495:92 , srv263072224:94 , srv1896097710:407 }
2023-06-06 08:53:25,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-06-06 08:53:25,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1896097710=50, srv225589968=62, srv919148626=94, srv1288150606=15, srv1806104207=44, srv2140342374=61, srv1077719315=3, srv2019324906=56, srv1857435470=48, srv1749714313=36, srv90751534=92, srv1490483860=30, srv1941658159=52, srv246148354=65, srv290375543=68, srv622130346=82, srv930647353=95, srv969543998=97, srv1999005261=55, srv448230014=77, srv804668101=89, srv1794858086=43, srv1202738944=10, srv1781647063=40, srv1470249648=28, srv13464797=18, srv276947149=67, srv606499608=81, srv1961516968=53, srv1769720177=38, srv1477736799=29, srv1557564034=31, srv402648216=73, srv1720176110=35, srv1085299235=4, srv1781070920=39, srv330734731=69, srv263072224=66, srv1229556977=11, srv774084824=88, srv554585789=80, srv747427490=87, srv539863997=79, srv1345314549=17, srv124916237=13, srv2058511510=59, srv1358140724=20, srv2059857268=60, srv373403493=72, srv1293068586=16, srv727296575=86, srv95826760=96, srv1984145033=54, srv1098610983=5, srv1452801414=25, srv1829706189=46, srv721541723=85, srv1156363772=6, srv1711752447=33, srv1270137378=14, srv1711923108=34, srv1013651395=1, srv235825327=63, srv123613404=12, srv352579354=71, srv1782504583=41, srv985792094=99, srv347300443=70, srv974782919=98, srv103007289=2, srv434461584=76, srv494854160=78, srv668655589=83, srv1681957682=32, srv895344431=91, srv829021266=90, srv1817544242=45, srv1884819110=49, srv41030017=74, srv1790590003=42, srv241637343=64, srv146472816=27, srv1358885320=21, srv1003413249=0, srv1191095953=9, srv1354875913=19, srv429607479=75, srv2057713889=58, srv11594084=7, srv1453822736=26, srv1389538630=24, srv917104273=93, srv702223797=84, srv1159990755=8, srv1905326230=51, srv1750284377=37, srv1361689495=22, srv184035776=47, srv1363292937=23, srv2054660140=57} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-06-06 08:53:25,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-06-06 08:53:25,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-06-06 08:53:25,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-06-06 08:53:25,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-06-06 08:53:25,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-06-06 08:53:25,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-06-06 08:53:25,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-06-06 08:53:25,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-06-06 08:53:25,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-06-06 08:53:25,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-06-06 08:53:25,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-06-06 08:53:25,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-06-06 08:53:25,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-06-06 08:53:25,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-06-06 08:53:25,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-06-06 08:53:25,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-06-06 08:53:25,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-06-06 08:53:25,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-06-06 08:53:25,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-06-06 08:53:25,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-06-06 08:53:25,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-06-06 08:53:25,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-06-06 08:53:25,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-06-06 08:53:25,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-06-06 08:53:25,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-06-06 08:53:25,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-06-06 08:53:25,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-06-06 08:53:25,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-06-06 08:53:25,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-06-06 08:53:25,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-06-06 08:53:25,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-06-06 08:53:25,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-06-06 08:53:25,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-06-06 08:53:25,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-06-06 08:53:25,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-06-06 08:53:25,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-06-06 08:53:25,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-06-06 08:53:25,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-06-06 08:53:25,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-06-06 08:53:25,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-06-06 08:53:25,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-06-06 08:53:25,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-06-06 08:53:25,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-06-06 08:53:25,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-06-06 08:53:25,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-06-06 08:53:25,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-06-06 08:53:25,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-06-06 08:53:25,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-06-06 08:53:25,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-06-06 08:53:25,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-06-06 08:53:25,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-06-06 08:53:25,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-06-06 08:53:25,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-06-06 08:53:25,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-06-06 08:53:25,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-06-06 08:53:25,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-06-06 08:53:25,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-06-06 08:53:25,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-06-06 08:53:25,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-06-06 08:53:25,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-06-06 08:53:25,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-06-06 08:53:25,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-06-06 08:53:25,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-06-06 08:53:25,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-06-06 08:53:25,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-06-06 08:53:25,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-06-06 08:53:25,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-06-06 08:53:25,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-06-06 08:53:25,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-06-06 08:53:25,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-06-06 08:53:25,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-06-06 08:53:25,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-06-06 08:53:25,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-06-06 08:53:25,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-06-06 08:53:25,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-06-06 08:53:25,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-06-06 08:53:25,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-06-06 08:53:25,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-06-06 08:53:25,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-06-06 08:53:25,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-06-06 08:53:25,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-06-06 08:53:25,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-06-06 08:53:25,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-06-06 08:53:25,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-06-06 08:53:25,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-06-06 08:53:25,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-06-06 08:53:25,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-06-06 08:53:25,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-06-06 08:53:25,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-06-06 08:53:25,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-06-06 08:53:25,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-06-06 08:53:25,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-06-06 08:53:25,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-06-06 08:53:25,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-06-06 08:53:25,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-06-06 08:53:25,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-06-06 08:53:25,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-06-06 08:53:25,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-06-06 08:53:25,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-06-06 08:53:25,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-06-06 08:53:25,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-06-06 08:53:25,725 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.035676002498298984, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05141106537602234, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.035676002498298984, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17483333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.239, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-06-06 08:53:25,725 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-06-06 08:53:25,726 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17931818042761272, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.035676002498298984, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05141106537602234, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.035676002498298984, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17483333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.239, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-06-06 08:53:26,126 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 521 ms to try 5000 different iterations.  Found a solution that moves 2675 regions; Going from a computed imbalance of 0.17931818042761272 to a new imbalance of 0.014679364428761141. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.019824016869532182); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03237338281215884, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2972222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.019824016869532182); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0115); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04516666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-06-06 08:53:26,138 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv263072224:79 , srv1085299235:80 , srv402648216:80 , srv1191095953:81 , srv1361689495:81 , srv917104273:81 , srv103007289:82 , srv13464797:82 , srv146472816:82 , srv1794858086:82 , srv1817544242:82 , srv2057713889:82 , srv330734731:82 , srv969543998:82 , srv124916237:83 , srv1750284377:83 , srv1769720177:83 , srv1806104207:83 , srv1829706189:83 , srv434461584:83 , srv622130346:83 , srv974782919:83 , srv1098610983:84 , srv1159990755:84 , srv1389538630:84 , srv1452801414:84 , srv1557564034:84 , srv1711923108:84 , srv1782504583:84 , srv1984145033:84 , srv2019324906:84 , srv2054660140:84 , srv246148354:84 , srv347300443:84 , srv429607479:84 , srv448230014:84 , srv606499608:84 , srv11594084:85 , srv1288150606:85 , srv1470249648:85 , srv1490483860:85 , srv1681957682:85 , srv1781070920:85 , srv1781647063:85 , srv1790590003:85 , srv1884819110:85 , srv1905326230:85 , srv494854160:85 , srv702223797:85 , srv774084824:85 , srv804668101:85 , srv829021266:85 , srv1003413249:86 , srv1077719315:86 , srv1270137378:86 , srv1477736799:86 , srv1941658159:86 , srv2059857268:86 , srv225589968:86 , srv554585789:86 , srv721541723:86 , srv90751534:86 , srv919148626:86 , srv930647353:86 , srv985792094:86 , srv1013651395:87 , srv1358885320:87 , srv1453822736:87 , srv1961516968:87 , srv2058511510:87 , srv352579354:87 , srv1202738944:88 , srv123613404:88 , srv1345314549:88 , srv1358140724:88 , srv1711752447:88 , srv1720176110:88 , srv1749714313:88 , srv184035776:88 , srv1857435470:88 , srv1999005261:88 , srv2140342374:88 , srv241637343:88 , srv276947149:88 , srv290375543:88 , srv373403493:88 , srv41030017:88 , srv727296575:88 , srv95826760:88 , srv1156363772:89 , srv1229556977:89 , srv1293068586:89 , srv235825327:89 , srv668655589:89 , srv747427490:89 , srv895344431:89 , srv1363292937:90 , srv1354875913:91 , srv539863997:92 , srv1896097710:543 }
2023-06-06 08:53:26,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-06-06 08:53:26,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1896097710=50, srv225589968=62, srv919148626=94, srv1288150606=15, srv1806104207=44, srv2140342374=61, srv1077719315=3, srv2019324906=56, srv1857435470=48, srv1749714313=36, srv90751534=92, srv1490483860=30, srv1941658159=52, srv246148354=65, srv290375543=68, srv622130346=82, srv930647353=95, srv969543998=97, srv1999005261=55, srv448230014=77, srv804668101=89, srv1794858086=43, srv1202738944=10, srv1781647063=40, srv1470249648=28, srv13464797=18, srv276947149=67, srv606499608=81, srv1961516968=53, srv1769720177=38, srv1477736799=29, srv1557564034=31, srv402648216=73, srv1720176110=35, srv1085299235=4, srv1781070920=39, srv330734731=69, srv263072224=66, srv1229556977=11, srv774084824=88, srv554585789=80, srv747427490=87, srv539863997=79, srv1345314549=17, srv124916237=13, srv2058511510=59, srv1358140724=20, srv2059857268=60, srv373403493=72, srv1293068586=16, srv727296575=86, srv95826760=96, srv1984145033=54, srv1098610983=5, srv1452801414=25, srv1829706189=46, srv721541723=85, srv1156363772=6, srv1711752447=33, srv1270137378=14, srv1711923108=34, srv1013651395=1, srv235825327=63, srv123613404=12, srv352579354=71, srv1782504583=41, srv985792094=99, srv347300443=70, srv974782919=98, srv103007289=2, srv434461584=76, srv494854160=78, srv668655589=83, srv1681957682=32, srv895344431=91, srv829021266=90, srv1817544242=45, srv1884819110=49, srv41030017=74, srv1790590003=42, srv241637343=64, srv146472816=27, srv1358885320=21, srv1003413249=0, srv1191095953=9, srv1354875913=19, srv429607479=75, srv2057713889=58, srv11594084=7, srv1453822736=26, srv1389538630=24, srv917104273=93, srv702223797=84, srv1159990755=8, srv1905326230=51, srv1750284377=37, srv1361689495=22, srv184035776=47, srv1363292937=23, srv2054660140=57} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-06-06 08:53:26,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-06-06 08:53:26,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-06-06 08:53:26,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-06-06 08:53:26,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-06-06 08:53:26,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-06-06 08:53:26,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-06-06 08:53:26,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-06-06 08:53:26,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-06-06 08:53:26,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-06-06 08:53:26,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-06-06 08:53:26,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-06-06 08:53:26,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-06-06 08:53:26,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-06-06 08:53:26,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-06-06 08:53:26,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-06-06 08:53:26,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-06-06 08:53:26,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-06-06 08:53:26,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-06-06 08:53:26,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-06-06 08:53:26,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-06-06 08:53:26,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-06-06 08:53:26,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-06-06 08:53:26,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-06-06 08:53:26,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-06-06 08:53:26,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-06-06 08:53:26,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-06-06 08:53:26,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-06-06 08:53:26,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-06-06 08:53:26,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-06-06 08:53:26,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-06-06 08:53:26,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-06-06 08:53:26,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-06-06 08:53:26,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-06-06 08:53:26,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-06-06 08:53:26,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-06-06 08:53:26,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-06-06 08:53:26,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-06-06 08:53:26,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-06-06 08:53:26,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-06-06 08:53:26,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-06-06 08:53:26,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-06-06 08:53:26,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-06-06 08:53:26,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-06-06 08:53:26,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-06-06 08:53:26,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-06-06 08:53:26,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-06-06 08:53:26,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-06-06 08:53:26,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-06-06 08:53:26,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-06-06 08:53:26,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-06-06 08:53:26,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-06-06 08:53:26,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-06-06 08:53:26,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-06-06 08:53:26,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-06-06 08:53:26,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-06-06 08:53:26,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-06-06 08:53:26,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-06-06 08:53:26,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-06-06 08:53:26,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-06-06 08:53:26,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-06-06 08:53:26,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-06-06 08:53:26,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-06-06 08:53:26,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-06-06 08:53:26,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-06-06 08:53:26,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-06-06 08:53:26,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-06-06 08:53:26,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-06-06 08:53:26,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-06-06 08:53:26,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-06-06 08:53:26,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-06-06 08:53:26,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-06-06 08:53:26,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-06-06 08:53:26,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-06-06 08:53:26,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-06-06 08:53:26,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-06-06 08:53:26,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-06-06 08:53:26,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-06-06 08:53:26,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-06-06 08:53:26,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-06-06 08:53:26,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-06-06 08:53:26,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-06-06 08:53:26,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-06-06 08:53:26,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-06-06 08:53:26,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-06-06 08:53:26,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-06-06 08:53:26,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-06-06 08:53:26,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-06-06 08:53:26,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-06-06 08:53:26,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-06-06 08:53:26,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-06-06 08:53:26,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-06-06 08:53:26,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-06-06 08:53:26,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-06-06 08:53:26,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-06-06 08:53:26,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-06-06 08:53:26,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-06-06 08:53:26,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-06-06 08:53:26,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-06-06 08:53:26,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-06-06 08:53:26,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-06-06 08:53:26,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-06-06 08:53:26,310 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.019824016869532182); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03237338281215884, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.019824016869532182); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0115); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04516666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-06-06 08:53:26,311 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-06-06 08:53:26,311 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.014660633678420788, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.019824016869532182); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03237338281215884, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.019824016869532182); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0115); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04516666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-06-06 08:53:26,567 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 370 ms to try 5000 different iterations.  Found a solution that moves 1011 regions; Going from a computed imbalance of 0.014660633678420788 to a new imbalance of 7.008111526483928E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006442160669684254); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008888888888888889); MoveCostFunction : (multiplier=7.0, imbalance=0.11233333333333333, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006442160669684254); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0035833333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-06-06 08:53:26,569 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1156363772:80 , srv1293068586:82 , srv539863997:82 , srv1202738944:83 , srv1354875913:83 , srv1358140724:83 , srv1358885320:83 , srv1790590003:83 , srv1999005261:83 , srv290375543:83 , srv352579354:83 , srv494854160:83 , srv969543998:83 , srv974782919:83 , srv1003413249:84 , srv124916237:84 , srv1270137378:84 , srv1288150606:84 , srv1345314549:84 , srv1361689495:84 , srv1363292937:84 , srv146472816:84 , srv1557564034:84 , srv184035776:84 , srv1884819110:84 , srv1961516968:84 , srv2140342374:84 , srv276947149:84 , srv622130346:84 , srv668655589:84 , srv727296575:84 , srv747427490:84 , srv829021266:84 , srv1229556977:85 , srv1453822736:85 , srv1470249648:85 , srv1681957682:85 , srv1794858086:85 , srv1806104207:85 , srv1905326230:85 , srv2054660140:85 , srv2059857268:85 , srv225589968:85 , srv235825327:85 , srv263072224:85 , srv373403493:85 , srv429607479:85 , srv434461584:85 , srv448230014:85 , srv554585789:85 , srv721541723:85 , srv90751534:85 , srv919148626:85 , srv1085299235:86 , srv11594084:86 , srv1159990755:86 , srv123613404:86 , srv13464797:86 , srv1477736799:86 , srv1490483860:86 , srv1711752447:86 , srv1720176110:86 , srv1829706189:86 , srv1941658159:86 , srv2019324906:86 , srv2057713889:86 , srv241637343:86 , srv330734731:86 , srv347300443:86 , srv402648216:86 , srv41030017:86 , srv606499608:86 , srv702223797:86 , srv804668101:86 , srv895344431:86 , srv985792094:86 , srv1013651395:87 , srv103007289:87 , srv1098610983:87 , srv1191095953:87 , srv1389538630:87 , srv1452801414:87 , srv1711923108:87 , srv1749714313:87 , srv1750284377:87 , srv1769720177:87 , srv1781070920:87 , srv1781647063:87 , srv1782504583:87 , srv1817544242:87 , srv1857435470:87 , srv1984145033:87 , srv2058511510:87 , srv246148354:87 , srv774084824:87 , srv95826760:87 , srv1077719315:88 , srv917104273:88 , srv930647353:88 , srv1896097710:565 }
2023-06-06 08:53:26,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-06-06 08:53:26,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1896097710=50, srv225589968=62, srv919148626=94, srv1288150606=15, srv1806104207=44, srv2140342374=61, srv1077719315=3, srv2019324906=56, srv1857435470=48, srv1749714313=36, srv90751534=92, srv1490483860=30, srv1941658159=52, srv246148354=65, srv290375543=68, srv622130346=82, srv930647353=95, srv969543998=97, srv1999005261=55, srv448230014=77, srv804668101=89, srv1794858086=43, srv1202738944=10, srv1781647063=40, srv1470249648=28, srv13464797=18, srv276947149=67, srv606499608=81, srv1961516968=53, srv1769720177=38, srv1477736799=29, srv1557564034=31, srv402648216=73, srv1720176110=35, srv1085299235=4, srv1781070920=39, srv330734731=69, srv263072224=66, srv1229556977=11, srv774084824=88, srv554585789=80, srv747427490=87, srv539863997=79, srv1345314549=17, srv124916237=13, srv2058511510=59, srv1358140724=20, srv2059857268=60, srv373403493=72, srv1293068586=16, srv727296575=86, srv95826760=96, srv1984145033=54, srv1098610983=5, srv1452801414=25, srv1829706189=46, srv721541723=85, srv1156363772=6, srv1711752447=33, srv1270137378=14, srv1711923108=34, srv1013651395=1, srv235825327=63, srv123613404=12, srv352579354=71, srv1782504583=41, srv985792094=99, srv347300443=70, srv974782919=98, srv103007289=2, srv434461584=76, srv494854160=78, srv668655589=83, srv1681957682=32, srv895344431=91, srv829021266=90, srv1817544242=45, srv1884819110=49, srv41030017=74, srv1790590003=42, srv241637343=64, srv146472816=27, srv1358885320=21, srv1003413249=0, srv1191095953=9, srv1354875913=19, srv429607479=75, srv2057713889=58, srv11594084=7, srv1453822736=26, srv1389538630=24, srv917104273=93, srv702223797=84, srv1159990755=8, srv1905326230=51, srv1750284377=37, srv1361689495=22, srv184035776=47, srv1363292937=23, srv2054660140=57} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-06-06 08:53:26,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-06-06 08:53:26,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-06-06 08:53:26,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-06-06 08:53:26,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-06-06 08:53:26,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-06-06 08:53:26,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-06-06 08:53:26,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-06-06 08:53:26,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-06-06 08:53:26,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-06-06 08:53:26,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-06-06 08:53:26,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-06-06 08:53:26,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-06-06 08:53:26,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-06-06 08:53:26,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-06-06 08:53:26,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-06-06 08:53:26,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-06-06 08:53:26,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-06-06 08:53:26,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-06-06 08:53:26,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-06-06 08:53:26,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-06-06 08:53:26,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-06-06 08:53:26,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-06-06 08:53:26,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-06-06 08:53:26,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-06-06 08:53:26,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-06-06 08:53:26,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-06-06 08:53:26,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-06-06 08:53:26,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-06-06 08:53:26,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-06-06 08:53:26,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-06-06 08:53:26,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-06-06 08:53:26,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-06-06 08:53:26,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-06-06 08:53:26,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-06-06 08:53:26,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-06-06 08:53:26,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-06-06 08:53:26,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-06-06 08:53:26,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-06-06 08:53:26,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-06-06 08:53:26,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-06-06 08:53:26,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-06-06 08:53:26,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-06-06 08:53:26,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-06-06 08:53:26,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-06-06 08:53:26,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-06-06 08:53:26,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-06-06 08:53:26,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-06-06 08:53:26,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-06-06 08:53:26,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-06-06 08:53:26,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-06-06 08:53:26,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-06-06 08:53:26,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-06-06 08:53:26,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-06-06 08:53:26,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-06-06 08:53:26,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-06-06 08:53:26,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-06-06 08:53:26,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-06-06 08:53:26,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-06-06 08:53:26,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-06-06 08:53:26,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-06-06 08:53:26,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-06-06 08:53:26,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-06-06 08:53:26,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-06-06 08:53:26,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-06-06 08:53:26,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-06-06 08:53:26,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-06-06 08:53:26,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-06-06 08:53:26,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-06-06 08:53:26,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-06-06 08:53:26,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-06-06 08:53:26,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-06-06 08:53:26,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-06-06 08:53:26,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-06-06 08:53:26,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-06-06 08:53:26,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-06-06 08:53:26,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-06-06 08:53:26,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-06-06 08:53:26,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-06-06 08:53:26,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-06-06 08:53:26,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-06-06 08:53:26,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-06-06 08:53:26,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-06-06 08:53:26,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-06-06 08:53:26,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-06-06 08:53:26,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-06-06 08:53:26,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-06-06 08:53:26,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-06-06 08:53:26,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-06-06 08:53:26,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-06-06 08:53:26,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-06-06 08:53:26,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-06-06 08:53:26,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-06-06 08:53:26,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-06-06 08:53:26,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-06-06 08:53:26,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-06-06 08:53:26,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-06-06 08:53:26,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-06-06 08:53:26,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-06-06 08:53:26,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-06-06 08:53:26,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-06-06 08:53:26,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-06-06 08:53:26,723 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006442160669684254); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008888888888888889); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006442160669684254); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0035833333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-06-06 08:53:26,723 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-06-06 08:53:26,723 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=6.937319793421877E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006442160669684254); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008888888888888889); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006442160669684254); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0035833333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-06-06 08:53:27,052 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 438 ms to try 5000 different iterations.  Found a solution that moves 267 regions; Going from a computed imbalance of 6.937319793421877E-4 to a new imbalance of 2.105496211766075E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.470732932414788E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002010075630518424); MoveCostFunction : (multiplier=7.0, imbalance=0.029666666666666668, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.470732932414788E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-06-06 08:53:27,052 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv103007289:83 , srv1270137378:83 , srv1782504583:83 , srv1790590003:83 , srv1857435470:83 , srv606499608:83 , srv90751534:83 , srv95826760:83 , srv1013651395:84 , srv1077719315:84 , srv1098610983:84 , srv1156363772:84 , srv1202738944:84 , srv123613404:84 , srv1345314549:84 , srv1361689495:84 , srv1389538630:84 , srv1452801414:84 , srv1453822736:84 , srv1557564034:84 , srv1681957682:84 , srv1711923108:84 , srv1720176110:84 , srv1749714313:84 , srv184035776:84 , srv1905326230:84 , srv1941658159:84 , srv1999005261:84 , srv2054660140:84 , srv2057713889:84 , srv225589968:84 , srv246148354:84 , srv263072224:84 , srv290375543:84 , srv347300443:84 , srv373403493:84 , srv434461584:84 , srv554585789:84 , srv702223797:84 , srv727296575:84 , srv747427490:84 , srv829021266:84 , srv917104273:84 , srv930647353:84 , srv1003413249:85 , srv1085299235:85 , srv11594084:85 , srv1159990755:85 , srv1229556977:85 , srv1293068586:85 , srv13464797:85 , srv1354875913:85 , srv1358140724:85 , srv1358885320:85 , srv1363292937:85 , srv146472816:85 , srv1477736799:85 , srv1490483860:85 , srv1711752447:85 , srv1750284377:85 , srv1769720177:85 , srv1781070920:85 , srv1781647063:85 , srv1806104207:85 , srv1817544242:85 , srv1829706189:85 , srv1961516968:85 , srv1984145033:85 , srv2019324906:85 , srv2058511510:85 , srv2059857268:85 , srv2140342374:85 , srv241637343:85 , srv330734731:85 , srv402648216:85 , srv41030017:85 , srv429607479:85 , srv448230014:85 , srv494854160:85 , srv539863997:85 , srv622130346:85 , srv668655589:85 , srv721541723:85 , srv774084824:85 , srv804668101:85 , srv895344431:85 , srv919148626:85 , srv974782919:85 , srv1191095953:86 , srv124916237:86 , srv1288150606:86 , srv1470249648:86 , srv1794858086:86 , srv1884819110:86 , srv235825327:86 , srv276947149:86 , srv352579354:86 , srv969543998:86 , srv985792094:86 , srv1896097710:626 }
2023-06-06 08:53:27,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-06-06 08:53:27,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1896097710=50, srv225589968=62, srv919148626=94, srv1288150606=15, srv1806104207=44, srv2140342374=61, srv1077719315=3, srv2019324906=56, srv1857435470=48, srv1749714313=36, srv90751534=92, srv1490483860=30, srv1941658159=52, srv246148354=65, srv290375543=68, srv622130346=82, srv930647353=95, srv969543998=97, srv1999005261=55, srv448230014=77, srv804668101=89, srv1794858086=43, srv1202738944=10, srv1781647063=40, srv1470249648=28, srv13464797=18, srv276947149=67, srv606499608=81, srv1961516968=53, srv1769720177=38, srv1477736799=29, srv1557564034=31, srv402648216=73, srv1720176110=35, srv1085299235=4, srv1781070920=39, srv330734731=69, srv263072224=66, srv1229556977=11, srv774084824=88, srv554585789=80, srv747427490=87, srv539863997=79, srv1345314549=17, srv124916237=13, srv2058511510=59, srv1358140724=20, srv2059857268=60, srv373403493=72, srv1293068586=16, srv727296575=86, srv95826760=96, srv1984145033=54, srv1098610983=5, srv1452801414=25, srv1829706189=46, srv721541723=85, srv1156363772=6, srv1711752447=33, srv1270137378=14, srv1711923108=34, srv1013651395=1, srv235825327=63, srv123613404=12, srv352579354=71, srv1782504583=41, srv985792094=99, srv347300443=70, srv974782919=98, srv103007289=2, srv434461584=76, srv494854160=78, srv668655589=83, srv1681957682=32, srv895344431=91, srv829021266=90, srv1817544242=45, srv1884819110=49, srv41030017=74, srv1790590003=42, srv241637343=64, srv146472816=27, srv1358885320=21, srv1003413249=0, srv1191095953=9, srv1354875913=19, srv429607479=75, srv2057713889=58, srv11594084=7, srv1453822736=26, srv1389538630=24, srv917104273=93, srv702223797=84, srv1159990755=8, srv1905326230=51, srv1750284377=37, srv1361689495=22, srv184035776=47, srv1363292937=23, srv2054660140=57} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-06-06 08:53:27,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-06-06 08:53:27,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-06-06 08:53:27,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-06-06 08:53:27,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-06-06 08:53:27,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-06-06 08:53:27,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-06-06 08:53:27,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-06-06 08:53:27,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-06-06 08:53:27,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-06-06 08:53:27,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-06-06 08:53:27,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-06-06 08:53:27,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-06-06 08:53:27,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-06-06 08:53:27,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-06-06 08:53:27,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-06-06 08:53:27,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-06-06 08:53:27,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-06-06 08:53:27,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-06-06 08:53:27,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-06-06 08:53:27,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-06-06 08:53:27,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-06-06 08:53:27,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-06-06 08:53:27,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-06-06 08:53:27,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-06-06 08:53:27,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-06-06 08:53:27,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-06-06 08:53:27,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-06-06 08:53:27,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-06-06 08:53:27,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-06-06 08:53:27,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-06-06 08:53:27,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-06-06 08:53:27,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-06-06 08:53:27,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-06-06 08:53:27,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-06-06 08:53:27,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-06-06 08:53:27,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-06-06 08:53:27,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-06-06 08:53:27,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-06-06 08:53:27,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-06-06 08:53:27,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-06-06 08:53:27,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-06-06 08:53:27,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-06-06 08:53:27,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-06-06 08:53:27,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-06-06 08:53:27,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-06-06 08:53:27,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-06-06 08:53:27,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-06-06 08:53:27,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-06-06 08:53:27,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-06-06 08:53:27,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-06-06 08:53:27,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-06-06 08:53:27,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-06-06 08:53:27,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-06-06 08:53:27,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-06-06 08:53:27,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-06-06 08:53:27,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-06-06 08:53:27,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-06-06 08:53:27,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-06-06 08:53:27,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-06-06 08:53:27,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-06-06 08:53:27,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-06-06 08:53:27,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-06-06 08:53:27,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-06-06 08:53:27,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-06-06 08:53:27,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-06-06 08:53:27,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-06-06 08:53:27,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-06-06 08:53:27,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-06-06 08:53:27,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-06-06 08:53:27,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-06-06 08:53:27,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-06-06 08:53:27,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-06-06 08:53:27,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-06-06 08:53:27,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-06-06 08:53:27,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-06-06 08:53:27,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-06-06 08:53:27,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-06-06 08:53:27,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-06-06 08:53:27,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-06-06 08:53:27,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-06-06 08:53:27,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-06-06 08:53:27,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-06-06 08:53:27,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-06-06 08:53:27,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-06-06 08:53:27,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-06-06 08:53:27,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-06-06 08:53:27,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-06-06 08:53:27,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-06-06 08:53:27,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-06-06 08:53:27,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-06-06 08:53:27,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-06-06 08:53:27,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-06-06 08:53:27,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-06-06 08:53:27,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-06-06 08:53:27,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-06-06 08:53:27,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-06-06 08:53:27,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-06-06 08:53:27,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-06-06 08:53:27,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-06-06 08:53:27,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-06-06 08:53:27,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-06-06 08:53:27,183 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=1.9185388158455275E-5 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.470732932414788E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002010075630518424); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.470732932414788E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-06-06 08:53:27,183 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv103007289:83 , srv1270137378:83 , srv1782504583:83 , srv1790590003:83 , srv1857435470:83 , srv606499608:83 , srv90751534:83 , srv95826760:83 , srv1013651395:84 , srv1077719315:84 , srv1098610983:84 , srv1156363772:84 , srv1202738944:84 , srv123613404:84 , srv1345314549:84 , srv1361689495:84 , srv1389538630:84 , srv1452801414:84 , srv1453822736:84 , srv1557564034:84 , srv1681957682:84 , srv1711923108:84 , srv1720176110:84 , srv1749714313:84 , srv184035776:84 , srv1905326230:84 , srv1941658159:84 , srv1999005261:84 , srv2054660140:84 , srv2057713889:84 , srv225589968:84 , srv246148354:84 , srv263072224:84 , srv290375543:84 , srv347300443:84 , srv373403493:84 , srv434461584:84 , srv554585789:84 , srv702223797:84 , srv727296575:84 , srv747427490:84 , srv829021266:84 , srv917104273:84 , srv930647353:84 , srv1003413249:85 , srv1085299235:85 , srv11594084:85 , srv1159990755:85 , srv1229556977:85 , srv1293068586:85 , srv13464797:85 , srv1354875913:85 , srv1358140724:85 , srv1358885320:85 , srv1363292937:85 , srv146472816:85 , srv1477736799:85 , srv1490483860:85 , srv1711752447:85 , srv1750284377:85 , srv1769720177:85 , srv1781070920:85 , srv1781647063:85 , srv1806104207:85 , srv1817544242:85 , srv1829706189:85 , srv1961516968:85 , srv1984145033:85 , srv2019324906:85 , srv2058511510:85 , srv2059857268:85 , srv2140342374:85 , srv241637343:85 , srv330734731:85 , srv402648216:85 , srv41030017:85 , srv429607479:85 , srv448230014:85 , srv494854160:85 , srv539863997:85 , srv622130346:85 , srv668655589:85 , srv721541723:85 , srv774084824:85 , srv804668101:85 , srv895344431:85 , srv919148626:85 , srv974782919:85 , srv1191095953:86 , srv124916237:86 , srv1288150606:86 , srv1470249648:86 , srv1794858086:86 , srv1884819110:86 , srv235825327:86 , srv276947149:86 , srv352579354:86 , srv969543998:86 , srv985792094:86 , srv1896097710:626 }
2023-06-06 08:53:27,211 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=376 (was 400), ProcessCount=176 (was 177), AvailableMemoryMB=7718 (was 8210)
2023-06-06 08:53:27,219 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=376, ProcessCount=176, AvailableMemoryMB=7718
2023-06-06 08:53:27,220 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-06-06 08:53:27,220 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-06-06 08:53:27,228 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1024224376:84 , srv1064699163:84 , srv123847587:84 , srv1380647318:84 , srv1490925293:84 , srv1547235554:84 , srv1586093522:84 , srv1632198745:84 , srv1680277558:84 , srv1688875619:84 , srv1762166359:84 , srv1768083962:84 , srv179418694:84 , srv1813682956:84 , srv1911051038:84 , srv1932033405:84 , srv1936233493:84 , srv1947526832:84 , srv2139408346:84 , srv339359337:84 , srv520010373:84 , srv642425932:84 , srv650278008:84 , srv658569815:84 , srv847838096:84 , srv905285684:84 , srv946532130:84 , srv952681107:84 , srv966807500:84 , srv1893481962:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-06-06 08:53:27,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-06-06 08:53:27,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1064699163=1, srv123847587=2, srv1490925293=4, srv658569815=24, srv1380647318=3, srv1688875619=9, srv1911051038=15, srv952681107=28, srv1947526832=18, srv1762166359=10, srv650278008=23, srv905285684=26, srv1586093522=6, srv179418694=12, srv1547235554=5, srv847838096=25, srv1813682956=13, srv1024224376=0, srv1680277558=8, srv1768083962=11, srv966807500=29, srv642425932=22, srv1936233493=17, srv1632198745=7, srv339359337=20, srv1893481962=14, srv1932033405=16, srv2139408346=19, srv520010373=21, srv946532130=27} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-06-06 08:53:27,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-06-06 08:53:27,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-06-06 08:53:27,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-06-06 08:53:27,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-06-06 08:53:27,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-06-06 08:53:27,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-06-06 08:53:27,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-06-06 08:53:27,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-06-06 08:53:27,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-06-06 08:53:27,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-06-06 08:53:27,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-06-06 08:53:27,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-06-06 08:53:27,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-06-06 08:53:27,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-06-06 08:53:27,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-06-06 08:53:27,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-06-06 08:53:27,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-06-06 08:53:27,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-06-06 08:53:27,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-06-06 08:53:27,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-06-06 08:53:27,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-06-06 08:53:27,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-06-06 08:53:27,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-06-06 08:53:27,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-06-06 08:53:27,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-06-06 08:53:27,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-06-06 08:53:27,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-06-06 08:53:27,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-06-06 08:53:27,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-06-06 08:53:27,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-06-06 08:53:27,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-06-06 08:53:27,255 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1152068127259516, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-06-06 08:53:27,255 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.991255605616933, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1152068127259516, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-06-06 08:55:27,243 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5939048 different iterations.  Found a solution that moves 1851 regions; Going from a computed imbalance of 0.991255605616933 to a new imbalance of 4.320326340186438E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6855555555555556, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-06-06 08:55:27,248 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1024224376:90 , srv1064699163:90 , srv123847587:90 , srv1380647318:90 , srv1490925293:90 , srv1547235554:90 , srv1586093522:90 , srv1632198745:90 , srv1680277558:90 , srv1688875619:90 , srv1762166359:90 , srv1768083962:90 , srv179418694:90 , srv1813682956:90 , srv1893481962:90 , srv1911051038:90 , srv1932033405:90 , srv1936233493:90 , srv1947526832:90 , srv2139408346:90 , srv339359337:90 , srv520010373:90 , srv642425932:90 , srv650278008:90 , srv658569815:90 , srv847838096:90 , srv905285684:90 , srv946532130:90 , srv952681107:90 , srv966807500:90 }
2023-06-06 08:55:27,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-06-06 08:55:27,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1064699163=1, srv123847587=2, srv1490925293=4, srv658569815=24, srv1380647318=3, srv1688875619=9, srv1911051038=15, srv952681107=28, srv1947526832=18, srv1762166359=10, srv650278008=23, srv905285684=26, srv1586093522=6, srv179418694=12, srv1547235554=5, srv847838096=25, srv1813682956=13, srv1024224376=0, srv1680277558=8, srv1768083962=11, srv966807500=29, srv642425932=22, srv1936233493=17, srv1632198745=7, srv339359337=20, srv1893481962=14, srv1932033405=16, srv2139408346=19, srv520010373=21, srv946532130=27} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-06-06 08:55:27,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-06-06 08:55:27,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-06-06 08:55:27,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-06-06 08:55:27,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-06-06 08:55:27,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-06-06 08:55:27,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-06-06 08:55:27,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-06-06 08:55:27,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-06-06 08:55:27,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-06-06 08:55:27,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-06-06 08:55:27,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-06-06 08:55:27,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-06-06 08:55:27,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-06-06 08:55:27,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-06-06 08:55:27,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-06-06 08:55:27,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-06-06 08:55:27,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-06-06 08:55:27,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-06-06 08:55:27,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-06-06 08:55:27,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-06-06 08:55:27,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-06-06 08:55:27,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-06-06 08:55:27,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-06-06 08:55:27,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-06-06 08:55:27,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-06-06 08:55:27,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-06-06 08:55:27,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-06-06 08:55:27,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-06-06 08:55:27,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-06-06 08:55:27,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-06-06 08:55:27,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-06-06 08:55:27,266 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-06-06 08:55:27,266 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1024224376:90 , srv1064699163:90 , srv123847587:90 , srv1380647318:90 , srv1490925293:90 , srv1547235554:90 , srv1586093522:90 , srv1632198745:90 , srv1680277558:90 , srv1688875619:90 , srv1762166359:90 , srv1768083962:90 , srv179418694:90 , srv1813682956:90 , srv1893481962:90 , srv1911051038:90 , srv1932033405:90 , srv1936233493:90 , srv1947526832:90 , srv2139408346:90 , srv339359337:90 , srv520010373:90 , srv642425932:90 , srv650278008:90 , srv658569815:90 , srv847838096:90 , srv905285684:90 , srv946532130:90 , srv952681107:90 , srv966807500:90 }
2023-06-06 08:55:27,278 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=237 (was 376), ProcessCount=175 (was 176), AvailableMemoryMB=6915 (was 7718)