2023-05-22 19:53:30,555 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-05-22 19:53:30,874 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-05-22 19:53:30,994 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-05-22 19:53:31,059 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-05-22 19:53:31,067 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-05-22 19:53:31,081 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=264, MaxFileDescriptor=60000, SystemLoadAverage=346, ProcessCount=171, AvailableMemoryMB=7121
2023-05-22 19:53:31,083 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-05-22 19:53:31,083 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-05-22 19:53:31,229 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1004188480:84 , srv100446692:84 , srv1013285414:84 , srv1039614335:84 , srv1042081435:84 , srv1045800652:84 , srv1062428957:84 , srv1068819201:84 , srv1116675563:84 , srv1124199654:84 , srv1173640153:84 , srv1185481624:84 , srv1196220834:84 , srv1208155525:84 , srv1210077091:84 , srv1265684762:84 , srv1289570793:84 , srv1300516712:84 , srv1354745123:84 , srv1371551375:84 , srv1401882079:84 , srv1441674155:84 , srv1445114021:84 , srv1456839229:84 , srv1479759049:84 , srv1524564205:84 , srv1525698761:84 , srv1545741294:84 , srv1570194768:84 , srv1572378792:84 , srv1574074164:84 , srv1662329889:84 , srv1669141716:84 , srv1684081372:84 , srv1739212385:84 , srv1739881361:84 , srv1759523425:84 , srv1778708587:84 , srv1781995815:84 , srv1840868226:84 , srv1856023238:84 , srv18734674:84 , srv18746786:84 , srv1897237659:84 , srv1918777431:84 , srv1920849568:84 , srv1969431433:84 , srv1997282464:84 , srv2040839032:84 , srv205184136:84 , srv2054814435:84 , srv2066352380:84 , srv2108587634:84 , srv2117294534:84 , srv2124086762:84 , srv213009571:84 , srv290367846:84 , srv295113864:84 , srv306481523:84 , srv317427321:84 , srv340977893:84 , srv354888955:84 , srv367743896:84 , srv378858914:84 , srv421807457:84 , srv427618322:84 , srv440784613:84 , srv443524376:84 , srv44656298:84 , srv480563559:84 , srv481077046:84 , srv483632834:84 , srv484251424:84 , srv493114133:84 , srv511733959:84 , srv517599183:84 , srv526689943:84 , srv540314389:84 , srv573421179:84 , srv574170007:84 , srv576763222:84 , srv69013667:84 , srv71676153:84 , srv743762440:84 , srv755734925:84 , srv783272249:84 , srv797834380:84 , srv830334484:84 , srv843469379:84 , srv850444303:84 , srv857367431:84 , srv879139270:84 , srv889482722:84 , srv893721100:84 , srv940897798:84 , srv97508840:84 , srv979025470:84 , srv980167378:84 , srv983734159:84 , srv1664102820:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-05-22 19:53:31,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-22 19:53:31,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1997282464=48, srv573421179=79, srv983734159=99, srv755734925=85, srv317427321=60, srv893721100=94, srv1856023238=41, srv340977893=61, srv979025470=97, srv1570194768=28, srv1116675563=8, srv1371551375=19, srv1300516712=17, srv1684081372=34, srv1456839229=23, srv2108587634=53, srv295113864=58, srv205184136=50, srv69013667=82, srv1042081435=4, srv1574074164=30, srv511733959=75, srv44656298=69, srv1525698761=26, srv2066352380=52, srv481077046=71, srv1196220834=12, srv1918777431=45, srv484251424=73, srv1664102820=32, srv743762440=84, srv1781995815=39, srv526689943=77, srv440784613=67, srv850444303=90, srv1265684762=15, srv306481523=59, srv367743896=63, srv443524376=68, srv1441674155=21, srv1739212385=35, srv1739881361=36, srv1185481624=11, srv1208155525=13, srv2054814435=51, srv1840868226=40, srv1401882079=20, srv1662329889=31, srv940897798=95, srv1210077091=14, srv2117294534=54, srv1669141716=33, srv1289570793=16, srv576763222=81, srv857367431=91, srv427618322=66, srv517599183=76, srv1068819201=7, srv71676153=83, srv1124199654=9, srv1524564205=25, srv354888955=62, srv1062428957=6, srv1545741294=27, srv980167378=98, srv783272249=86, srv1479759049=24, srv18734674=42, srv1920849568=46, srv483632834=72, srv1572378792=29, srv1173640153=10, srv797834380=87, srv1969431433=47, srv1354745123=18, srv493114133=74, srv290367846=57, srv1897237659=44, srv843469379=89, srv1045800652=5, srv213009571=56, srv1039614335=3, srv1759523425=37, srv2040839032=49, srv889482722=93, srv1445114021=22, srv2124086762=55, srv540314389=78, srv100446692=1, srv574170007=80, srv1778708587=38, srv480563559=70, srv97508840=96, srv421807457=65, srv378858914=64, srv830334484=88, srv879139270=92, srv18746786=43, srv1004188480=0, srv1013285414=2} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-22 19:53:31,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-22 19:53:31,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-22 19:53:31,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-22 19:53:31,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-22 19:53:31,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-22 19:53:31,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-22 19:53:31,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-22 19:53:31,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-22 19:53:31,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-22 19:53:31,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-22 19:53:31,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-22 19:53:31,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-22 19:53:31,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-22 19:53:31,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-22 19:53:31,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-22 19:53:31,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-22 19:53:31,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-22 19:53:31,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-22 19:53:31,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-22 19:53:31,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-22 19:53:31,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-22 19:53:31,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-22 19:53:31,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-22 19:53:31,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-22 19:53:31,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-22 19:53:31,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-22 19:53:31,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-22 19:53:31,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-22 19:53:31,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-22 19:53:31,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-22 19:53:31,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-22 19:53:31,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-22 19:53:31,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-22 19:53:31,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-22 19:53:31,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-22 19:53:31,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-22 19:53:31,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-22 19:53:31,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-22 19:53:31,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-22 19:53:31,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-22 19:53:31,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-22 19:53:31,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-22 19:53:31,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-22 19:53:31,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-22 19:53:31,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-22 19:53:31,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-22 19:53:31,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-22 19:53:31,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-22 19:53:31,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-22 19:53:31,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-22 19:53:31,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-22 19:53:31,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-22 19:53:31,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-22 19:53:31,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-22 19:53:31,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-22 19:53:31,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-22 19:53:31,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-22 19:53:31,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-22 19:53:31,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-22 19:53:31,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-22 19:53:31,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-22 19:53:31,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-22 19:53:31,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-22 19:53:31,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-22 19:53:31,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-22 19:53:31,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-22 19:53:31,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-22 19:53:31,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-22 19:53:31,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-22 19:53:31,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-22 19:53:31,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-22 19:53:31,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-22 19:53:31,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-22 19:53:31,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-22 19:53:31,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-22 19:53:31,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-22 19:53:31,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-22 19:53:31,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-22 19:53:31,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-22 19:53:31,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-22 19:53:31,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-22 19:53:31,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-22 19:53:31,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-22 19:53:31,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-22 19:53:31,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-22 19:53:31,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-22 19:53:31,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-22 19:53:31,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-22 19:53:31,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-22 19:53:31,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-22 19:53:31,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-22 19:53:31,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-22 19:53:31,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-22 19:53:31,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-22 19:53:31,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-22 19:53:31,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-22 19:53:31,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-22 19:53:31,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-22 19:53:31,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-22 19:53:31,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-22 19:53:31,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-22 19:53:31,554 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-22 19:53:31,555 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-22 19:53:31,555 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-22 19:53:31,851 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 456 ms to try 5000 different iterations.  Found a solution that moves 4650 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.1856500726072193. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04053452555003302, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05563428764566532, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5166666666666667, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04053452555003302, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.18075, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24933333333333332, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-22 19:53:31,871 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1039614335:80 , srv1068819201:81 , srv44656298:81 , srv1759523425:82 , srv421807457:82 , srv1289570793:83 , srv1441674155:83 , srv1684081372:83 , srv1997282464:83 , srv205184136:83 , srv2108587634:83 , srv213009571:83 , srv354888955:83 , srv427618322:83 , srv526689943:83 , srv1013285414:84 , srv1300516712:84 , srv1445114021:84 , srv1456839229:84 , srv1669141716:84 , srv1778708587:84 , srv1969431433:84 , srv290367846:84 , srv440784613:84 , srv493114133:84 , srv517599183:84 , srv71676153:84 , srv755734925:84 , srv983734159:84 , srv1042081435:85 , srv1045800652:85 , srv1185481624:85 , srv1265684762:85 , srv1545741294:85 , srv1574074164:85 , srv18746786:85 , srv1920849568:85 , srv484251424:85 , srv540314389:85 , srv573421179:85 , srv889482722:85 , srv979025470:85 , srv980167378:85 , srv100446692:86 , srv1124199654:86 , srv1210077091:86 , srv1524564205:86 , srv1662329889:86 , srv1739881361:86 , srv1897237659:86 , srv2054814435:86 , srv295113864:86 , srv481077046:86 , srv940897798:86 , srv1196220834:87 , srv1354745123:87 , srv1401882079:87 , srv1479759049:87 , srv1525698761:87 , srv1572378792:87 , srv1918777431:87 , srv2040839032:87 , srv340977893:87 , srv480563559:87 , srv483632834:87 , srv830334484:87 , srv879139270:87 , srv1004188480:88 , srv1062428957:88 , srv1173640153:88 , srv1781995815:88 , srv1856023238:88 , srv2066352380:88 , srv2117294534:88 , srv306481523:88 , srv367743896:88 , srv511733959:88 , srv576763222:88 , srv783272249:88 , srv97508840:88 , srv1371551375:89 , srv18734674:89 , srv69013667:89 , srv797834380:89 , srv843469379:89 , srv850444303:89 , srv1840868226:90 , srv317427321:90 , srv574170007:90 , srv743762440:90 , srv1739212385:91 , srv893721100:91 , srv1208155525:92 , srv1570194768:92 , srv2124086762:92 , srv378858914:93 , srv1116675563:94 , srv443524376:94 , srv857367431:94 , srv1664102820:450 }
2023-05-22 19:53:31,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-22 19:53:31,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1997282464=48, srv573421179=79, srv983734159=99, srv755734925=85, srv317427321=60, srv893721100=94, srv1856023238=41, srv340977893=61, srv979025470=97, srv1570194768=28, srv1116675563=8, srv1371551375=19, srv1300516712=17, srv1684081372=34, srv1456839229=23, srv2108587634=53, srv295113864=58, srv205184136=50, srv69013667=82, srv1042081435=4, srv1574074164=30, srv511733959=75, srv44656298=69, srv1525698761=26, srv2066352380=52, srv481077046=71, srv1196220834=12, srv1918777431=45, srv484251424=73, srv1664102820=32, srv743762440=84, srv1781995815=39, srv526689943=77, srv440784613=67, srv850444303=90, srv1265684762=15, srv306481523=59, srv367743896=63, srv443524376=68, srv1441674155=21, srv1739212385=35, srv1739881361=36, srv1185481624=11, srv1208155525=13, srv2054814435=51, srv1840868226=40, srv1401882079=20, srv1662329889=31, srv940897798=95, srv1210077091=14, srv2117294534=54, srv1669141716=33, srv1289570793=16, srv576763222=81, srv857367431=91, srv427618322=66, srv517599183=76, srv1068819201=7, srv71676153=83, srv1124199654=9, srv1524564205=25, srv354888955=62, srv1062428957=6, srv1545741294=27, srv980167378=98, srv783272249=86, srv1479759049=24, srv18734674=42, srv1920849568=46, srv483632834=72, srv1572378792=29, srv1173640153=10, srv797834380=87, srv1969431433=47, srv1354745123=18, srv493114133=74, srv290367846=57, srv1897237659=44, srv843469379=89, srv1045800652=5, srv213009571=56, srv1039614335=3, srv1759523425=37, srv2040839032=49, srv889482722=93, srv1445114021=22, srv2124086762=55, srv540314389=78, srv100446692=1, srv574170007=80, srv1778708587=38, srv480563559=70, srv97508840=96, srv421807457=65, srv378858914=64, srv830334484=88, srv879139270=92, srv18746786=43, srv1004188480=0, srv1013285414=2} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-22 19:53:31,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-22 19:53:31,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-22 19:53:31,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-22 19:53:31,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-22 19:53:31,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-22 19:53:31,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-22 19:53:31,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-22 19:53:31,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-22 19:53:31,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-22 19:53:31,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-22 19:53:31,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-22 19:53:31,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-22 19:53:31,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-22 19:53:31,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-22 19:53:31,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-22 19:53:31,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-22 19:53:31,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-22 19:53:31,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-22 19:53:31,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-22 19:53:31,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-22 19:53:31,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-22 19:53:31,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-22 19:53:31,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-22 19:53:31,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-22 19:53:31,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-22 19:53:31,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-22 19:53:31,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-22 19:53:31,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-22 19:53:31,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-22 19:53:31,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-22 19:53:31,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-22 19:53:31,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-22 19:53:31,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-22 19:53:31,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-22 19:53:31,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-22 19:53:31,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-22 19:53:31,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-22 19:53:31,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-22 19:53:31,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-22 19:53:31,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-22 19:53:31,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-22 19:53:31,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-22 19:53:31,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-22 19:53:31,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-22 19:53:31,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-22 19:53:31,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-22 19:53:31,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-22 19:53:31,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-22 19:53:31,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-22 19:53:31,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-22 19:53:31,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-22 19:53:31,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-22 19:53:31,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-22 19:53:31,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-22 19:53:31,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-22 19:53:31,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-22 19:53:31,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-22 19:53:31,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-22 19:53:31,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-22 19:53:31,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-22 19:53:31,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-22 19:53:31,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-22 19:53:31,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-22 19:53:31,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-22 19:53:31,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-22 19:53:31,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-22 19:53:31,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-22 19:53:31,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-22 19:53:31,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-22 19:53:31,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-22 19:53:31,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-22 19:53:31,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-22 19:53:31,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-22 19:53:31,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-22 19:53:31,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-22 19:53:31,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-22 19:53:31,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-22 19:53:31,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-22 19:53:31,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-22 19:53:31,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-22 19:53:31,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-22 19:53:31,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-22 19:53:31,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-22 19:53:31,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-22 19:53:31,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-22 19:53:31,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-22 19:53:31,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-22 19:53:31,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-22 19:53:31,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-22 19:53:31,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-22 19:53:31,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-22 19:53:31,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-22 19:53:31,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-22 19:53:31,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-22 19:53:31,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-22 19:53:31,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-22 19:53:31,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-22 19:53:31,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-22 19:53:31,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-22 19:53:31,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-22 19:53:31,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-22 19:53:32,092 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04053452555003302, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05563428764566532, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04053452555003302, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.18075, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24933333333333332, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-22 19:53:32,092 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-22 19:53:32,093 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18561751261130058, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04053452555003302, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05563428764566532, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04053452555003302, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.18075, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24933333333333332, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-22 19:53:32,494 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 561 ms to try 5000 different iterations.  Found a solution that moves 2656 regions; Going from a computed imbalance of 0.18561751261130058 to a new imbalance of 0.01791661354243142. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023407769677118204); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03773616246190503, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2951111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023407769677118204); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.014583333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.049833333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-22 19:53:32,508 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1116675563:79 , srv443524376:79 , srv574170007:79 , srv1208155525:80 , srv857367431:80 , srv1840868226:81 , srv2124086762:81 , srv378858914:81 , srv797834380:81 , srv893721100:81 , srv1062428957:82 , srv1371551375:82 , srv1570194768:82 , srv850444303:82 , srv1004188480:83 , srv1173640153:83 , srv1196220834:83 , srv1354745123:83 , srv1739212385:83 , srv2117294534:83 , srv317427321:83 , srv480563559:83 , srv511733959:83 , srv576763222:83 , srv69013667:83 , srv843469379:83 , srv1045800652:84 , srv1897237659:84 , srv1918777431:84 , srv483632834:84 , srv97508840:84 , srv100446692:85 , srv1124199654:85 , srv1401882079:85 , srv1545741294:85 , srv1572378792:85 , srv1662329889:85 , srv1781995815:85 , srv1856023238:85 , srv18734674:85 , srv2040839032:85 , srv2066352380:85 , srv295113864:85 , srv367743896:85 , srv481077046:85 , srv743762440:85 , srv879139270:85 , srv940897798:85 , srv979025470:85 , srv980167378:85 , srv1185481624:86 , srv1210077091:86 , srv1265684762:86 , srv1300516712:86 , srv1739881361:86 , srv1778708587:86 , srv18746786:86 , srv1920849568:86 , srv290367846:86 , srv340977893:86 , srv517599183:86 , srv783272249:86 , srv830334484:86 , srv889482722:86 , srv1441674155:87 , srv1456839229:87 , srv1479759049:87 , srv1684081372:87 , srv205184136:87 , srv2108587634:87 , srv306481523:87 , srv484251424:87 , srv540314389:87 , srv983734159:87 , srv1013285414:88 , srv1289570793:88 , srv1445114021:88 , srv1524564205:88 , srv1574074164:88 , srv2054814435:88 , srv427618322:88 , srv573421179:88 , srv1969431433:89 , srv1997282464:89 , srv354888955:89 , srv440784613:89 , srv493114133:89 , srv755734925:89 , srv1039614335:90 , srv1042081435:90 , srv1525698761:90 , srv1669141716:90 , srv1759523425:90 , srv213009571:90 , srv44656298:90 , srv526689943:90 , srv71676153:90 , srv421807457:92 , srv1068819201:93 , srv1664102820:532 }
2023-05-22 19:53:32,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-22 19:53:32,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1997282464=48, srv573421179=79, srv983734159=99, srv755734925=85, srv317427321=60, srv893721100=94, srv1856023238=41, srv340977893=61, srv979025470=97, srv1570194768=28, srv1116675563=8, srv1371551375=19, srv1300516712=17, srv1684081372=34, srv1456839229=23, srv2108587634=53, srv295113864=58, srv205184136=50, srv69013667=82, srv1042081435=4, srv1574074164=30, srv511733959=75, srv44656298=69, srv1525698761=26, srv2066352380=52, srv481077046=71, srv1196220834=12, srv1918777431=45, srv484251424=73, srv1664102820=32, srv743762440=84, srv1781995815=39, srv526689943=77, srv440784613=67, srv850444303=90, srv1265684762=15, srv306481523=59, srv367743896=63, srv443524376=68, srv1441674155=21, srv1739212385=35, srv1739881361=36, srv1185481624=11, srv1208155525=13, srv2054814435=51, srv1840868226=40, srv1401882079=20, srv1662329889=31, srv940897798=95, srv1210077091=14, srv2117294534=54, srv1669141716=33, srv1289570793=16, srv576763222=81, srv857367431=91, srv427618322=66, srv517599183=76, srv1068819201=7, srv71676153=83, srv1124199654=9, srv1524564205=25, srv354888955=62, srv1062428957=6, srv1545741294=27, srv980167378=98, srv783272249=86, srv1479759049=24, srv18734674=42, srv1920849568=46, srv483632834=72, srv1572378792=29, srv1173640153=10, srv797834380=87, srv1969431433=47, srv1354745123=18, srv493114133=74, srv290367846=57, srv1897237659=44, srv843469379=89, srv1045800652=5, srv213009571=56, srv1039614335=3, srv1759523425=37, srv2040839032=49, srv889482722=93, srv1445114021=22, srv2124086762=55, srv540314389=78, srv100446692=1, srv574170007=80, srv1778708587=38, srv480563559=70, srv97508840=96, srv421807457=65, srv378858914=64, srv830334484=88, srv879139270=92, srv18746786=43, srv1004188480=0, srv1013285414=2} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-22 19:53:32,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-22 19:53:32,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-22 19:53:32,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-22 19:53:32,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-22 19:53:32,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-22 19:53:32,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-22 19:53:32,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-22 19:53:32,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-22 19:53:32,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-22 19:53:32,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-22 19:53:32,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-22 19:53:32,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-22 19:53:32,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-22 19:53:32,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-22 19:53:32,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-22 19:53:32,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-22 19:53:32,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-22 19:53:32,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-22 19:53:32,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-22 19:53:32,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-22 19:53:32,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-22 19:53:32,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-22 19:53:32,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-22 19:53:32,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-22 19:53:32,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-22 19:53:32,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-22 19:53:32,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-22 19:53:32,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-22 19:53:32,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-22 19:53:32,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-22 19:53:32,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-22 19:53:32,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-22 19:53:32,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-22 19:53:32,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-22 19:53:32,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-22 19:53:32,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-22 19:53:32,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-22 19:53:32,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-22 19:53:32,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-22 19:53:32,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-22 19:53:32,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-22 19:53:32,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-22 19:53:32,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-22 19:53:32,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-22 19:53:32,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-22 19:53:32,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-22 19:53:32,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-22 19:53:32,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-22 19:53:32,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-22 19:53:32,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-22 19:53:32,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-22 19:53:32,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-22 19:53:32,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-22 19:53:32,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-22 19:53:32,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-22 19:53:32,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-22 19:53:32,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-22 19:53:32,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-22 19:53:32,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-22 19:53:32,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-22 19:53:32,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-22 19:53:32,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-22 19:53:32,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-22 19:53:32,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-22 19:53:32,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-22 19:53:32,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-22 19:53:32,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-22 19:53:32,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-22 19:53:32,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-22 19:53:32,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-22 19:53:32,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-22 19:53:32,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-22 19:53:32,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-22 19:53:32,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-22 19:53:32,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-22 19:53:32,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-22 19:53:32,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-22 19:53:32,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-22 19:53:32,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-22 19:53:32,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-22 19:53:32,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-22 19:53:32,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-22 19:53:32,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-22 19:53:32,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-22 19:53:32,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-22 19:53:32,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-22 19:53:32,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-22 19:53:32,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-22 19:53:32,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-22 19:53:32,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-22 19:53:32,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-22 19:53:32,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-22 19:53:32,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-22 19:53:32,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-22 19:53:32,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-22 19:53:32,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-22 19:53:32,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-22 19:53:32,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-22 19:53:32,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-22 19:53:32,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-22 19:53:32,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-22 19:53:32,713 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023407769677118204); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03773616246190503, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023407769677118204); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.014583333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.049833333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-22 19:53:32,713 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-22 19:53:32,713 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.017898015832934606, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023407769677118204); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03773616246190503, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023407769677118204); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.014583333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.049833333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-22 19:53:33,086 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 509 ms to try 5000 different iterations.  Found a solution that moves 1059 regions; Going from a computed imbalance of 0.017898015832934606 to a new imbalance of 6.073283722967217E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008567419296420211); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.01077262190536962); MoveCostFunction : (multiplier=7.0, imbalance=0.11766666666666667, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.008567419296420211); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-22 19:53:33,088 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1042081435:82 , srv1525698761:82 , srv743762440:82 , srv857367431:82 , srv1068819201:83 , srv1479759049:83 , srv1669141716:83 , srv1739212385:83 , srv1856023238:83 , srv1969431433:83 , srv306481523:83 , srv317427321:83 , srv378858914:83 , srv421807457:83 , srv1013285414:84 , srv1524564205:84 , srv1570194768:84 , srv1574074164:84 , srv1781995815:84 , srv18734674:84 , srv2054814435:84 , srv2124086762:84 , srv213009571:84 , srv354888955:84 , srv367743896:84 , srv440784613:84 , srv443524376:84 , srv493114133:84 , srv526689943:84 , srv573421179:84 , srv71676153:84 , srv830334484:84 , srv1116675563:85 , srv1210077091:85 , srv1401882079:85 , srv1445114021:85 , srv1572378792:85 , srv1662329889:85 , srv1739881361:85 , srv1759523425:85 , srv1997282464:85 , srv2040839032:85 , srv2066352380:85 , srv295113864:85 , srv340977893:85 , srv481077046:85 , srv484251424:85 , srv540314389:85 , srv755734925:85 , srv783272249:85 , srv843469379:85 , srv97508840:85 , srv1004188480:86 , srv100446692:86 , srv1124199654:86 , srv1185481624:86 , srv1208155525:86 , srv1265684762:86 , srv1289570793:86 , srv1456839229:86 , srv1545741294:86 , srv1778708587:86 , srv1840868226:86 , srv18746786:86 , srv1918777431:86 , srv2117294534:86 , srv511733959:86 , srv576763222:86 , srv69013667:86 , srv797834380:86 , srv850444303:86 , srv879139270:86 , srv893721100:86 , srv940897798:86 , srv980167378:86 , srv1173640153:87 , srv1300516712:87 , srv1371551375:87 , srv1684081372:87 , srv1920849568:87 , srv2108587634:87 , srv427618322:87 , srv44656298:87 , srv480563559:87 , srv483632834:87 , srv517599183:87 , srv889482722:87 , srv979025470:87 , srv983734159:87 , srv1039614335:88 , srv1045800652:88 , srv1062428957:88 , srv1196220834:88 , srv1354745123:88 , srv1897237659:88 , srv290367846:88 , srv574170007:88 , srv1441674155:89 , srv205184136:89 , srv1664102820:552 }
2023-05-22 19:53:33,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-22 19:53:33,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1997282464=48, srv573421179=79, srv983734159=99, srv755734925=85, srv317427321=60, srv893721100=94, srv1856023238=41, srv340977893=61, srv979025470=97, srv1570194768=28, srv1116675563=8, srv1371551375=19, srv1300516712=17, srv1684081372=34, srv1456839229=23, srv2108587634=53, srv295113864=58, srv205184136=50, srv69013667=82, srv1042081435=4, srv1574074164=30, srv511733959=75, srv44656298=69, srv1525698761=26, srv2066352380=52, srv481077046=71, srv1196220834=12, srv1918777431=45, srv484251424=73, srv1664102820=32, srv743762440=84, srv1781995815=39, srv526689943=77, srv440784613=67, srv850444303=90, srv1265684762=15, srv306481523=59, srv367743896=63, srv443524376=68, srv1441674155=21, srv1739212385=35, srv1739881361=36, srv1185481624=11, srv1208155525=13, srv2054814435=51, srv1840868226=40, srv1401882079=20, srv1662329889=31, srv940897798=95, srv1210077091=14, srv2117294534=54, srv1669141716=33, srv1289570793=16, srv576763222=81, srv857367431=91, srv427618322=66, srv517599183=76, srv1068819201=7, srv71676153=83, srv1124199654=9, srv1524564205=25, srv354888955=62, srv1062428957=6, srv1545741294=27, srv980167378=98, srv783272249=86, srv1479759049=24, srv18734674=42, srv1920849568=46, srv483632834=72, srv1572378792=29, srv1173640153=10, srv797834380=87, srv1969431433=47, srv1354745123=18, srv493114133=74, srv290367846=57, srv1897237659=44, srv843469379=89, srv1045800652=5, srv213009571=56, srv1039614335=3, srv1759523425=37, srv2040839032=49, srv889482722=93, srv1445114021=22, srv2124086762=55, srv540314389=78, srv100446692=1, srv574170007=80, srv1778708587=38, srv480563559=70, srv97508840=96, srv421807457=65, srv378858914=64, srv830334484=88, srv879139270=92, srv18746786=43, srv1004188480=0, srv1013285414=2} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-22 19:53:33,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-22 19:53:33,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-22 19:53:33,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-22 19:53:33,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-22 19:53:33,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-22 19:53:33,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-22 19:53:33,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-22 19:53:33,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-22 19:53:33,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-22 19:53:33,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-22 19:53:33,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-22 19:53:33,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-22 19:53:33,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-22 19:53:33,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-22 19:53:33,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-22 19:53:33,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-22 19:53:33,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-22 19:53:33,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-22 19:53:33,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-22 19:53:33,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-22 19:53:33,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-22 19:53:33,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-22 19:53:33,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-22 19:53:33,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-22 19:53:33,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-22 19:53:33,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-22 19:53:33,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-22 19:53:33,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-22 19:53:33,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-22 19:53:33,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-22 19:53:33,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-22 19:53:33,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-22 19:53:33,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-22 19:53:33,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-22 19:53:33,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-22 19:53:33,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-22 19:53:33,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-22 19:53:33,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-22 19:53:33,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-22 19:53:33,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-22 19:53:33,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-22 19:53:33,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-22 19:53:33,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-22 19:53:33,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-22 19:53:33,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-22 19:53:33,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-22 19:53:33,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-22 19:53:33,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-22 19:53:33,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-22 19:53:33,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-22 19:53:33,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-22 19:53:33,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-22 19:53:33,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-22 19:53:33,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-22 19:53:33,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-22 19:53:33,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-22 19:53:33,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-22 19:53:33,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-22 19:53:33,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-22 19:53:33,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-22 19:53:33,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-22 19:53:33,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-22 19:53:33,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-22 19:53:33,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-22 19:53:33,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-22 19:53:33,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-22 19:53:33,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-22 19:53:33,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-22 19:53:33,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-22 19:53:33,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-22 19:53:33,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-22 19:53:33,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-22 19:53:33,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-22 19:53:33,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-22 19:53:33,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-22 19:53:33,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-22 19:53:33,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-22 19:53:33,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-22 19:53:33,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-22 19:53:33,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-22 19:53:33,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-22 19:53:33,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-22 19:53:33,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-22 19:53:33,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-22 19:53:33,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-22 19:53:33,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-22 19:53:33,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-22 19:53:33,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-22 19:53:33,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-22 19:53:33,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-22 19:53:33,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-22 19:53:33,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-22 19:53:33,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-22 19:53:33,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-22 19:53:33,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-22 19:53:33,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-22 19:53:33,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-22 19:53:33,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-22 19:53:33,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-22 19:53:33,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-22 19:53:33,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-22 19:53:33,284 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008567419296420211); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.01077262190536962); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.008567419296420211); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-22 19:53:33,285 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-22 19:53:33,285 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=5.999130958068393E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008567419296420211); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.01077262190536962); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.008567419296420211); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-22 19:53:33,638 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 493 ms to try 5000 different iterations.  Found a solution that moves 289 regions; Going from a computed imbalance of 5.999130958068393E-4 to a new imbalance of 5.861544637988951E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0020651563939657444); MoveCostFunction : (multiplier=7.0, imbalance=0.03211111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=5.0E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-22 19:53:33,639 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1441674155:83 , srv205184136:83 , srv483632834:83 , srv783272249:83 , srv879139270:83 , srv1039614335:84 , srv1062428957:84 , srv1116675563:84 , srv1173640153:84 , srv1196220834:84 , srv1208155525:84 , srv1354745123:84 , srv1371551375:84 , srv1524564205:84 , srv1525698761:84 , srv1570194768:84 , srv1840868226:84 , srv18734674:84 , srv1897237659:84 , srv1920849568:84 , srv2054814435:84 , srv2066352380:84 , srv290367846:84 , srv306481523:84 , srv340977893:84 , srv367743896:84 , srv378858914:84 , srv427618322:84 , srv443524376:84 , srv517599183:84 , srv69013667:84 , srv71676153:84 , srv755734925:84 , srv889482722:84 , srv893721100:84 , srv983734159:84 , srv1004188480:85 , srv100446692:85 , srv1042081435:85 , srv1045800652:85 , srv1068819201:85 , srv1124199654:85 , srv1185481624:85 , srv1265684762:85 , srv1289570793:85 , srv1300516712:85 , srv1401882079:85 , srv1445114021:85 , srv1456839229:85 , srv1479759049:85 , srv1572378792:85 , srv1574074164:85 , srv1669141716:85 , srv1684081372:85 , srv1739212385:85 , srv1739881361:85 , srv18746786:85 , srv1918777431:85 , srv1997282464:85 , srv2040839032:85 , srv2108587634:85 , srv2117294534:85 , srv2124086762:85 , srv213009571:85 , srv421807457:85 , srv440784613:85 , srv44656298:85 , srv480563559:85 , srv484251424:85 , srv493114133:85 , srv526689943:85 , srv573421179:85 , srv574170007:85 , srv576763222:85 , srv743762440:85 , srv830334484:85 , srv843469379:85 , srv850444303:85 , srv940897798:85 , srv97508840:85 , srv979025470:85 , srv980167378:85 , srv1013285414:86 , srv1545741294:86 , srv1662329889:86 , srv1759523425:86 , srv1778708587:86 , srv1781995815:86 , srv1856023238:86 , srv1969431433:86 , srv295113864:86 , srv317427321:86 , srv354888955:86 , srv481077046:86 , srv511733959:86 , srv540314389:86 , srv797834380:86 , srv857367431:86 , srv1210077091:87 , srv1664102820:608 }
2023-05-22 19:53:33,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-22 19:53:33,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1997282464=48, srv573421179=79, srv983734159=99, srv755734925=85, srv317427321=60, srv893721100=94, srv1856023238=41, srv340977893=61, srv979025470=97, srv1570194768=28, srv1116675563=8, srv1371551375=19, srv1300516712=17, srv1684081372=34, srv1456839229=23, srv2108587634=53, srv295113864=58, srv205184136=50, srv69013667=82, srv1042081435=4, srv1574074164=30, srv511733959=75, srv44656298=69, srv1525698761=26, srv2066352380=52, srv481077046=71, srv1196220834=12, srv1918777431=45, srv484251424=73, srv1664102820=32, srv743762440=84, srv1781995815=39, srv526689943=77, srv440784613=67, srv850444303=90, srv1265684762=15, srv306481523=59, srv367743896=63, srv443524376=68, srv1441674155=21, srv1739212385=35, srv1739881361=36, srv1185481624=11, srv1208155525=13, srv2054814435=51, srv1840868226=40, srv1401882079=20, srv1662329889=31, srv940897798=95, srv1210077091=14, srv2117294534=54, srv1669141716=33, srv1289570793=16, srv576763222=81, srv857367431=91, srv427618322=66, srv517599183=76, srv1068819201=7, srv71676153=83, srv1124199654=9, srv1524564205=25, srv354888955=62, srv1062428957=6, srv1545741294=27, srv980167378=98, srv783272249=86, srv1479759049=24, srv18734674=42, srv1920849568=46, srv483632834=72, srv1572378792=29, srv1173640153=10, srv797834380=87, srv1969431433=47, srv1354745123=18, srv493114133=74, srv290367846=57, srv1897237659=44, srv843469379=89, srv1045800652=5, srv213009571=56, srv1039614335=3, srv1759523425=37, srv2040839032=49, srv889482722=93, srv1445114021=22, srv2124086762=55, srv540314389=78, srv100446692=1, srv574170007=80, srv1778708587=38, srv480563559=70, srv97508840=96, srv421807457=65, srv378858914=64, srv830334484=88, srv879139270=92, srv18746786=43, srv1004188480=0, srv1013285414=2} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-22 19:53:33,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-22 19:53:33,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-22 19:53:33,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-22 19:53:33,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-22 19:53:33,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-22 19:53:33,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-22 19:53:33,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-22 19:53:33,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-22 19:53:33,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-22 19:53:33,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-22 19:53:33,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-22 19:53:33,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-22 19:53:33,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-22 19:53:33,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-22 19:53:33,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-22 19:53:33,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-22 19:53:33,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-22 19:53:33,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-22 19:53:33,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-22 19:53:33,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-22 19:53:33,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-22 19:53:33,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-22 19:53:33,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-22 19:53:33,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-22 19:53:33,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-22 19:53:33,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-22 19:53:33,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-22 19:53:33,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-22 19:53:33,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-22 19:53:33,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-22 19:53:33,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-22 19:53:33,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-22 19:53:33,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-22 19:53:33,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-22 19:53:33,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-22 19:53:33,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-22 19:53:33,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-22 19:53:33,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-22 19:53:33,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-22 19:53:33,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-22 19:53:33,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-22 19:53:33,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-22 19:53:33,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-22 19:53:33,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-22 19:53:33,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-22 19:53:33,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-22 19:53:33,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-22 19:53:33,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-22 19:53:33,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-22 19:53:33,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-22 19:53:33,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-22 19:53:33,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-22 19:53:33,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-22 19:53:33,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-22 19:53:33,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-22 19:53:33,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-22 19:53:33,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-22 19:53:33,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-22 19:53:33,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-22 19:53:33,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-22 19:53:33,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-22 19:53:33,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-22 19:53:33,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-22 19:53:33,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-22 19:53:33,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-22 19:53:33,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-22 19:53:33,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-22 19:53:33,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-22 19:53:33,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-22 19:53:33,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-22 19:53:33,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-22 19:53:33,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-22 19:53:33,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-22 19:53:33,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-22 19:53:33,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-22 19:53:33,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-22 19:53:33,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-22 19:53:33,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-22 19:53:33,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-22 19:53:33,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-22 19:53:33,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-22 19:53:33,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-22 19:53:33,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-22 19:53:33,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-22 19:53:33,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-22 19:53:33,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-22 19:53:33,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-22 19:53:33,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-22 19:53:33,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-22 19:53:33,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-22 19:53:33,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-22 19:53:33,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-22 19:53:33,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-22 19:53:33,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-22 19:53:33,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-22 19:53:33,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-22 19:53:33,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-22 19:53:33,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-22 19:53:33,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-22 19:53:33,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-22 19:53:33,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-22 19:53:33,794 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0020651563939657444); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=5.0E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-22 19:53:33,794 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-22 19:53:33,795 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=5.659182512816523E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0020651563939657444); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=5.0E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-22 19:53:34,019 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 335 ms to try 5000 different iterations.  Found a solution that moves 35 regions; Going from a computed imbalance of 5.659182512816523E-5 to a new imbalance of 7.632832738410655E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0016412198797244363); MoveCostFunction : (multiplier=7.0, imbalance=0.0038888888888888888); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-22 19:53:34,020 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1210077091:82 , srv1525698761:83 , srv1759523425:83 , srv1781995815:83 , srv44656298:83 , srv511733959:83 , srv540314389:83 , srv1004188480:84 , srv100446692:84 , srv1013285414:84 , srv1039614335:84 , srv1042081435:84 , srv1045800652:84 , srv1062428957:84 , srv1068819201:84 , srv1116675563:84 , srv1124199654:84 , srv1173640153:84 , srv1185481624:84 , srv1196220834:84 , srv1208155525:84 , srv1265684762:84 , srv1289570793:84 , srv1300516712:84 , srv1354745123:84 , srv1371551375:84 , srv1401882079:84 , srv1441674155:84 , srv1445114021:84 , srv1456839229:84 , srv1479759049:84 , srv1524564205:84 , srv1545741294:84 , srv1570194768:84 , srv1572378792:84 , srv1574074164:84 , srv1662329889:84 , srv1669141716:84 , srv1684081372:84 , srv1739212385:84 , srv1739881361:84 , srv1778708587:84 , srv1856023238:84 , srv18734674:84 , srv18746786:84 , srv1897237659:84 , srv1918777431:84 , srv1920849568:84 , srv1969431433:84 , srv1997282464:84 , srv2040839032:84 , srv205184136:84 , srv2054814435:84 , srv2066352380:84 , srv2108587634:84 , srv2117294534:84 , srv2124086762:84 , srv213009571:84 , srv290367846:84 , srv295113864:84 , srv306481523:84 , srv317427321:84 , srv340977893:84 , srv354888955:84 , srv421807457:84 , srv427618322:84 , srv440784613:84 , srv480563559:84 , srv481077046:84 , srv484251424:84 , srv493114133:84 , srv526689943:84 , srv573421179:84 , srv574170007:84 , srv576763222:84 , srv69013667:84 , srv71676153:84 , srv743762440:84 , srv755734925:84 , srv783272249:84 , srv797834380:84 , srv830334484:84 , srv843469379:84 , srv850444303:84 , srv857367431:84 , srv889482722:84 , srv893721100:84 , srv940897798:84 , srv97508840:84 , srv979025470:84 , srv983734159:84 , srv1840868226:85 , srv367743896:85 , srv378858914:85 , srv443524376:85 , srv483632834:85 , srv517599183:85 , srv879139270:85 , srv980167378:85 , srv1664102820:684 }
2023-05-22 19:53:34,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-22 19:53:34,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1997282464=48, srv573421179=79, srv983734159=99, srv755734925=85, srv317427321=60, srv893721100=94, srv1856023238=41, srv340977893=61, srv979025470=97, srv1570194768=28, srv1116675563=8, srv1371551375=19, srv1300516712=17, srv1684081372=34, srv1456839229=23, srv2108587634=53, srv295113864=58, srv205184136=50, srv69013667=82, srv1042081435=4, srv1574074164=30, srv511733959=75, srv44656298=69, srv1525698761=26, srv2066352380=52, srv481077046=71, srv1196220834=12, srv1918777431=45, srv484251424=73, srv1664102820=32, srv743762440=84, srv1781995815=39, srv526689943=77, srv440784613=67, srv850444303=90, srv1265684762=15, srv306481523=59, srv367743896=63, srv443524376=68, srv1441674155=21, srv1739212385=35, srv1739881361=36, srv1185481624=11, srv1208155525=13, srv2054814435=51, srv1840868226=40, srv1401882079=20, srv1662329889=31, srv940897798=95, srv1210077091=14, srv2117294534=54, srv1669141716=33, srv1289570793=16, srv576763222=81, srv857367431=91, srv427618322=66, srv517599183=76, srv1068819201=7, srv71676153=83, srv1124199654=9, srv1524564205=25, srv354888955=62, srv1062428957=6, srv1545741294=27, srv980167378=98, srv783272249=86, srv1479759049=24, srv18734674=42, srv1920849568=46, srv483632834=72, srv1572378792=29, srv1173640153=10, srv797834380=87, srv1969431433=47, srv1354745123=18, srv493114133=74, srv290367846=57, srv1897237659=44, srv843469379=89, srv1045800652=5, srv213009571=56, srv1039614335=3, srv1759523425=37, srv2040839032=49, srv889482722=93, srv1445114021=22, srv2124086762=55, srv540314389=78, srv100446692=1, srv574170007=80, srv1778708587=38, srv480563559=70, srv97508840=96, srv421807457=65, srv378858914=64, srv830334484=88, srv879139270=92, srv18746786=43, srv1004188480=0, srv1013285414=2} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-22 19:53:34,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-22 19:53:34,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-22 19:53:34,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-22 19:53:34,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-22 19:53:34,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-22 19:53:34,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-22 19:53:34,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-22 19:53:34,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-22 19:53:34,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-22 19:53:34,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-22 19:53:34,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-22 19:53:34,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-22 19:53:34,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-22 19:53:34,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-22 19:53:34,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-22 19:53:34,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-22 19:53:34,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-22 19:53:34,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-22 19:53:34,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-22 19:53:34,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-22 19:53:34,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-22 19:53:34,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-22 19:53:34,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-22 19:53:34,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-22 19:53:34,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-22 19:53:34,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-22 19:53:34,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-22 19:53:34,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-22 19:53:34,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-22 19:53:34,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-22 19:53:34,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-22 19:53:34,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-22 19:53:34,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-22 19:53:34,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-22 19:53:34,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-22 19:53:34,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-22 19:53:34,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-22 19:53:34,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-22 19:53:34,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-22 19:53:34,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-22 19:53:34,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-22 19:53:34,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-22 19:53:34,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-22 19:53:34,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-22 19:53:34,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-22 19:53:34,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-22 19:53:34,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-22 19:53:34,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-22 19:53:34,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-22 19:53:34,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-22 19:53:34,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-22 19:53:34,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-22 19:53:34,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-22 19:53:34,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-22 19:53:34,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-22 19:53:34,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-22 19:53:34,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-22 19:53:34,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-22 19:53:34,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-22 19:53:34,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-22 19:53:34,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-22 19:53:34,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-22 19:53:34,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-22 19:53:34,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-22 19:53:34,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-22 19:53:34,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-22 19:53:34,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-22 19:53:34,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-22 19:53:34,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-22 19:53:34,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-22 19:53:34,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-22 19:53:34,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-22 19:53:34,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-22 19:53:34,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-22 19:53:34,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-22 19:53:34,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-22 19:53:34,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-22 19:53:34,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-22 19:53:34,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-22 19:53:34,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-22 19:53:34,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-22 19:53:34,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-22 19:53:34,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-22 19:53:34,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-22 19:53:34,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-22 19:53:34,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-22 19:53:34,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-22 19:53:34,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-22 19:53:34,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-22 19:53:34,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-22 19:53:34,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-22 19:53:34,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-22 19:53:34,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-22 19:53:34,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-22 19:53:34,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-22 19:53:34,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-22 19:53:34,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-22 19:53:34,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-22 19:53:34,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-22 19:53:34,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-22 19:53:34,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-22 19:53:34,170 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.387757500312559E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0016412198797244363); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-22 19:53:34,170 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1210077091:82 , srv1525698761:83 , srv1759523425:83 , srv1781995815:83 , srv44656298:83 , srv511733959:83 , srv540314389:83 , srv1004188480:84 , srv100446692:84 , srv1013285414:84 , srv1039614335:84 , srv1042081435:84 , srv1045800652:84 , srv1062428957:84 , srv1068819201:84 , srv1116675563:84 , srv1124199654:84 , srv1173640153:84 , srv1185481624:84 , srv1196220834:84 , srv1208155525:84 , srv1265684762:84 , srv1289570793:84 , srv1300516712:84 , srv1354745123:84 , srv1371551375:84 , srv1401882079:84 , srv1441674155:84 , srv1445114021:84 , srv1456839229:84 , srv1479759049:84 , srv1524564205:84 , srv1545741294:84 , srv1570194768:84 , srv1572378792:84 , srv1574074164:84 , srv1662329889:84 , srv1669141716:84 , srv1684081372:84 , srv1739212385:84 , srv1739881361:84 , srv1778708587:84 , srv1856023238:84 , srv18734674:84 , srv18746786:84 , srv1897237659:84 , srv1918777431:84 , srv1920849568:84 , srv1969431433:84 , srv1997282464:84 , srv2040839032:84 , srv205184136:84 , srv2054814435:84 , srv2066352380:84 , srv2108587634:84 , srv2117294534:84 , srv2124086762:84 , srv213009571:84 , srv290367846:84 , srv295113864:84 , srv306481523:84 , srv317427321:84 , srv340977893:84 , srv354888955:84 , srv421807457:84 , srv427618322:84 , srv440784613:84 , srv480563559:84 , srv481077046:84 , srv484251424:84 , srv493114133:84 , srv526689943:84 , srv573421179:84 , srv574170007:84 , srv576763222:84 , srv69013667:84 , srv71676153:84 , srv743762440:84 , srv755734925:84 , srv783272249:84 , srv797834380:84 , srv830334484:84 , srv843469379:84 , srv850444303:84 , srv857367431:84 , srv889482722:84 , srv893721100:84 , srv940897798:84 , srv97508840:84 , srv979025470:84 , srv983734159:84 , srv1840868226:85 , srv367743896:85 , srv378858914:85 , srv443524376:85 , srv483632834:85 , srv517599183:85 , srv879139270:85 , srv980167378:85 , srv1664102820:684 }
2023-05-22 19:53:34,197 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=264 (was 264), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=367 (was 346) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 171), AvailableMemoryMB=6505 (was 7121)
2023-05-22 19:53:34,206 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=264, MaxFileDescriptor=60000, SystemLoadAverage=367, ProcessCount=171, AvailableMemoryMB=6505
2023-05-22 19:53:34,206 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-05-22 19:53:34,207 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-05-22 19:53:34,219 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1000664846:84 , srv1070021570:84 , srv1135125229:84 , srv1190351581:84 , srv1328136521:84 , srv1379958171:84 , srv1462662368:84 , srv1538174052:84 , srv1554624455:84 , srv1600820143:84 , srv1603407002:84 , srv1736328309:84 , srv1747108418:84 , srv1753638013:84 , srv1822015461:84 , srv1840300038:84 , srv1943157506:84 , srv1952189580:84 , srv2144165226:84 , srv24648886:84 , srv300988140:84 , srv412397678:84 , srv535198883:84 , srv56317551:84 , srv569516816:84 , srv655842852:84 , srv81386578:84 , srv879603594:84 , srv900073881:84 , srv1848348441:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-05-22 19:53:34,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-22 19:53:34,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1603407002=10, srv879603594=28, srv300988140=21, srv1190351581=3, srv1943157506=17, srv569516816=25, srv56317551=24, srv1840300038=15, srv1328136521=4, srv1736328309=11, srv1379958171=5, srv1747108418=12, srv1462662368=6, srv412397678=22, srv900073881=29, srv24648886=20, srv655842852=26, srv1952189580=18, srv535198883=23, srv1554624455=8, srv1538174052=7, srv81386578=27, srv1822015461=14, srv1135125229=2, srv1000664846=0, srv1600820143=9, srv1753638013=13, srv1848348441=16, srv1070021570=1, srv2144165226=19} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-22 19:53:34,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-22 19:53:34,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-22 19:53:34,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-22 19:53:34,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-22 19:53:34,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-22 19:53:34,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-22 19:53:34,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-22 19:53:34,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-22 19:53:34,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-22 19:53:34,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-22 19:53:34,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-22 19:53:34,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-22 19:53:34,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-22 19:53:34,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-22 19:53:34,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-22 19:53:34,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-22 19:53:34,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-22 19:53:34,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-22 19:53:34,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-22 19:53:34,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-22 19:53:34,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-22 19:53:34,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-22 19:53:34,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-22 19:53:34,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-22 19:53:34,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-22 19:53:34,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-22 19:53:34,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-22 19:53:34,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-22 19:53:34,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-22 19:53:34,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-22 19:53:34,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-05-22 19:53:34,249 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1408086843554017, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-22 19:53:34,249 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912636726830856, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1408086843554017, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-05-22 19:55:34,237 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6686456 different iterations.  Found a solution that moves 1859 regions; Going from a computed imbalance of 0.9912636726830856 to a new imbalance of 4.338998739279625E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6885185185185185, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-22 19:55:34,246 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1000664846:90 , srv1070021570:90 , srv1135125229:90 , srv1190351581:90 , srv1328136521:90 , srv1379958171:90 , srv1462662368:90 , srv1538174052:90 , srv1554624455:90 , srv1600820143:90 , srv1603407002:90 , srv1736328309:90 , srv1747108418:90 , srv1753638013:90 , srv1822015461:90 , srv1840300038:90 , srv1848348441:90 , srv1943157506:90 , srv1952189580:90 , srv2144165226:90 , srv24648886:90 , srv300988140:90 , srv412397678:90 , srv535198883:90 , srv56317551:90 , srv569516816:90 , srv655842852:90 , srv81386578:90 , srv879603594:90 , srv900073881:90 }
2023-05-22 19:55:34,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-22 19:55:34,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1603407002=10, srv879603594=28, srv300988140=21, srv1190351581=3, srv1943157506=17, srv569516816=25, srv56317551=24, srv1840300038=15, srv1328136521=4, srv1736328309=11, srv1379958171=5, srv1747108418=12, srv1462662368=6, srv412397678=22, srv900073881=29, srv24648886=20, srv655842852=26, srv1952189580=18, srv535198883=23, srv1554624455=8, srv1538174052=7, srv81386578=27, srv1822015461=14, srv1135125229=2, srv1000664846=0, srv1600820143=9, srv1753638013=13, srv1848348441=16, srv1070021570=1, srv2144165226=19} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-22 19:55:34,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-22 19:55:34,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-22 19:55:34,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-22 19:55:34,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-22 19:55:34,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-22 19:55:34,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-22 19:55:34,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-22 19:55:34,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-22 19:55:34,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-22 19:55:34,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-22 19:55:34,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-22 19:55:34,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-22 19:55:34,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-22 19:55:34,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-22 19:55:34,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-22 19:55:34,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-22 19:55:34,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-22 19:55:34,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-22 19:55:34,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-22 19:55:34,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-22 19:55:34,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-22 19:55:34,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-22 19:55:34,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-22 19:55:34,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-22 19:55:34,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-22 19:55:34,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-22 19:55:34,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-22 19:55:34,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-22 19:55:34,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-22 19:55:34,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-22 19:55:34,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-05-22 19:55:34,273 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-22 19:55:34,273 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1000664846:90 , srv1070021570:90 , srv1135125229:90 , srv1190351581:90 , srv1328136521:90 , srv1379958171:90 , srv1462662368:90 , srv1538174052:90 , srv1554624455:90 , srv1600820143:90 , srv1603407002:90 , srv1736328309:90 , srv1747108418:90 , srv1753638013:90 , srv1822015461:90 , srv1840300038:90 , srv1848348441:90 , srv1943157506:90 , srv1952189580:90 , srv2144165226:90 , srv24648886:90 , srv300988140:90 , srv412397678:90 , srv535198883:90 , srv56317551:90 , srv569516816:90 , srv655842852:90 , srv81386578:90 , srv879603594:90 , srv900073881:90 }
2023-05-22 19:55:34,287 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=264 (was 264), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=227 (was 367), ProcessCount=169 (was 171), AvailableMemoryMB=6350 (was 6505)