2023-05-14 21:53:25,925 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-05-14 21:53:26,247 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-05-14 21:53:26,361 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-05-14 21:53:26,427 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-05-14 21:53:26,434 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-05-14 21:53:26,447 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=264, MaxFileDescriptor=60000, SystemLoadAverage=309, ProcessCount=173, AvailableMemoryMB=19057
2023-05-14 21:53:26,449 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-05-14 21:53:26,449 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-05-14 21:53:26,608 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1007601328:84 , srv1073407549:84 , srv1086428343:84 , srv1090218745:84 , srv1131573398:84 , srv1137902946:84 , srv1183081900:84 , srv1187438761:84 , srv1213570988:84 , srv1229243171:84 , srv1237955748:84 , srv1312548174:84 , srv1323288279:84 , srv1323492389:84 , srv1343895555:84 , srv1372037689:84 , srv1395409022:84 , srv1405202798:84 , srv1421421351:84 , srv1429386664:84 , srv1442922516:84 , srv1451489:84 , srv1453778407:84 , srv1468673061:84 , srv1509367214:84 , srv1515213881:84 , srv1523069478:84 , srv1526281802:84 , srv1529809645:84 , srv1536426589:84 , srv1546185743:84 , srv1552065187:84 , srv1582222127:84 , srv1615959392:84 , srv1627164440:84 , srv1647441853:84 , srv1659463144:84 , srv1672010383:84 , srv1689365207:84 , srv170105572:84 , srv1752589854:84 , srv1790108365:84 , srv1799171296:84 , srv1848958430:84 , srv1854429581:84 , srv1857080745:84 , srv1867532075:84 , srv1907357750:84 , srv191477285:84 , srv1929665424:84 , srv194427499:84 , srv1946342744:84 , srv1959334071:84 , srv1979946191:84 , srv1980129672:84 , srv2031843255:84 , srv2034240034:84 , srv2037899700:84 , srv2046780448:84 , srv2073634152:84 , srv2080848818:84 , srv2094788727:84 , srv262670194:84 , srv273898045:84 , srv273947199:84 , srv298025083:84 , srv304446967:84 , srv305512299:84 , srv33095690:84 , srv363605588:84 , srv402688098:84 , srv461849703:84 , srv483431061:84 , srv493713785:84 , srv496886608:84 , srv51710639:84 , srv525629498:84 , srv559665749:84 , srv591993764:84 , srv594403304:84 , srv635429677:84 , srv640679828:84 , srv64422739:84 , srv675761352:84 , srv677698479:84 , srv679263523:84 , srv695850639:84 , srv7571120:84 , srv764162865:84 , srv777973808:84 , srv83069397:84 , srv840607957:84 , srv851546687:84 , srv935169156:84 , srv957611806:84 , srv965256793:84 , srv980760181:84 , srv983199003:84 , srv984184778:84 , srv147473903:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-05-14 21:53:26,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-14 21:53:26,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1752589854=41, srv1323492389=13, srv1790108365=42, srv525629498=77, srv677698479=85, srv1229243171=9, srv1429386664=19, srv1323288279=12, srv1546185743=31, srv2080848818=61, srv363605588=70, srv1237955748=10, srv273898045=64, srv51710639=76, srv851546687=93, srv840607957=92, srv679263523=86, srv1090218745=3, srv1343895555=14, srv1515213881=26, srv980760181=97, srv1980129672=55, srv194427499=51, srv591993764=79, srv1582222127=33, srv777973808=90, srv957611806=95, srv1867532075=47, srv1213570988=8, srv1946342744=52, srv1854429581=45, srv170105572=40, srv635429677=81, srv461849703=72, srv1405202798=17, srv2094788727=62, srv1131573398=4, srv2037899700=58, srv273947199=65, srv1672010383=38, srv1536426589=30, srv262670194=63, srv305512299=68, srv1929665424=50, srv7571120=88, srv83069397=91, srv1007601328=0, srv1907357750=48, srv1523069478=27, srv1659463144=37, srv1073407549=1, srv1627164440=35, srv2046780448=59, srv33095690=69, srv1137902946=5, srv2031843255=56, srv1529809645=29, srv935169156=94, srv402688098=71, srv1453778407=22, srv496886608=75, srv1689365207=39, srv1848958430=44, srv640679828=82, srv1086428343=2, srv1615959392=34, srv1372037689=15, srv304446967=67, srv764162865=89, srv1442922516=20, srv2073634152=60, srv1857080745=46, srv965256793=96, srv1959334071=53, srv298025083=66, srv1468673061=23, srv2034240034=57, srv64422739=83, srv594403304=80, srv1395409022=16, srv483431061=73, srv1421421351=18, srv1312548174=11, srv191477285=49, srv1979946191=54, srv984184778=99, srv1647441853=36, srv1799171296=43, srv1187438761=7, srv695850639=87, srv983199003=98, srv559665749=78, srv1526281802=28, srv1451489=21, srv147473903=24, srv1552065187=32, srv1509367214=25, srv675761352=84, srv493713785=74, srv1183081900=6} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-14 21:53:26,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-14 21:53:26,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-14 21:53:26,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-14 21:53:26,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-14 21:53:26,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-14 21:53:26,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-14 21:53:26,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-14 21:53:26,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-14 21:53:26,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-14 21:53:26,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-14 21:53:26,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-14 21:53:26,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-14 21:53:26,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-14 21:53:26,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-14 21:53:26,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-14 21:53:26,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-14 21:53:26,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-14 21:53:26,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-14 21:53:26,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-14 21:53:26,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-14 21:53:26,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-14 21:53:26,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-14 21:53:26,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-14 21:53:26,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-14 21:53:26,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-14 21:53:26,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-14 21:53:26,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-14 21:53:26,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-14 21:53:26,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-14 21:53:26,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-14 21:53:26,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-14 21:53:26,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-14 21:53:26,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-14 21:53:26,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-14 21:53:26,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-14 21:53:26,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-14 21:53:26,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-14 21:53:26,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-14 21:53:26,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-14 21:53:26,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-14 21:53:26,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-14 21:53:26,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-14 21:53:26,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-14 21:53:26,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-14 21:53:26,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-14 21:53:26,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-14 21:53:26,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-14 21:53:26,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-14 21:53:26,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-14 21:53:26,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-14 21:53:26,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-14 21:53:26,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-14 21:53:26,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-14 21:53:26,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-14 21:53:26,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-14 21:53:26,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-14 21:53:26,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-14 21:53:26,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-14 21:53:26,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-14 21:53:26,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-14 21:53:26,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-14 21:53:26,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-14 21:53:26,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-14 21:53:26,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-14 21:53:26,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-14 21:53:26,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-14 21:53:26,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-14 21:53:26,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-14 21:53:26,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-14 21:53:26,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-14 21:53:26,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-14 21:53:26,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-14 21:53:26,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-14 21:53:26,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-14 21:53:26,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-14 21:53:26,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-14 21:53:26,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-14 21:53:26,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-14 21:53:26,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-14 21:53:26,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-14 21:53:26,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-14 21:53:26,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-14 21:53:26,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-14 21:53:26,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-14 21:53:26,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-14 21:53:26,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-14 21:53:26,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-14 21:53:26,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-14 21:53:26,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-14 21:53:26,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-14 21:53:26,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-14 21:53:26,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-14 21:53:26,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-14 21:53:26,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-14 21:53:26,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-14 21:53:26,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-14 21:53:26,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-14 21:53:26,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-14 21:53:26,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-14 21:53:26,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-14 21:53:26,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-14 21:53:26,899 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-14 21:53:26,899 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-14 21:53:26,899 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-14 21:53:27,326 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 592 ms to try 5000 different iterations.  Found a solution that moves 4689 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18384674769653783. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04105571540057789, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05440010563137562, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.521, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04105571540057789, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17883333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.2485, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-14 21:53:27,341 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv2034240034:80 , srv273947199:80 , srv305512299:80 , srv1515213881:81 , srv1523069478:81 , srv1529809645:81 , srv2080848818:81 , srv83069397:81 , srv1237955748:82 , srv1752589854:82 , srv1980129672:82 , srv33095690:82 , srv496886608:82 , srv677698479:82 , srv1312548174:83 , srv1979946191:83 , srv262670194:83 , srv402688098:83 , srv935169156:83 , srv1137902946:84 , srv1509367214:84 , srv1672010383:84 , srv1689365207:84 , srv170105572:84 , srv1848958430:84 , srv304446967:84 , srv525629498:84 , srv7571120:84 , srv1007601328:85 , srv1131573398:85 , srv1323492389:85 , srv1405202798:85 , srv1536426589:85 , srv1627164440:85 , srv1790108365:85 , srv1854429581:85 , srv2073634152:85 , srv493713785:85 , srv635429677:85 , srv679263523:85 , srv777973808:85 , srv1086428343:86 , srv1183081900:86 , srv1213570988:86 , srv1343895555:86 , srv1468673061:86 , srv1546185743:86 , srv1552065187:86 , srv1582222127:86 , srv191477285:86 , srv1946342744:86 , srv1959334071:86 , srv2031843255:86 , srv363605588:86 , srv851546687:86 , srv1073407549:87 , srv1229243171:87 , srv1647441853:87 , srv1659463144:87 , srv1907357750:87 , srv1929665424:87 , srv2037899700:87 , srv2046780448:87 , srv2094788727:87 , srv51710639:87 , srv591993764:87 , srv695850639:87 , srv840607957:87 , srv1090218745:88 , srv1187438761:88 , srv1451489:88 , srv1453778407:88 , srv1526281802:88 , srv1867532075:88 , srv194427499:88 , srv298025083:88 , srv559665749:88 , srv64422739:88 , srv675761352:88 , srv980760181:88 , srv983199003:88 , srv1429386664:89 , srv1615959392:89 , srv1857080745:89 , srv273898045:89 , srv461849703:89 , srv483431061:89 , srv640679828:89 , srv594403304:91 , srv1372037689:92 , srv1395409022:92 , srv1442922516:92 , srv764162865:92 , srv984184778:92 , srv1323288279:93 , srv957611806:93 , srv965256793:94 , srv1799171296:96 , srv1421421351:104 , srv147473903:454 }
2023-05-14 21:53:27,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-14 21:53:27,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1752589854=41, srv1323492389=13, srv1790108365=42, srv525629498=77, srv677698479=85, srv1229243171=9, srv1429386664=19, srv1323288279=12, srv1546185743=31, srv2080848818=61, srv363605588=70, srv1237955748=10, srv273898045=64, srv51710639=76, srv851546687=93, srv840607957=92, srv679263523=86, srv1090218745=3, srv1343895555=14, srv1515213881=26, srv980760181=97, srv1980129672=55, srv194427499=51, srv591993764=79, srv1582222127=33, srv777973808=90, srv957611806=95, srv1867532075=47, srv1213570988=8, srv1946342744=52, srv1854429581=45, srv170105572=40, srv635429677=81, srv461849703=72, srv1405202798=17, srv2094788727=62, srv1131573398=4, srv2037899700=58, srv273947199=65, srv1672010383=38, srv1536426589=30, srv262670194=63, srv305512299=68, srv1929665424=50, srv7571120=88, srv83069397=91, srv1007601328=0, srv1907357750=48, srv1523069478=27, srv1659463144=37, srv1073407549=1, srv1627164440=35, srv2046780448=59, srv33095690=69, srv1137902946=5, srv2031843255=56, srv1529809645=29, srv935169156=94, srv402688098=71, srv1453778407=22, srv496886608=75, srv1689365207=39, srv1848958430=44, srv640679828=82, srv1086428343=2, srv1615959392=34, srv1372037689=15, srv304446967=67, srv764162865=89, srv1442922516=20, srv2073634152=60, srv1857080745=46, srv965256793=96, srv1959334071=53, srv298025083=66, srv1468673061=23, srv2034240034=57, srv64422739=83, srv594403304=80, srv1395409022=16, srv483431061=73, srv1421421351=18, srv1312548174=11, srv191477285=49, srv1979946191=54, srv984184778=99, srv1647441853=36, srv1799171296=43, srv1187438761=7, srv695850639=87, srv983199003=98, srv559665749=78, srv1526281802=28, srv1451489=21, srv147473903=24, srv1552065187=32, srv1509367214=25, srv675761352=84, srv493713785=74, srv1183081900=6} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-14 21:53:27,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-14 21:53:27,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-14 21:53:27,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-14 21:53:27,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-14 21:53:27,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-14 21:53:27,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-14 21:53:27,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-14 21:53:27,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-14 21:53:27,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-14 21:53:27,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-14 21:53:27,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-14 21:53:27,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-14 21:53:27,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-14 21:53:27,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-14 21:53:27,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-14 21:53:27,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-14 21:53:27,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-14 21:53:27,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-14 21:53:27,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-14 21:53:27,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-14 21:53:27,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-14 21:53:27,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-14 21:53:27,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-14 21:53:27,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-14 21:53:27,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-14 21:53:27,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-14 21:53:27,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-14 21:53:27,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-14 21:53:27,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-14 21:53:27,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-14 21:53:27,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-14 21:53:27,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-14 21:53:27,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-14 21:53:27,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-14 21:53:27,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-14 21:53:27,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-14 21:53:27,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-14 21:53:27,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-14 21:53:27,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-14 21:53:27,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-14 21:53:27,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-14 21:53:27,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-14 21:53:27,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-14 21:53:27,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-14 21:53:27,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-14 21:53:27,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-14 21:53:27,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-14 21:53:27,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-14 21:53:27,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-14 21:53:27,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-14 21:53:27,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-14 21:53:27,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-14 21:53:27,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-14 21:53:27,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-14 21:53:27,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-14 21:53:27,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-14 21:53:27,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-14 21:53:27,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-14 21:53:27,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-14 21:53:27,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-14 21:53:27,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-14 21:53:27,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-14 21:53:27,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-14 21:53:27,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-14 21:53:27,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-14 21:53:27,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-14 21:53:27,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-14 21:53:27,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-14 21:53:27,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-14 21:53:27,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-14 21:53:27,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-14 21:53:27,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-14 21:53:27,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-14 21:53:27,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-14 21:53:27,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-14 21:53:27,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-14 21:53:27,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-14 21:53:27,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-14 21:53:27,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-14 21:53:27,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-14 21:53:27,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-14 21:53:27,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-14 21:53:27,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-14 21:53:27,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-14 21:53:27,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-14 21:53:27,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-14 21:53:27,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-14 21:53:27,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-14 21:53:27,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-14 21:53:27,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-14 21:53:27,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-14 21:53:27,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-14 21:53:27,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-14 21:53:27,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-14 21:53:27,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-14 21:53:27,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-14 21:53:27,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-14 21:53:27,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-14 21:53:27,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-14 21:53:27,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-14 21:53:27,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-14 21:53:27,488 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04105571540057789, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05440010563137562, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04105571540057789, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17883333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.2485, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-14 21:53:27,489 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-14 21:53:27,489 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18381391461678234, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04105571540057789, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05440010563137562, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04105571540057789, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17883333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.2485, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-14 21:53:27,919 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 533 ms to try 5000 different iterations.  Found a solution that moves 2635 regions; Going from a computed imbalance of 0.18381391461678234 to a new imbalance of 0.0159828277190319. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023657889226612876); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03290294539911509, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2927777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023657889226612876); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01275); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04691666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-14 21:53:27,935 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1799171296:73 , srv1421421351:75 , srv1442922516:78 , srv764162865:78 , srv1323288279:79 , srv965256793:79 , srv1372037689:80 , srv1395409022:80 , srv957611806:80 , srv1429386664:81 , srv984184778:81 , srv1615959392:82 , srv1857080745:82 , srv2046780448:82 , srv559665749:82 , srv594403304:82 , srv64422739:82 , srv980760181:82 , srv1343895555:83 , srv1453778407:83 , srv1647441853:83 , srv194427499:83 , srv273898045:83 , srv493713785:83 , srv1187438761:84 , srv1451489:84 , srv1689365207:84 , srv1854429581:84 , srv1867532075:84 , srv1907357750:84 , srv1959334071:84 , srv363605588:84 , srv461849703:84 , srv640679828:84 , srv675761352:84 , srv840607957:84 , srv983199003:84 , srv1137902946:85 , srv1183081900:85 , srv1229243171:85 , srv1509367214:85 , srv1526281802:85 , srv1946342744:85 , srv2031843255:85 , srv2037899700:85 , srv2073634152:85 , srv2094788727:85 , srv483431061:85 , srv591993764:85 , srv851546687:85 , srv1073407549:86 , srv1086428343:86 , srv1090218745:86 , srv1213570988:86 , srv1672010383:86 , srv170105572:86 , srv298025083:86 , srv51710639:86 , srv1312548174:87 , srv1323492389:87 , srv1582222127:87 , srv1627164440:87 , srv1929665424:87 , srv304446967:87 , srv695850639:87 , srv1007601328:88 , srv1405202798:88 , srv1468673061:88 , srv1546185743:88 , srv1552065187:88 , srv1659463144:88 , srv1752589854:88 , srv1790108365:88 , srv1848958430:88 , srv191477285:88 , srv1979946191:88 , srv496886608:88 , srv677698479:88 , srv777973808:88 , srv1131573398:89 , srv33095690:89 , srv525629498:89 , srv635429677:89 , srv7571120:89 , srv83069397:89 , srv1515213881:90 , srv1523069478:90 , srv1536426589:90 , srv305512299:90 , srv402688098:90 , srv1237955748:91 , srv1529809645:91 , srv1980129672:91 , srv2080848818:91 , srv679263523:91 , srv262670194:92 , srv273947199:92 , srv935169156:92 , srv2034240034:93 , srv147473903:530 }
2023-05-14 21:53:27,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-14 21:53:27,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1752589854=41, srv1323492389=13, srv1790108365=42, srv525629498=77, srv677698479=85, srv1229243171=9, srv1429386664=19, srv1323288279=12, srv1546185743=31, srv2080848818=61, srv363605588=70, srv1237955748=10, srv273898045=64, srv51710639=76, srv851546687=93, srv840607957=92, srv679263523=86, srv1090218745=3, srv1343895555=14, srv1515213881=26, srv980760181=97, srv1980129672=55, srv194427499=51, srv591993764=79, srv1582222127=33, srv777973808=90, srv957611806=95, srv1867532075=47, srv1213570988=8, srv1946342744=52, srv1854429581=45, srv170105572=40, srv635429677=81, srv461849703=72, srv1405202798=17, srv2094788727=62, srv1131573398=4, srv2037899700=58, srv273947199=65, srv1672010383=38, srv1536426589=30, srv262670194=63, srv305512299=68, srv1929665424=50, srv7571120=88, srv83069397=91, srv1007601328=0, srv1907357750=48, srv1523069478=27, srv1659463144=37, srv1073407549=1, srv1627164440=35, srv2046780448=59, srv33095690=69, srv1137902946=5, srv2031843255=56, srv1529809645=29, srv935169156=94, srv402688098=71, srv1453778407=22, srv496886608=75, srv1689365207=39, srv1848958430=44, srv640679828=82, srv1086428343=2, srv1615959392=34, srv1372037689=15, srv304446967=67, srv764162865=89, srv1442922516=20, srv2073634152=60, srv1857080745=46, srv965256793=96, srv1959334071=53, srv298025083=66, srv1468673061=23, srv2034240034=57, srv64422739=83, srv594403304=80, srv1395409022=16, srv483431061=73, srv1421421351=18, srv1312548174=11, srv191477285=49, srv1979946191=54, srv984184778=99, srv1647441853=36, srv1799171296=43, srv1187438761=7, srv695850639=87, srv983199003=98, srv559665749=78, srv1526281802=28, srv1451489=21, srv147473903=24, srv1552065187=32, srv1509367214=25, srv675761352=84, srv493713785=74, srv1183081900=6} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-14 21:53:27,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-14 21:53:27,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-14 21:53:27,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-14 21:53:27,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-14 21:53:27,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-14 21:53:27,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-14 21:53:27,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-14 21:53:27,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-14 21:53:27,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-14 21:53:27,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-14 21:53:27,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-14 21:53:27,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-14 21:53:27,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-14 21:53:27,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-14 21:53:27,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-14 21:53:27,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-14 21:53:27,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-14 21:53:27,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-14 21:53:27,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-14 21:53:27,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-14 21:53:27,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-14 21:53:27,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-14 21:53:27,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-14 21:53:27,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-14 21:53:27,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-14 21:53:27,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-14 21:53:27,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-14 21:53:27,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-14 21:53:27,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-14 21:53:27,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-14 21:53:27,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-14 21:53:27,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-14 21:53:27,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-14 21:53:27,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-14 21:53:27,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-14 21:53:27,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-14 21:53:27,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-14 21:53:27,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-14 21:53:27,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-14 21:53:27,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-14 21:53:27,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-14 21:53:27,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-14 21:53:27,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-14 21:53:27,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-14 21:53:27,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-14 21:53:27,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-14 21:53:27,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-14 21:53:27,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-14 21:53:27,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-14 21:53:27,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-14 21:53:27,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-14 21:53:27,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-14 21:53:27,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-14 21:53:27,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-14 21:53:27,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-14 21:53:27,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-14 21:53:27,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-14 21:53:27,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-14 21:53:27,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-14 21:53:27,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-14 21:53:27,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-14 21:53:27,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-14 21:53:27,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-14 21:53:27,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-14 21:53:27,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-14 21:53:27,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-14 21:53:27,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-14 21:53:27,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-14 21:53:27,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-14 21:53:27,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-14 21:53:27,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-14 21:53:27,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-14 21:53:27,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-14 21:53:27,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-14 21:53:27,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-14 21:53:27,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-14 21:53:27,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-14 21:53:27,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-14 21:53:27,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-14 21:53:27,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-14 21:53:27,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-14 21:53:27,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-14 21:53:27,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-14 21:53:27,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-14 21:53:27,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-14 21:53:27,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-14 21:53:27,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-14 21:53:27,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-14 21:53:27,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-14 21:53:27,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-14 21:53:27,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-14 21:53:27,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-14 21:53:27,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-14 21:53:27,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-14 21:53:27,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-14 21:53:27,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-14 21:53:27,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-14 21:53:27,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-14 21:53:27,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-14 21:53:27,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-14 21:53:27,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-14 21:53:28,118 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023657889226612876); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03290294539911509, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023657889226612876); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01275); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04691666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-14 21:53:28,118 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-14 21:53:28,119 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.015964377054677945, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023657889226612876); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03290294539911509, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023657889226612876); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01275); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04691666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-14 21:53:28,437 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 440 ms to try 5000 different iterations.  Found a solution that moves 1001 regions; Going from a computed imbalance of 0.015964377054677945 to a new imbalance of 8.405930663572214E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007452723339338097); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008876253645985944); MoveCostFunction : (multiplier=7.0, imbalance=0.11122222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007452723339338097); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00425); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-14 21:53:28,439 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1421421351:79 , srv262670194:82 , srv483431061:82 , srv679263523:82 , srv1073407549:83 , srv1090218745:83 , srv1546185743:83 , srv1552065187:83 , srv1659463144:83 , srv1929665424:83 , srv2034240034:83 , srv461849703:83 , srv957611806:83 , srv1007601328:84 , srv1131573398:84 , srv1323492389:84 , srv1405202798:84 , srv1468673061:84 , srv1526281802:84 , srv1536426589:84 , srv191477285:84 , srv1980129672:84 , srv298025083:84 , srv402688098:84 , srv525629498:84 , srv591993764:84 , srv635429677:84 , srv695850639:84 , srv7571120:84 , srv777973808:84 , srv935169156:84 , srv984184778:84 , srv1086428343:85 , srv1187438761:85 , srv1213570988:85 , srv1229243171:85 , srv1237955748:85 , srv1323288279:85 , srv1372037689:85 , srv1451489:85 , srv1529809645:85 , srv1627164440:85 , srv1790108365:85 , srv1848958430:85 , srv2080848818:85 , srv273898045:85 , srv273947199:85 , srv51710639:85 , srv594403304:85 , srv640679828:85 , srv965256793:85 , srv1183081900:86 , srv1395409022:86 , srv1442922516:86 , srv1523069478:86 , srv1582222127:86 , srv1615959392:86 , srv1867532075:86 , srv1907357750:86 , srv1946342744:86 , srv1979946191:86 , srv2031843255:86 , srv2037899700:86 , srv2094788727:86 , srv33095690:86 , srv675761352:86 , srv840607957:86 , srv983199003:86 , srv1312548174:87 , srv1429386664:87 , srv1509367214:87 , srv1515213881:87 , srv1647441853:87 , srv170105572:87 , srv1799171296:87 , srv1857080745:87 , srv194427499:87 , srv2046780448:87 , srv304446967:87 , srv305512299:87 , srv496886608:87 , srv677698479:87 , srv83069397:87 , srv851546687:87 , srv980760181:87 , srv1137902946:88 , srv1453778407:88 , srv1672010383:88 , srv1689365207:88 , srv1752589854:88 , srv1959334071:88 , srv2073634152:88 , srv363605588:88 , srv559665749:88 , srv64422739:88 , srv764162865:88 , srv1343895555:89 , srv1854429581:89 , srv493713785:90 , srv147473903:540 }
2023-05-14 21:53:28,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-14 21:53:28,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1752589854=41, srv1323492389=13, srv1790108365=42, srv525629498=77, srv677698479=85, srv1229243171=9, srv1429386664=19, srv1323288279=12, srv1546185743=31, srv2080848818=61, srv363605588=70, srv1237955748=10, srv273898045=64, srv51710639=76, srv851546687=93, srv840607957=92, srv679263523=86, srv1090218745=3, srv1343895555=14, srv1515213881=26, srv980760181=97, srv1980129672=55, srv194427499=51, srv591993764=79, srv1582222127=33, srv777973808=90, srv957611806=95, srv1867532075=47, srv1213570988=8, srv1946342744=52, srv1854429581=45, srv170105572=40, srv635429677=81, srv461849703=72, srv1405202798=17, srv2094788727=62, srv1131573398=4, srv2037899700=58, srv273947199=65, srv1672010383=38, srv1536426589=30, srv262670194=63, srv305512299=68, srv1929665424=50, srv7571120=88, srv83069397=91, srv1007601328=0, srv1907357750=48, srv1523069478=27, srv1659463144=37, srv1073407549=1, srv1627164440=35, srv2046780448=59, srv33095690=69, srv1137902946=5, srv2031843255=56, srv1529809645=29, srv935169156=94, srv402688098=71, srv1453778407=22, srv496886608=75, srv1689365207=39, srv1848958430=44, srv640679828=82, srv1086428343=2, srv1615959392=34, srv1372037689=15, srv304446967=67, srv764162865=89, srv1442922516=20, srv2073634152=60, srv1857080745=46, srv965256793=96, srv1959334071=53, srv298025083=66, srv1468673061=23, srv2034240034=57, srv64422739=83, srv594403304=80, srv1395409022=16, srv483431061=73, srv1421421351=18, srv1312548174=11, srv191477285=49, srv1979946191=54, srv984184778=99, srv1647441853=36, srv1799171296=43, srv1187438761=7, srv695850639=87, srv983199003=98, srv559665749=78, srv1526281802=28, srv1451489=21, srv147473903=24, srv1552065187=32, srv1509367214=25, srv675761352=84, srv493713785=74, srv1183081900=6} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-14 21:53:28,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-14 21:53:28,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-14 21:53:28,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-14 21:53:28,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-14 21:53:28,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-14 21:53:28,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-14 21:53:28,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-14 21:53:28,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-14 21:53:28,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-14 21:53:28,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-14 21:53:28,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-14 21:53:28,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-14 21:53:28,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-14 21:53:28,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-14 21:53:28,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-14 21:53:28,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-14 21:53:28,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-14 21:53:28,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-14 21:53:28,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-14 21:53:28,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-14 21:53:28,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-14 21:53:28,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-14 21:53:28,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-14 21:53:28,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-14 21:53:28,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-14 21:53:28,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-14 21:53:28,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-14 21:53:28,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-14 21:53:28,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-14 21:53:28,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-14 21:53:28,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-14 21:53:28,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-14 21:53:28,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-14 21:53:28,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-14 21:53:28,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-14 21:53:28,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-14 21:53:28,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-14 21:53:28,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-14 21:53:28,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-14 21:53:28,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-14 21:53:28,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-14 21:53:28,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-14 21:53:28,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-14 21:53:28,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-14 21:53:28,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-14 21:53:28,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-14 21:53:28,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-14 21:53:28,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-14 21:53:28,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-14 21:53:28,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-14 21:53:28,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-14 21:53:28,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-14 21:53:28,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-14 21:53:28,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-14 21:53:28,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-14 21:53:28,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-14 21:53:28,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-14 21:53:28,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-14 21:53:28,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-14 21:53:28,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-14 21:53:28,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-14 21:53:28,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-14 21:53:28,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-14 21:53:28,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-14 21:53:28,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-14 21:53:28,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-14 21:53:28,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-14 21:53:28,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-14 21:53:28,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-14 21:53:28,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-14 21:53:28,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-14 21:53:28,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-14 21:53:28,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-14 21:53:28,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-14 21:53:28,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-14 21:53:28,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-14 21:53:28,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-14 21:53:28,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-14 21:53:28,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-14 21:53:28,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-14 21:53:28,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-14 21:53:28,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-14 21:53:28,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-14 21:53:28,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-14 21:53:28,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-14 21:53:28,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-14 21:53:28,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-14 21:53:28,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-14 21:53:28,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-14 21:53:28,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-14 21:53:28,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-14 21:53:28,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-14 21:53:28,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-14 21:53:28,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-14 21:53:28,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-14 21:53:28,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-14 21:53:28,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-14 21:53:28,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-14 21:53:28,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-14 21:53:28,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-14 21:53:28,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-14 21:53:28,622 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007452723339338097); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008876253645985944); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007452723339338097); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00425); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-14 21:53:28,622 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-14 21:53:28,622 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=8.335839145476159E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007452723339338097); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008876253645985944); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007452723339338097); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00425); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-14 21:53:29,082 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 595 ms to try 5000 different iterations.  Found a solution that moves 274 regions; Going from a computed imbalance of 8.335839145476159E-4 to a new imbalance of 2.1206465927740457E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0021711298242630987); MoveCostFunction : (multiplier=7.0, imbalance=0.030444444444444444, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-14 21:53:29,083 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1536426589:83 , srv1582222127:83 , srv2073634152:83 , srv594403304:83 , srv935169156:83 , srv1187438761:84 , srv1237955748:84 , srv1343895555:84 , srv1421421351:84 , srv1453778407:84 , srv1468673061:84 , srv1515213881:84 , srv1546185743:84 , srv1659463144:84 , srv1672010383:84 , srv170105572:84 , srv1752589854:84 , srv1790108365:84 , srv1854429581:84 , srv1857080745:84 , srv1867532075:84 , srv191477285:84 , srv194427499:84 , srv1946342744:84 , srv1959334071:84 , srv2037899700:84 , srv2094788727:84 , srv298025083:84 , srv304446967:84 , srv363605588:84 , srv493713785:84 , srv51710639:84 , srv559665749:84 , srv635429677:84 , srv640679828:84 , srv64422739:84 , srv675761352:84 , srv679263523:84 , srv695850639:84 , srv764162865:84 , srv965256793:84 , srv983199003:84 , srv1007601328:85 , srv1086428343:85 , srv1090218745:85 , srv1131573398:85 , srv1137902946:85 , srv1183081900:85 , srv1229243171:85 , srv1312548174:85 , srv1323288279:85 , srv1372037689:85 , srv1395409022:85 , srv1405202798:85 , srv1442922516:85 , srv1451489:85 , srv1523069478:85 , srv1526281802:85 , srv1552065187:85 , srv1615959392:85 , srv1627164440:85 , srv1647441853:85 , srv1848958430:85 , srv1907357750:85 , srv1929665424:85 , srv1979946191:85 , srv1980129672:85 , srv2031843255:85 , srv2080848818:85 , srv262670194:85 , srv273898045:85 , srv273947199:85 , srv305512299:85 , srv33095690:85 , srv402688098:85 , srv496886608:85 , srv525629498:85 , srv677698479:85 , srv7571120:85 , srv777973808:85 , srv83069397:85 , srv840607957:85 , srv851546687:85 , srv980760181:85 , srv984184778:85 , srv1073407549:86 , srv1213570988:86 , srv1323492389:86 , srv1429386664:86 , srv1509367214:86 , srv1529809645:86 , srv1689365207:86 , srv1799171296:86 , srv2034240034:86 , srv2046780448:86 , srv461849703:86 , srv483431061:86 , srv591993764:86 , srv957611806:86 , srv147473903:618 }
2023-05-14 21:53:29,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-14 21:53:29,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1752589854=41, srv1323492389=13, srv1790108365=42, srv525629498=77, srv677698479=85, srv1229243171=9, srv1429386664=19, srv1323288279=12, srv1546185743=31, srv2080848818=61, srv363605588=70, srv1237955748=10, srv273898045=64, srv51710639=76, srv851546687=93, srv840607957=92, srv679263523=86, srv1090218745=3, srv1343895555=14, srv1515213881=26, srv980760181=97, srv1980129672=55, srv194427499=51, srv591993764=79, srv1582222127=33, srv777973808=90, srv957611806=95, srv1867532075=47, srv1213570988=8, srv1946342744=52, srv1854429581=45, srv170105572=40, srv635429677=81, srv461849703=72, srv1405202798=17, srv2094788727=62, srv1131573398=4, srv2037899700=58, srv273947199=65, srv1672010383=38, srv1536426589=30, srv262670194=63, srv305512299=68, srv1929665424=50, srv7571120=88, srv83069397=91, srv1007601328=0, srv1907357750=48, srv1523069478=27, srv1659463144=37, srv1073407549=1, srv1627164440=35, srv2046780448=59, srv33095690=69, srv1137902946=5, srv2031843255=56, srv1529809645=29, srv935169156=94, srv402688098=71, srv1453778407=22, srv496886608=75, srv1689365207=39, srv1848958430=44, srv640679828=82, srv1086428343=2, srv1615959392=34, srv1372037689=15, srv304446967=67, srv764162865=89, srv1442922516=20, srv2073634152=60, srv1857080745=46, srv965256793=96, srv1959334071=53, srv298025083=66, srv1468673061=23, srv2034240034=57, srv64422739=83, srv594403304=80, srv1395409022=16, srv483431061=73, srv1421421351=18, srv1312548174=11, srv191477285=49, srv1979946191=54, srv984184778=99, srv1647441853=36, srv1799171296=43, srv1187438761=7, srv695850639=87, srv983199003=98, srv559665749=78, srv1526281802=28, srv1451489=21, srv147473903=24, srv1552065187=32, srv1509367214=25, srv675761352=84, srv493713785=74, srv1183081900=6} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-14 21:53:29,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-14 21:53:29,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-14 21:53:29,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-14 21:53:29,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-14 21:53:29,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-14 21:53:29,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-14 21:53:29,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-14 21:53:29,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-14 21:53:29,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-14 21:53:29,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-14 21:53:29,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-14 21:53:29,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-14 21:53:29,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-14 21:53:29,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-14 21:53:29,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-14 21:53:29,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-14 21:53:29,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-14 21:53:29,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-14 21:53:29,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-14 21:53:29,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-14 21:53:29,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-14 21:53:29,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-14 21:53:29,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-14 21:53:29,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-14 21:53:29,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-14 21:53:29,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-14 21:53:29,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-14 21:53:29,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-14 21:53:29,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-14 21:53:29,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-14 21:53:29,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-14 21:53:29,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-14 21:53:29,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-14 21:53:29,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-14 21:53:29,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-14 21:53:29,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-14 21:53:29,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-14 21:53:29,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-14 21:53:29,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-14 21:53:29,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-14 21:53:29,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-14 21:53:29,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-14 21:53:29,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-14 21:53:29,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-14 21:53:29,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-14 21:53:29,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-14 21:53:29,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-14 21:53:29,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-14 21:53:29,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-14 21:53:29,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-14 21:53:29,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-14 21:53:29,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-14 21:53:29,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-14 21:53:29,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-14 21:53:29,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-14 21:53:29,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-14 21:53:29,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-14 21:53:29,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-14 21:53:29,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-14 21:53:29,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-14 21:53:29,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-14 21:53:29,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-14 21:53:29,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-14 21:53:29,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-14 21:53:29,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-14 21:53:29,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-14 21:53:29,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-14 21:53:29,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-14 21:53:29,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-14 21:53:29,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-14 21:53:29,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-14 21:53:29,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-14 21:53:29,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-14 21:53:29,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-14 21:53:29,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-14 21:53:29,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-14 21:53:29,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-14 21:53:29,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-14 21:53:29,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-14 21:53:29,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-14 21:53:29,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-14 21:53:29,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-14 21:53:29,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-14 21:53:29,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-14 21:53:29,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-14 21:53:29,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-14 21:53:29,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-14 21:53:29,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-14 21:53:29,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-14 21:53:29,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-14 21:53:29,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-14 21:53:29,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-14 21:53:29,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-14 21:53:29,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-14 21:53:29,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-14 21:53:29,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-14 21:53:29,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-14 21:53:29,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-14 21:53:29,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-14 21:53:29,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-14 21:53:29,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-14 21:53:29,268 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=1.9287876920915365E-5 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0021711298242630987); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-14 21:53:29,268 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1536426589:83 , srv1582222127:83 , srv2073634152:83 , srv594403304:83 , srv935169156:83 , srv1187438761:84 , srv1237955748:84 , srv1343895555:84 , srv1421421351:84 , srv1453778407:84 , srv1468673061:84 , srv1515213881:84 , srv1546185743:84 , srv1659463144:84 , srv1672010383:84 , srv170105572:84 , srv1752589854:84 , srv1790108365:84 , srv1854429581:84 , srv1857080745:84 , srv1867532075:84 , srv191477285:84 , srv194427499:84 , srv1946342744:84 , srv1959334071:84 , srv2037899700:84 , srv2094788727:84 , srv298025083:84 , srv304446967:84 , srv363605588:84 , srv493713785:84 , srv51710639:84 , srv559665749:84 , srv635429677:84 , srv640679828:84 , srv64422739:84 , srv675761352:84 , srv679263523:84 , srv695850639:84 , srv764162865:84 , srv965256793:84 , srv983199003:84 , srv1007601328:85 , srv1086428343:85 , srv1090218745:85 , srv1131573398:85 , srv1137902946:85 , srv1183081900:85 , srv1229243171:85 , srv1312548174:85 , srv1323288279:85 , srv1372037689:85 , srv1395409022:85 , srv1405202798:85 , srv1442922516:85 , srv1451489:85 , srv1523069478:85 , srv1526281802:85 , srv1552065187:85 , srv1615959392:85 , srv1627164440:85 , srv1647441853:85 , srv1848958430:85 , srv1907357750:85 , srv1929665424:85 , srv1979946191:85 , srv1980129672:85 , srv2031843255:85 , srv2080848818:85 , srv262670194:85 , srv273898045:85 , srv273947199:85 , srv305512299:85 , srv33095690:85 , srv402688098:85 , srv496886608:85 , srv525629498:85 , srv677698479:85 , srv7571120:85 , srv777973808:85 , srv83069397:85 , srv840607957:85 , srv851546687:85 , srv980760181:85 , srv984184778:85 , srv1073407549:86 , srv1213570988:86 , srv1323492389:86 , srv1429386664:86 , srv1509367214:86 , srv1529809645:86 , srv1689365207:86 , srv1799171296:86 , srv2034240034:86 , srv2046780448:86 , srv461849703:86 , srv483431061:86 , srv591993764:86 , srv957611806:86 , srv147473903:618 }
2023-05-14 21:53:29,316 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=264 (was 264), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=309 (was 309), ProcessCount=173 (was 173), AvailableMemoryMB=18255 (was 19057)
2023-05-14 21:53:29,325 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=264, MaxFileDescriptor=60000, SystemLoadAverage=309, ProcessCount=173, AvailableMemoryMB=18253
2023-05-14 21:53:29,326 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-05-14 21:53:29,327 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-05-14 21:53:29,340 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1050421805:84 , srv109158689:84 , srv1117730602:84 , srv1427896343:84 , srv1491585557:84 , srv1534208844:84 , srv1608960365:84 , srv1741564470:84 , srv178263272:84 , srv1783236689:84 , srv186493821:84 , srv1901664912:84 , srv1933703203:84 , srv2032116294:84 , srv259835130:84 , srv266581253:84 , srv323676855:84 , srv485660566:84 , srv508059840:84 , srv508243742:84 , srv513645513:84 , srv594542898:84 , srv670912119:84 , srv775653208:84 , srv811486351:84 , srv893672099:84 , srv988906868:84 , srv993864920:84 , srv997761908:84 , srv1133177078:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-05-14 21:53:29,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-14 21:53:29,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv178263272=9, srv2032116294=14, srv775653208=24, srv259835130=15, srv1933703203=13, srv1427896343=4, srv1608960365=7, srv594542898=22, srv508243742=20, srv997761908=29, srv811486351=25, srv1133177078=3, srv485660566=18, srv186493821=11, srv993864920=28, srv1741564470=8, srv988906868=27, srv1783236689=10, srv893672099=26, srv1901664912=12, srv508059840=19, srv109158689=1, srv266581253=16, srv1534208844=6, srv1050421805=0, srv1117730602=2, srv513645513=21, srv1491585557=5, srv323676855=17, srv670912119=23} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-14 21:53:29,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-14 21:53:29,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-14 21:53:29,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-14 21:53:29,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-14 21:53:29,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-14 21:53:29,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-14 21:53:29,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-14 21:53:29,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-14 21:53:29,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-14 21:53:29,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-14 21:53:29,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-14 21:53:29,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-14 21:53:29,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-14 21:53:29,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-14 21:53:29,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-14 21:53:29,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-14 21:53:29,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-14 21:53:29,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-14 21:53:29,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-14 21:53:29,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-14 21:53:29,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-14 21:53:29,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-14 21:53:29,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-14 21:53:29,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-14 21:53:29,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-14 21:53:29,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-14 21:53:29,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-14 21:53:29,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-14 21:53:29,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-14 21:53:29,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-14 21:53:29,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-05-14 21:53:29,381 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0768506584099746, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-14 21:53:29,381 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912435197179525, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0768506584099746, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-05-14 21:55:29,361 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6090202 different iterations.  Found a solution that moves 1847 regions; Going from a computed imbalance of 0.9912435197179525 to a new imbalance of 4.3109901406398434E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6840740740740741, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-14 21:55:29,369 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1050421805:90 , srv109158689:90 , srv1117730602:90 , srv1133177078:90 , srv1427896343:90 , srv1491585557:90 , srv1534208844:90 , srv1608960365:90 , srv1741564470:90 , srv178263272:90 , srv1783236689:90 , srv186493821:90 , srv1901664912:90 , srv1933703203:90 , srv2032116294:90 , srv259835130:90 , srv266581253:90 , srv323676855:90 , srv485660566:90 , srv508059840:90 , srv508243742:90 , srv513645513:90 , srv594542898:90 , srv670912119:90 , srv775653208:90 , srv811486351:90 , srv893672099:90 , srv988906868:90 , srv993864920:90 , srv997761908:90 }
2023-05-14 21:55:29,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-14 21:55:29,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv178263272=9, srv2032116294=14, srv775653208=24, srv259835130=15, srv1933703203=13, srv1427896343=4, srv1608960365=7, srv594542898=22, srv508243742=20, srv997761908=29, srv811486351=25, srv1133177078=3, srv485660566=18, srv186493821=11, srv993864920=28, srv1741564470=8, srv988906868=27, srv1783236689=10, srv893672099=26, srv1901664912=12, srv508059840=19, srv109158689=1, srv266581253=16, srv1534208844=6, srv1050421805=0, srv1117730602=2, srv513645513=21, srv1491585557=5, srv323676855=17, srv670912119=23} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-14 21:55:29,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-14 21:55:29,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-14 21:55:29,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-14 21:55:29,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-14 21:55:29,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-14 21:55:29,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-14 21:55:29,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-14 21:55:29,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-14 21:55:29,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-14 21:55:29,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-14 21:55:29,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-14 21:55:29,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-14 21:55:29,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-14 21:55:29,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-14 21:55:29,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-14 21:55:29,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-14 21:55:29,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-14 21:55:29,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-14 21:55:29,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-14 21:55:29,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-14 21:55:29,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-14 21:55:29,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-14 21:55:29,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-14 21:55:29,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-14 21:55:29,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-14 21:55:29,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-14 21:55:29,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-14 21:55:29,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-14 21:55:29,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-14 21:55:29,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-14 21:55:29,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-05-14 21:55:29,398 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-14 21:55:29,398 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1050421805:90 , srv109158689:90 , srv1117730602:90 , srv1133177078:90 , srv1427896343:90 , srv1491585557:90 , srv1534208844:90 , srv1608960365:90 , srv1741564470:90 , srv178263272:90 , srv1783236689:90 , srv186493821:90 , srv1901664912:90 , srv1933703203:90 , srv2032116294:90 , srv259835130:90 , srv266581253:90 , srv323676855:90 , srv485660566:90 , srv508059840:90 , srv508243742:90 , srv513645513:90 , srv594542898:90 , srv670912119:90 , srv775653208:90 , srv811486351:90 , srv893672099:90 , srv988906868:90 , srv993864920:90 , srv997761908:90 }
2023-05-14 21:55:29,416 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=264 (was 264), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=172 (was 309), ProcessCount=173 (was 173), AvailableMemoryMB=18125 (was 18253)