2023-04-25 04:55:39,907 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-04-25 04:55:40,322 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-04-25 04:55:40,457 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-04-25 04:55:40,538 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-25 04:55:40,548 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-04-25 04:55:40,564 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=405, ProcessCount=169, AvailableMemoryMB=5215
2023-04-25 04:55:40,567 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-25 04:55:40,568 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-04-25 04:55:40,742 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1010842467:84 , srv1081705302:84 , srv1086770598:84 , srv1096298398:84 , srv1117615496:84 , srv1117905234:84 , srv1133639173:84 , srv1144100525:84 , srv1154629288:84 , srv1171629530:84 , srv1193929542:84 , srv1218793562:84 , srv1248488765:84 , srv125085997:84 , srv1273757174:84 , srv1278291948:84 , srv1340905645:84 , srv1359496780:84 , srv13652617:84 , srv137422292:84 , srv1394540560:84 , srv1448221253:84 , srv1477606727:84 , srv1484627118:84 , srv150353936:84 , srv1552802014:84 , srv1557938736:84 , srv156238486:84 , srv1572593349:84 , srv157689894:84 , srv1625268011:84 , srv1645955048:84 , srv1666601491:84 , srv1682535063:84 , srv1692408823:84 , srv1704632879:84 , srv1715191367:84 , srv1721650258:84 , srv1745269825:84 , srv1749375261:84 , srv1775234645:84 , srv1776885671:84 , srv1796907393:84 , srv1835657592:84 , srv1843678222:84 , srv1869438308:84 , srv1915278873:84 , srv1926028155:84 , srv1940080111:84 , srv1946070906:84 , srv1999275780:84 , srv2018477881:84 , srv2037432872:84 , srv2079684663:84 , srv209062494:84 , srv2111435571:84 , srv253888036:84 , srv25492908:84 , srv278363974:84 , srv282562578:84 , srv299900963:84 , srv308077831:84 , srv315610018:84 , srv337905041:84 , srv489990581:84 , srv50919729:84 , srv518152863:84 , srv531361259:84 , srv552343664:84 , srv557296675:84 , srv578103808:84 , srv579314715:84 , srv580590059:84 , srv615442393:84 , srv662766778:84 , srv675939666:84 , srv687465260:84 , srv689990287:84 , srv697216213:84 , srv705455807:84 , srv722959235:84 , srv760334166:84 , srv76486026:84 , srv76658449:84 , srv787767882:84 , srv788145739:84 , srv795138146:84 , srv850108008:84 , srv865416462:84 , srv869507462:84 , srv874858812:84 , srv886482626:84 , srv896958127:84 , srv915792098:84 , srv950378070:84 , srv966242468:84 , srv974753713:84 , srv989934415:84 , srv995767815:84 , srv425194278:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-04-25 04:55:40,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-25 04:55:40,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv787767882=85, srv687465260=77, srv1926028155=47, srv1448221253=21, srv552343664=69, srv1692408823=34, srv675939666=76, srv995767815=99, srv209062494=54, srv1645955048=31, srv25492908=57, srv1171629530=9, srv299900963=60, srv337905041=63, srv2018477881=51, srv1144100525=7, srv974753713=97, srv795138146=87, srv950378070=95, srv137422292=19, srv788145739=86, srv1081705302=1, srv1117615496=4, srv76658449=84, srv1117905234=5, srv150353936=24, srv989934415=98, srv76486026=83, srv278363974=58, srv1625268011=30, srv489990581=65, srv13652617=18, srv1096298398=3, srv1704632879=35, srv308077831=61, srv518152863=67, srv1552802014=25, srv1940080111=48, srv315610018=62, srv869507462=90, srv157689894=29, srv760334166=82, srv1682535063=33, srv1666601491=32, srv253888036=56, srv705455807=80, srv850108008=88, srv1248488765=12, srv282562578=59, srv1193929542=10, srv1394540560=20, srv915792098=94, srv1086770598=2, srv1359496780=17, srv1721650258=37, srv1775234645=40, srv50919729=66, srv886482626=92, srv1796907393=42, srv580590059=73, srv1273757174=14, srv1154629288=8, srv1477606727=22, srv2111435571=55, srv1340905645=16, srv125085997=13, srv156238486=27, srv1946070906=49, srv1010842467=0, srv1133639173=6, srv966242468=96, srv615442393=74, srv865416462=89, srv1915278873=46, srv425194278=64, srv531361259=68, srv578103808=71, srv1715191367=36, srv1484627118=23, srv662766778=75, srv1843678222=44, srv1749375261=39, srv722959235=81, srv579314715=72, srv1999275780=50, srv2079684663=53, srv1572593349=28, srv1557938736=26, srv1776885671=41, srv1218793562=11, srv557296675=70, srv874858812=91, srv896958127=93, srv1835657592=43, srv689990287=78, srv1869438308=45, srv1278291948=15, srv1745269825=38, srv2037432872=52, srv697216213=79} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-25 04:55:40,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-25 04:55:40,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-25 04:55:40,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-25 04:55:40,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-25 04:55:40,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-25 04:55:40,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-25 04:55:40,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-25 04:55:40,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-25 04:55:40,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-25 04:55:40,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-25 04:55:40,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-25 04:55:40,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-25 04:55:40,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-25 04:55:40,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-25 04:55:40,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-25 04:55:40,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-25 04:55:40,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-25 04:55:40,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-25 04:55:40,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-25 04:55:40,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-25 04:55:40,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-25 04:55:40,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-25 04:55:40,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-25 04:55:40,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-25 04:55:40,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-25 04:55:40,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-25 04:55:40,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-25 04:55:40,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-25 04:55:40,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-25 04:55:40,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-25 04:55:40,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-25 04:55:40,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-25 04:55:40,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-25 04:55:40,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-25 04:55:40,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-25 04:55:40,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-25 04:55:40,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-25 04:55:40,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-25 04:55:40,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-25 04:55:40,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-25 04:55:40,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-25 04:55:40,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-25 04:55:40,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-25 04:55:40,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-25 04:55:40,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-25 04:55:40,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-25 04:55:40,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-25 04:55:40,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-25 04:55:40,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-25 04:55:40,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-25 04:55:40,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-25 04:55:40,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-25 04:55:40,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-25 04:55:40,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-25 04:55:40,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-25 04:55:40,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-25 04:55:40,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-25 04:55:40,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-25 04:55:40,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-25 04:55:40,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-25 04:55:40,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-25 04:55:40,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-25 04:55:40,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-25 04:55:40,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-25 04:55:40,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-25 04:55:40,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-25 04:55:40,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-25 04:55:40,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-25 04:55:40,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-25 04:55:40,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-25 04:55:40,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-25 04:55:40,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-25 04:55:40,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-25 04:55:40,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-25 04:55:40,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-25 04:55:40,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-25 04:55:40,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-25 04:55:40,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-25 04:55:40,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-25 04:55:40,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-25 04:55:40,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-25 04:55:40,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-25 04:55:40,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-25 04:55:40,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-25 04:55:40,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-25 04:55:40,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-25 04:55:40,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-25 04:55:40,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-25 04:55:40,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-25 04:55:40,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-25 04:55:40,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-25 04:55:40,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-25 04:55:40,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-25 04:55:40,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-25 04:55:40,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-25 04:55:40,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-25 04:55:40,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-25 04:55:40,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-25 04:55:40,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-25 04:55:40,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-25 04:55:40,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-25 04:55:41,199 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-25 04:55:41,199 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-25 04:55:41,200 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-25 04:55:42,085 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 1155 ms to try 5000 different iterations.  Found a solution that moves 4681 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18425785567622505. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03929862710744792, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.054288583335574465, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5201111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03929862710744792, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17925, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.249, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-25 04:55:42,106 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv156238486:82 , srv1572593349:82 , srv1117615496:83 , srv1359496780:83 , srv13652617:83 , srv1692408823:83 , srv315610018:83 , srv557296675:83 , srv687465260:83 , srv850108008:83 , srv1144100525:84 , srv1193929542:84 , srv1340905645:84 , srv1625268011:84 , srv1745269825:84 , srv1796907393:84 , srv1869438308:84 , srv1946070906:84 , srv578103808:84 , srv579314715:84 , srv615442393:84 , srv760334166:84 , srv76486026:84 , srv915792098:84 , srv1010842467:85 , srv1117905234:85 , srv1248488765:85 , srv125085997:85 , srv1278291948:85 , srv1484627118:85 , srv1552802014:85 , srv1557938736:85 , srv1682535063:85 , srv1721650258:85 , srv1749375261:85 , srv2111435571:85 , srv675939666:85 , srv788145739:85 , srv950378070:85 , srv966242468:85 , srv974753713:85 , srv1081705302:86 , srv1096298398:86 , srv1171629530:86 , srv1218793562:86 , srv150353936:86 , srv1715191367:86 , srv1775234645:86 , srv1915278873:86 , srv1926028155:86 , srv2079684663:86 , srv50919729:86 , srv531361259:86 , srv552343664:86 , srv689990287:86 , srv722959235:86 , srv787767882:86 , srv869507462:86 , srv989934415:86 , srv995767815:86 , srv1477606727:87 , srv157689894:87 , srv1666601491:87 , srv1835657592:87 , srv1999275780:87 , srv2018477881:87 , srv253888036:87 , srv25492908:87 , srv299900963:87 , srv337905041:87 , srv865416462:87 , srv886482626:87 , srv1394540560:88 , srv1704632879:88 , srv1843678222:88 , srv209062494:88 , srv278363974:88 , srv697216213:88 , srv705455807:88 , srv896958127:88 , srv1448221253:89 , srv1645955048:89 , srv1940080111:89 , srv518152863:89 , srv662766778:89 , srv76658449:89 , srv795138146:89 , srv1776885671:90 , srv2037432872:90 , srv874858812:90 , srv489990581:91 , srv580590059:91 , srv1133639173:92 , srv1154629288:92 , srv137422292:92 , srv282562578:92 , srv308077831:93 , srv1273757174:94 , srv1086770598:100 , srv425194278:439 }
2023-04-25 04:55:42,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-25 04:55:42,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv787767882=85, srv687465260=77, srv1926028155=47, srv1448221253=21, srv552343664=69, srv1692408823=34, srv675939666=76, srv995767815=99, srv209062494=54, srv1645955048=31, srv25492908=57, srv1171629530=9, srv299900963=60, srv337905041=63, srv2018477881=51, srv1144100525=7, srv974753713=97, srv795138146=87, srv950378070=95, srv137422292=19, srv788145739=86, srv1081705302=1, srv1117615496=4, srv76658449=84, srv1117905234=5, srv150353936=24, srv989934415=98, srv76486026=83, srv278363974=58, srv1625268011=30, srv489990581=65, srv13652617=18, srv1096298398=3, srv1704632879=35, srv308077831=61, srv518152863=67, srv1552802014=25, srv1940080111=48, srv315610018=62, srv869507462=90, srv157689894=29, srv760334166=82, srv1682535063=33, srv1666601491=32, srv253888036=56, srv705455807=80, srv850108008=88, srv1248488765=12, srv282562578=59, srv1193929542=10, srv1394540560=20, srv915792098=94, srv1086770598=2, srv1359496780=17, srv1721650258=37, srv1775234645=40, srv50919729=66, srv886482626=92, srv1796907393=42, srv580590059=73, srv1273757174=14, srv1154629288=8, srv1477606727=22, srv2111435571=55, srv1340905645=16, srv125085997=13, srv156238486=27, srv1946070906=49, srv1010842467=0, srv1133639173=6, srv966242468=96, srv615442393=74, srv865416462=89, srv1915278873=46, srv425194278=64, srv531361259=68, srv578103808=71, srv1715191367=36, srv1484627118=23, srv662766778=75, srv1843678222=44, srv1749375261=39, srv722959235=81, srv579314715=72, srv1999275780=50, srv2079684663=53, srv1572593349=28, srv1557938736=26, srv1776885671=41, srv1218793562=11, srv557296675=70, srv874858812=91, srv896958127=93, srv1835657592=43, srv689990287=78, srv1869438308=45, srv1278291948=15, srv1745269825=38, srv2037432872=52, srv697216213=79} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-25 04:55:42,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-25 04:55:42,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-25 04:55:42,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-25 04:55:42,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-25 04:55:42,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-25 04:55:42,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-25 04:55:42,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-25 04:55:42,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-25 04:55:42,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-25 04:55:42,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-25 04:55:42,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-25 04:55:42,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-25 04:55:42,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-25 04:55:42,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-25 04:55:42,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-25 04:55:42,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-25 04:55:42,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-25 04:55:42,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-25 04:55:42,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-25 04:55:42,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-25 04:55:42,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-25 04:55:42,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-25 04:55:42,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-25 04:55:42,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-25 04:55:42,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-25 04:55:42,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-25 04:55:42,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-25 04:55:42,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-25 04:55:42,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-25 04:55:42,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-25 04:55:42,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-25 04:55:42,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-25 04:55:42,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-25 04:55:42,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-25 04:55:42,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-25 04:55:42,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-25 04:55:42,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-25 04:55:42,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-25 04:55:42,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-25 04:55:42,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-25 04:55:42,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-25 04:55:42,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-25 04:55:42,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-25 04:55:42,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-25 04:55:42,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-25 04:55:42,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-25 04:55:42,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-25 04:55:42,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-25 04:55:42,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-25 04:55:42,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-25 04:55:42,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-25 04:55:42,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-25 04:55:42,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-25 04:55:42,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-25 04:55:42,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-25 04:55:42,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-25 04:55:42,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-25 04:55:42,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-25 04:55:42,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-25 04:55:42,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-25 04:55:42,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-25 04:55:42,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-25 04:55:42,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-25 04:55:42,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-25 04:55:42,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-25 04:55:42,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-25 04:55:42,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-25 04:55:42,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-25 04:55:42,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-25 04:55:42,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-25 04:55:42,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-25 04:55:42,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-25 04:55:42,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-25 04:55:42,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-25 04:55:42,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-25 04:55:42,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-25 04:55:42,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-25 04:55:42,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-25 04:55:42,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-25 04:55:42,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-25 04:55:42,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-25 04:55:42,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-25 04:55:42,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-25 04:55:42,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-25 04:55:42,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-25 04:55:42,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-25 04:55:42,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-25 04:55:42,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-25 04:55:42,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-25 04:55:42,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-25 04:55:42,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-25 04:55:42,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-25 04:55:42,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-25 04:55:42,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-25 04:55:42,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-25 04:55:42,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-25 04:55:42,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-25 04:55:42,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-25 04:55:42,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-25 04:55:42,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-25 04:55:42,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-25 04:55:42,370 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03929862710744792, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.054288583335574465, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03929862710744792, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17925, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.249, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-25 04:55:42,371 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-25 04:55:42,371 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18422507861366683, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03929862710744792, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.054288583335574465, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03929862710744792, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17925, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.249, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-25 04:55:42,783 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 591 ms to try 5000 different iterations.  Found a solution that moves 2681 regions; Going from a computed imbalance of 0.18422507861366683 to a new imbalance of 0.018313150343302536. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020155277011749965); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.034269677185680844, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29788888888888887, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020155277011749965); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01525); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04791666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-25 04:55:42,798 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1086770598:72 , srv1154629288:79 , srv1273757174:79 , srv1133639173:81 , srv1776885671:81 , srv282562578:81 , srv489990581:81 , srv76658449:81 , srv1394540560:82 , srv1448221253:82 , srv308077831:82 , srv137422292:83 , srv1477606727:83 , srv1940080111:83 , srv2037432872:83 , srv209062494:83 , srv299900963:83 , srv518152863:83 , srv580590059:83 , srv662766778:83 , srv697216213:83 , srv795138146:83 , srv896958127:83 , srv150353936:84 , srv1915278873:84 , srv1926028155:84 , srv253888036:84 , srv552343664:84 , srv886482626:84 , srv1081705302:85 , srv1096298398:85 , srv125085997:85 , srv1278291948:85 , srv157689894:85 , srv1682535063:85 , srv1704632879:85 , srv1749375261:85 , srv1999275780:85 , srv865416462:85 , srv874858812:85 , srv989934415:85 , srv995767815:85 , srv1117905234:86 , srv1171629530:86 , srv1484627118:86 , srv1715191367:86 , srv1775234645:86 , srv1835657592:86 , srv1843678222:86 , srv1946070906:86 , srv2018477881:86 , srv2111435571:86 , srv278363974:86 , srv689990287:86 , srv722959235:86 , srv787767882:86 , srv974753713:86 , srv1218793562:87 , srv1552802014:87 , srv1645955048:87 , srv1666601491:87 , srv1745269825:87 , srv1869438308:87 , srv2079684663:87 , srv25492908:87 , srv337905041:87 , srv531361259:87 , srv615442393:87 , srv1010842467:88 , srv1144100525:88 , srv1248488765:88 , srv1557938736:88 , srv1625268011:88 , srv1796907393:88 , srv557296675:88 , srv687465260:88 , srv705455807:88 , srv760334166:88 , srv76486026:88 , srv788145739:88 , srv950378070:88 , srv966242468:88 , srv1193929542:89 , srv1340905645:89 , srv13652617:89 , srv156238486:89 , srv1721650258:89 , srv315610018:89 , srv50919729:89 , srv578103808:89 , srv579314715:89 , srv675939666:89 , srv869507462:89 , srv1117615496:90 , srv1359496780:90 , srv1692408823:90 , srv915792098:90 , srv1572593349:91 , srv850108008:91 , srv425194278:514 }
2023-04-25 04:55:42,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-25 04:55:42,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv787767882=85, srv687465260=77, srv1926028155=47, srv1448221253=21, srv552343664=69, srv1692408823=34, srv675939666=76, srv995767815=99, srv209062494=54, srv1645955048=31, srv25492908=57, srv1171629530=9, srv299900963=60, srv337905041=63, srv2018477881=51, srv1144100525=7, srv974753713=97, srv795138146=87, srv950378070=95, srv137422292=19, srv788145739=86, srv1081705302=1, srv1117615496=4, srv76658449=84, srv1117905234=5, srv150353936=24, srv989934415=98, srv76486026=83, srv278363974=58, srv1625268011=30, srv489990581=65, srv13652617=18, srv1096298398=3, srv1704632879=35, srv308077831=61, srv518152863=67, srv1552802014=25, srv1940080111=48, srv315610018=62, srv869507462=90, srv157689894=29, srv760334166=82, srv1682535063=33, srv1666601491=32, srv253888036=56, srv705455807=80, srv850108008=88, srv1248488765=12, srv282562578=59, srv1193929542=10, srv1394540560=20, srv915792098=94, srv1086770598=2, srv1359496780=17, srv1721650258=37, srv1775234645=40, srv50919729=66, srv886482626=92, srv1796907393=42, srv580590059=73, srv1273757174=14, srv1154629288=8, srv1477606727=22, srv2111435571=55, srv1340905645=16, srv125085997=13, srv156238486=27, srv1946070906=49, srv1010842467=0, srv1133639173=6, srv966242468=96, srv615442393=74, srv865416462=89, srv1915278873=46, srv425194278=64, srv531361259=68, srv578103808=71, srv1715191367=36, srv1484627118=23, srv662766778=75, srv1843678222=44, srv1749375261=39, srv722959235=81, srv579314715=72, srv1999275780=50, srv2079684663=53, srv1572593349=28, srv1557938736=26, srv1776885671=41, srv1218793562=11, srv557296675=70, srv874858812=91, srv896958127=93, srv1835657592=43, srv689990287=78, srv1869438308=45, srv1278291948=15, srv1745269825=38, srv2037432872=52, srv697216213=79} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-25 04:55:42,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-25 04:55:42,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-25 04:55:42,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-25 04:55:42,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-25 04:55:42,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-25 04:55:42,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-25 04:55:42,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-25 04:55:42,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-25 04:55:42,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-25 04:55:42,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-25 04:55:42,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-25 04:55:42,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-25 04:55:42,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-25 04:55:42,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-25 04:55:42,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-25 04:55:42,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-25 04:55:42,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-25 04:55:42,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-25 04:55:42,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-25 04:55:42,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-25 04:55:42,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-25 04:55:42,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-25 04:55:42,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-25 04:55:42,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-25 04:55:42,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-25 04:55:42,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-25 04:55:42,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-25 04:55:42,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-25 04:55:42,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-25 04:55:42,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-25 04:55:42,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-25 04:55:42,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-25 04:55:42,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-25 04:55:42,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-25 04:55:42,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-25 04:55:42,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-25 04:55:42,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-25 04:55:42,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-25 04:55:42,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-25 04:55:42,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-25 04:55:42,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-25 04:55:42,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-25 04:55:42,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-25 04:55:42,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-25 04:55:42,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-25 04:55:42,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-25 04:55:42,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-25 04:55:42,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-25 04:55:42,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-25 04:55:42,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-25 04:55:42,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-25 04:55:42,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-25 04:55:42,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-25 04:55:42,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-25 04:55:42,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-25 04:55:42,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-25 04:55:42,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-25 04:55:42,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-25 04:55:42,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-25 04:55:42,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-25 04:55:42,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-25 04:55:42,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-25 04:55:42,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-25 04:55:42,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-25 04:55:42,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-25 04:55:42,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-25 04:55:42,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-25 04:55:42,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-25 04:55:42,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-25 04:55:42,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-25 04:55:42,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-25 04:55:42,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-25 04:55:42,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-25 04:55:42,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-25 04:55:42,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-25 04:55:42,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-25 04:55:42,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-25 04:55:42,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-25 04:55:42,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-25 04:55:42,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-25 04:55:42,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-25 04:55:42,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-25 04:55:42,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-25 04:55:42,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-25 04:55:42,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-25 04:55:42,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-25 04:55:42,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-25 04:55:42,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-25 04:55:42,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-25 04:55:42,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-25 04:55:42,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-25 04:55:42,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-25 04:55:42,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-25 04:55:42,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-25 04:55:42,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-25 04:55:42,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-25 04:55:42,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-25 04:55:42,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-25 04:55:42,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-25 04:55:42,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-25 04:55:42,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-25 04:55:42,992 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020155277011749965); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.034269677185680844, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020155277011749965); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01525); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04791666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-25 04:55:42,993 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-25 04:55:42,993 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.01829437758006422, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020155277011749965); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.034269677185680844, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020155277011749965); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01525); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04791666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-25 04:55:43,292 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 426 ms to try 5000 different iterations.  Found a solution that moves 1026 regions; Going from a computed imbalance of 0.01829437758006422 to a new imbalance of 5.910895886109944E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005759446011241319); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008554309236258637); MoveCostFunction : (multiplier=7.0, imbalance=0.114, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005759446011241319); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004083333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-25 04:55:43,294 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1645955048:82 , srv705455807:82 , srv1666601491:83 , srv1721650258:83 , srv1843678222:83 , srv308077831:83 , srv337905041:83 , srv580590059:83 , srv675939666:83 , srv850108008:83 , srv869507462:83 , srv874858812:83 , srv1010842467:84 , srv1117615496:84 , srv1193929542:84 , srv1248488765:84 , srv1273757174:84 , srv1359496780:84 , srv137422292:84 , srv1572593349:84 , srv1835657592:84 , srv2037432872:84 , srv2079684663:84 , srv25492908:84 , srv282562578:84 , srv50919729:84 , srv531361259:84 , srv579314715:84 , srv915792098:84 , srv950378070:84 , srv966242468:84 , srv1086770598:85 , srv1133639173:85 , srv1144100525:85 , srv1171629530:85 , srv1340905645:85 , srv1557938736:85 , srv1692408823:85 , srv1704632879:85 , srv1775234645:85 , srv1796907393:85 , srv1940080111:85 , srv1999275780:85 , srv2018477881:85 , srv278363974:85 , srv578103808:85 , srv662766778:85 , srv722959235:85 , srv787767882:85 , srv788145739:85 , srv1081705302:86 , srv1117905234:86 , srv1154629288:86 , srv1218793562:86 , srv13652617:86 , srv1484627118:86 , srv1552802014:86 , srv157689894:86 , srv1625268011:86 , srv1715191367:86 , srv1776885671:86 , srv253888036:86 , srv315610018:86 , srv489990581:86 , srv518152863:86 , srv557296675:86 , srv615442393:86 , srv687465260:86 , srv689990287:86 , srv697216213:86 , srv760334166:86 , srv76486026:86 , srv795138146:86 , srv865416462:86 , srv886482626:86 , srv896958127:86 , srv995767815:86 , srv1096298398:87 , srv125085997:87 , srv1278291948:87 , srv1394540560:87 , srv1448221253:87 , srv1477606727:87 , srv150353936:87 , srv156238486:87 , srv1682535063:87 , srv1745269825:87 , srv1869438308:87 , srv1915278873:87 , srv1926028155:87 , srv1946070906:87 , srv209062494:87 , srv2111435571:87 , srv299900963:87 , srv974753713:87 , srv989934415:87 , srv1749375261:88 , srv552343664:88 , srv76658449:88 , srv425194278:556 }
2023-04-25 04:55:43,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-25 04:55:43,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv787767882=85, srv687465260=77, srv1926028155=47, srv1448221253=21, srv552343664=69, srv1692408823=34, srv675939666=76, srv995767815=99, srv209062494=54, srv1645955048=31, srv25492908=57, srv1171629530=9, srv299900963=60, srv337905041=63, srv2018477881=51, srv1144100525=7, srv974753713=97, srv795138146=87, srv950378070=95, srv137422292=19, srv788145739=86, srv1081705302=1, srv1117615496=4, srv76658449=84, srv1117905234=5, srv150353936=24, srv989934415=98, srv76486026=83, srv278363974=58, srv1625268011=30, srv489990581=65, srv13652617=18, srv1096298398=3, srv1704632879=35, srv308077831=61, srv518152863=67, srv1552802014=25, srv1940080111=48, srv315610018=62, srv869507462=90, srv157689894=29, srv760334166=82, srv1682535063=33, srv1666601491=32, srv253888036=56, srv705455807=80, srv850108008=88, srv1248488765=12, srv282562578=59, srv1193929542=10, srv1394540560=20, srv915792098=94, srv1086770598=2, srv1359496780=17, srv1721650258=37, srv1775234645=40, srv50919729=66, srv886482626=92, srv1796907393=42, srv580590059=73, srv1273757174=14, srv1154629288=8, srv1477606727=22, srv2111435571=55, srv1340905645=16, srv125085997=13, srv156238486=27, srv1946070906=49, srv1010842467=0, srv1133639173=6, srv966242468=96, srv615442393=74, srv865416462=89, srv1915278873=46, srv425194278=64, srv531361259=68, srv578103808=71, srv1715191367=36, srv1484627118=23, srv662766778=75, srv1843678222=44, srv1749375261=39, srv722959235=81, srv579314715=72, srv1999275780=50, srv2079684663=53, srv1572593349=28, srv1557938736=26, srv1776885671=41, srv1218793562=11, srv557296675=70, srv874858812=91, srv896958127=93, srv1835657592=43, srv689990287=78, srv1869438308=45, srv1278291948=15, srv1745269825=38, srv2037432872=52, srv697216213=79} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-25 04:55:43,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-25 04:55:43,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-25 04:55:43,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-25 04:55:43,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-25 04:55:43,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-25 04:55:43,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-25 04:55:43,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-25 04:55:43,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-25 04:55:43,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-25 04:55:43,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-25 04:55:43,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-25 04:55:43,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-25 04:55:43,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-25 04:55:43,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-25 04:55:43,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-25 04:55:43,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-25 04:55:43,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-25 04:55:43,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-25 04:55:43,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-25 04:55:43,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-25 04:55:43,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-25 04:55:43,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-25 04:55:43,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-25 04:55:43,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-25 04:55:43,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-25 04:55:43,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-25 04:55:43,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-25 04:55:43,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-25 04:55:43,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-25 04:55:43,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-25 04:55:43,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-25 04:55:43,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-25 04:55:43,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-25 04:55:43,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-25 04:55:43,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-25 04:55:43,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-25 04:55:43,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-25 04:55:43,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-25 04:55:43,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-25 04:55:43,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-25 04:55:43,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-25 04:55:43,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-25 04:55:43,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-25 04:55:43,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-25 04:55:43,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-25 04:55:43,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-25 04:55:43,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-25 04:55:43,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-25 04:55:43,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-25 04:55:43,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-25 04:55:43,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-25 04:55:43,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-25 04:55:43,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-25 04:55:43,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-25 04:55:43,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-25 04:55:43,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-25 04:55:43,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-25 04:55:43,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-25 04:55:43,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-25 04:55:43,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-25 04:55:43,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-25 04:55:43,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-25 04:55:43,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-25 04:55:43,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-25 04:55:43,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-25 04:55:43,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-25 04:55:43,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-25 04:55:43,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-25 04:55:43,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-25 04:55:43,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-25 04:55:43,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-25 04:55:43,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-25 04:55:43,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-25 04:55:43,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-25 04:55:43,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-25 04:55:43,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-25 04:55:43,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-25 04:55:43,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-25 04:55:43,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-25 04:55:43,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-25 04:55:43,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-25 04:55:43,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-25 04:55:43,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-25 04:55:43,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-25 04:55:43,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-25 04:55:43,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-25 04:55:43,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-25 04:55:43,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-25 04:55:43,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-25 04:55:43,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-25 04:55:43,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-25 04:55:43,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-25 04:55:43,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-25 04:55:43,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-25 04:55:43,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-25 04:55:43,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-25 04:55:43,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-25 04:55:43,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-25 04:55:43,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-25 04:55:43,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-25 04:55:43,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-25 04:55:43,445 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005759446011241319); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008554309236258637); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005759446011241319); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004083333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-25 04:55:43,445 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-25 04:55:43,446 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=5.839053830598902E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005759446011241319); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008554309236258637); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005759446011241319); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004083333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-25 04:55:43,831 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 492 ms to try 5000 different iterations.  Found a solution that moves 253 regions; Going from a computed imbalance of 5.839053830598902E-4 to a new imbalance of 2.6899117186149816E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.02811111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-25 04:55:43,832 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1218793562:83 , srv137422292:83 , srv278363974:83 , srv1096298398:84 , srv1133639173:84 , srv1248488765:84 , srv1340905645:84 , srv13652617:84 , srv1448221253:84 , srv1552802014:84 , srv1557938736:84 , srv156238486:84 , srv157689894:84 , srv1625268011:84 , srv1692408823:84 , srv1704632879:84 , srv1715191367:84 , srv1745269825:84 , srv1749375261:84 , srv1775234645:84 , srv1869438308:84 , srv2018477881:84 , srv209062494:84 , srv25492908:84 , srv315610018:84 , srv489990581:84 , srv50919729:84 , srv518152863:84 , srv552343664:84 , srv557296675:84 , srv578103808:84 , srv579314715:84 , srv675939666:84 , srv689990287:84 , srv705455807:84 , srv760334166:84 , srv76486026:84 , srv76658449:84 , srv788145739:84 , srv795138146:84 , srv865416462:84 , srv869507462:84 , srv874858812:84 , srv915792098:84 , srv966242468:84 , srv974753713:84 , srv989934415:84 , srv1010842467:85 , srv1081705302:85 , srv1086770598:85 , srv1117615496:85 , srv1117905234:85 , srv1144100525:85 , srv1154629288:85 , srv1171629530:85 , srv1193929542:85 , srv125085997:85 , srv1273757174:85 , srv1278291948:85 , srv1359496780:85 , srv1394540560:85 , srv1477606727:85 , srv1484627118:85 , srv150353936:85 , srv1572593349:85 , srv1645955048:85 , srv1666601491:85 , srv1682535063:85 , srv1721650258:85 , srv1776885671:85 , srv1796907393:85 , srv1835657592:85 , srv1843678222:85 , srv1915278873:85 , srv1926028155:85 , srv1940080111:85 , srv1946070906:85 , srv1999275780:85 , srv2037432872:85 , srv2079684663:85 , srv2111435571:85 , srv253888036:85 , srv282562578:85 , srv299900963:85 , srv308077831:85 , srv531361259:85 , srv580590059:85 , srv615442393:85 , srv662766778:85 , srv687465260:85 , srv697216213:85 , srv722959235:85 , srv787767882:85 , srv850108008:85 , srv886482626:85 , srv896958127:85 , srv950378070:85 , srv337905041:86 , srv995767815:86 , srv425194278:633 }
2023-04-25 04:55:43,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-25 04:55:43,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv787767882=85, srv687465260=77, srv1926028155=47, srv1448221253=21, srv552343664=69, srv1692408823=34, srv675939666=76, srv995767815=99, srv209062494=54, srv1645955048=31, srv25492908=57, srv1171629530=9, srv299900963=60, srv337905041=63, srv2018477881=51, srv1144100525=7, srv974753713=97, srv795138146=87, srv950378070=95, srv137422292=19, srv788145739=86, srv1081705302=1, srv1117615496=4, srv76658449=84, srv1117905234=5, srv150353936=24, srv989934415=98, srv76486026=83, srv278363974=58, srv1625268011=30, srv489990581=65, srv13652617=18, srv1096298398=3, srv1704632879=35, srv308077831=61, srv518152863=67, srv1552802014=25, srv1940080111=48, srv315610018=62, srv869507462=90, srv157689894=29, srv760334166=82, srv1682535063=33, srv1666601491=32, srv253888036=56, srv705455807=80, srv850108008=88, srv1248488765=12, srv282562578=59, srv1193929542=10, srv1394540560=20, srv915792098=94, srv1086770598=2, srv1359496780=17, srv1721650258=37, srv1775234645=40, srv50919729=66, srv886482626=92, srv1796907393=42, srv580590059=73, srv1273757174=14, srv1154629288=8, srv1477606727=22, srv2111435571=55, srv1340905645=16, srv125085997=13, srv156238486=27, srv1946070906=49, srv1010842467=0, srv1133639173=6, srv966242468=96, srv615442393=74, srv865416462=89, srv1915278873=46, srv425194278=64, srv531361259=68, srv578103808=71, srv1715191367=36, srv1484627118=23, srv662766778=75, srv1843678222=44, srv1749375261=39, srv722959235=81, srv579314715=72, srv1999275780=50, srv2079684663=53, srv1572593349=28, srv1557938736=26, srv1776885671=41, srv1218793562=11, srv557296675=70, srv874858812=91, srv896958127=93, srv1835657592=43, srv689990287=78, srv1869438308=45, srv1278291948=15, srv1745269825=38, srv2037432872=52, srv697216213=79} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-25 04:55:43,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-25 04:55:43,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-25 04:55:43,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-25 04:55:43,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-25 04:55:43,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-25 04:55:43,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-25 04:55:43,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-25 04:55:43,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-25 04:55:43,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-25 04:55:43,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-25 04:55:43,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-25 04:55:43,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-25 04:55:43,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-25 04:55:43,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-25 04:55:43,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-25 04:55:43,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-25 04:55:43,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-25 04:55:43,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-25 04:55:43,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-25 04:55:43,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-25 04:55:43,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-25 04:55:43,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-25 04:55:43,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-25 04:55:43,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-25 04:55:43,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-25 04:55:43,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-25 04:55:43,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-25 04:55:43,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-25 04:55:43,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-25 04:55:43,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-25 04:55:43,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-25 04:55:43,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-25 04:55:43,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-25 04:55:43,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-25 04:55:43,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-25 04:55:43,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-25 04:55:43,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-25 04:55:43,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-25 04:55:43,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-25 04:55:43,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-25 04:55:43,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-25 04:55:43,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-25 04:55:43,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-25 04:55:43,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-25 04:55:43,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-25 04:55:43,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-25 04:55:43,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-25 04:55:43,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-25 04:55:43,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-25 04:55:43,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-25 04:55:43,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-25 04:55:43,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-25 04:55:43,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-25 04:55:43,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-25 04:55:43,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-25 04:55:43,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-25 04:55:43,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-25 04:55:43,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-25 04:55:43,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-25 04:55:43,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-25 04:55:43,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-25 04:55:43,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-25 04:55:43,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-25 04:55:43,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-25 04:55:43,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-25 04:55:43,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-25 04:55:43,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-25 04:55:43,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-25 04:55:43,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-25 04:55:43,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-25 04:55:43,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-25 04:55:43,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-25 04:55:43,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-25 04:55:43,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-25 04:55:43,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-25 04:55:43,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-25 04:55:43,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-25 04:55:43,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-25 04:55:43,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-25 04:55:43,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-25 04:55:43,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-25 04:55:43,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-25 04:55:43,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-25 04:55:43,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-25 04:55:43,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-25 04:55:43,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-25 04:55:43,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-25 04:55:43,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-25 04:55:43,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-25 04:55:43,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-25 04:55:43,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-25 04:55:43,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-25 04:55:43,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-25 04:55:43,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-25 04:55:43,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-25 04:55:43,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-25 04:55:43,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-25 04:55:43,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-25 04:55:43,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-25 04:55:43,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-25 04:55:43,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-25 04:55:43,993 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-25 04:55:43,993 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-25 04:55:43,994 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.5127573322183584E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-25 04:55:44,231 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 351 ms to try 5000 different iterations.  Found a solution that moves 18 regions; Going from a computed imbalance of 2.5127573322183584E-5 to a new imbalance of 7.51379619419158E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0016412198797244363); MoveCostFunction : (multiplier=7.0, imbalance=0.002); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-25 04:55:44,232 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1645955048:83 , srv2111435571:83 , srv308077831:83 , srv337905041:83 , srv50919729:83 , srv995767815:83 , srv1010842467:84 , srv1081705302:84 , srv1086770598:84 , srv1096298398:84 , srv1117615496:84 , srv1117905234:84 , srv1133639173:84 , srv1144100525:84 , srv1154629288:84 , srv1171629530:84 , srv1193929542:84 , srv1218793562:84 , srv125085997:84 , srv1273757174:84 , srv1278291948:84 , srv1340905645:84 , srv1359496780:84 , srv13652617:84 , srv137422292:84 , srv1394540560:84 , srv1448221253:84 , srv1477606727:84 , srv1484627118:84 , srv150353936:84 , srv1552802014:84 , srv1557938736:84 , srv156238486:84 , srv1572593349:84 , srv157689894:84 , srv1625268011:84 , srv1666601491:84 , srv1682535063:84 , srv1692408823:84 , srv1704632879:84 , srv1715191367:84 , srv1721650258:84 , srv1745269825:84 , srv1749375261:84 , srv1776885671:84 , srv1796907393:84 , srv1835657592:84 , srv1843678222:84 , srv1869438308:84 , srv1915278873:84 , srv1926028155:84 , srv1940080111:84 , srv1946070906:84 , srv1999275780:84 , srv2018477881:84 , srv2037432872:84 , srv2079684663:84 , srv209062494:84 , srv253888036:84 , srv25492908:84 , srv278363974:84 , srv282562578:84 , srv299900963:84 , srv315610018:84 , srv489990581:84 , srv518152863:84 , srv531361259:84 , srv552343664:84 , srv578103808:84 , srv580590059:84 , srv615442393:84 , srv662766778:84 , srv687465260:84 , srv689990287:84 , srv697216213:84 , srv705455807:84 , srv722959235:84 , srv760334166:84 , srv76486026:84 , srv76658449:84 , srv787767882:84 , srv788145739:84 , srv795138146:84 , srv850108008:84 , srv865416462:84 , srv869507462:84 , srv874858812:84 , srv886482626:84 , srv896958127:84 , srv915792098:84 , srv950378070:84 , srv974753713:84 , srv989934415:84 , srv1248488765:85 , srv1775234645:85 , srv557296675:85 , srv579314715:85 , srv675939666:85 , srv966242468:85 , srv425194278:684 }
2023-04-25 04:55:44,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-25 04:55:44,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv787767882=85, srv687465260=77, srv1926028155=47, srv1448221253=21, srv552343664=69, srv1692408823=34, srv675939666=76, srv995767815=99, srv209062494=54, srv1645955048=31, srv25492908=57, srv1171629530=9, srv299900963=60, srv337905041=63, srv2018477881=51, srv1144100525=7, srv974753713=97, srv795138146=87, srv950378070=95, srv137422292=19, srv788145739=86, srv1081705302=1, srv1117615496=4, srv76658449=84, srv1117905234=5, srv150353936=24, srv989934415=98, srv76486026=83, srv278363974=58, srv1625268011=30, srv489990581=65, srv13652617=18, srv1096298398=3, srv1704632879=35, srv308077831=61, srv518152863=67, srv1552802014=25, srv1940080111=48, srv315610018=62, srv869507462=90, srv157689894=29, srv760334166=82, srv1682535063=33, srv1666601491=32, srv253888036=56, srv705455807=80, srv850108008=88, srv1248488765=12, srv282562578=59, srv1193929542=10, srv1394540560=20, srv915792098=94, srv1086770598=2, srv1359496780=17, srv1721650258=37, srv1775234645=40, srv50919729=66, srv886482626=92, srv1796907393=42, srv580590059=73, srv1273757174=14, srv1154629288=8, srv1477606727=22, srv2111435571=55, srv1340905645=16, srv125085997=13, srv156238486=27, srv1946070906=49, srv1010842467=0, srv1133639173=6, srv966242468=96, srv615442393=74, srv865416462=89, srv1915278873=46, srv425194278=64, srv531361259=68, srv578103808=71, srv1715191367=36, srv1484627118=23, srv662766778=75, srv1843678222=44, srv1749375261=39, srv722959235=81, srv579314715=72, srv1999275780=50, srv2079684663=53, srv1572593349=28, srv1557938736=26, srv1776885671=41, srv1218793562=11, srv557296675=70, srv874858812=91, srv896958127=93, srv1835657592=43, srv689990287=78, srv1869438308=45, srv1278291948=15, srv1745269825=38, srv2037432872=52, srv697216213=79} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-25 04:55:44,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-25 04:55:44,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-25 04:55:44,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-25 04:55:44,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-25 04:55:44,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-25 04:55:44,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-25 04:55:44,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-25 04:55:44,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-25 04:55:44,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-25 04:55:44,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-25 04:55:44,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-25 04:55:44,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-25 04:55:44,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-25 04:55:44,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-25 04:55:44,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-25 04:55:44,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-25 04:55:44,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-25 04:55:44,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-25 04:55:44,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-25 04:55:44,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-25 04:55:44,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-25 04:55:44,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-25 04:55:44,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-25 04:55:44,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-25 04:55:44,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-25 04:55:44,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-25 04:55:44,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-25 04:55:44,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-25 04:55:44,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-25 04:55:44,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-25 04:55:44,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-25 04:55:44,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-25 04:55:44,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-25 04:55:44,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-25 04:55:44,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-25 04:55:44,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-25 04:55:44,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-25 04:55:44,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-25 04:55:44,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-25 04:55:44,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-25 04:55:44,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-25 04:55:44,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-25 04:55:44,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-25 04:55:44,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-25 04:55:44,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-25 04:55:44,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-25 04:55:44,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-25 04:55:44,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-25 04:55:44,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-25 04:55:44,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-25 04:55:44,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-25 04:55:44,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-25 04:55:44,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-25 04:55:44,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-25 04:55:44,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-25 04:55:44,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-25 04:55:44,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-25 04:55:44,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-25 04:55:44,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-25 04:55:44,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-25 04:55:44,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-25 04:55:44,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-25 04:55:44,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-25 04:55:44,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-25 04:55:44,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-25 04:55:44,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-25 04:55:44,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-25 04:55:44,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-25 04:55:44,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-25 04:55:44,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-25 04:55:44,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-25 04:55:44,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-25 04:55:44,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-25 04:55:44,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-25 04:55:44,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-25 04:55:44,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-25 04:55:44,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-25 04:55:44,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-25 04:55:44,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-25 04:55:44,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-25 04:55:44,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-25 04:55:44,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-25 04:55:44,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-25 04:55:44,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-25 04:55:44,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-25 04:55:44,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-25 04:55:44,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-25 04:55:44,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-25 04:55:44,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-25 04:55:44,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-25 04:55:44,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-25 04:55:44,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-25 04:55:44,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-25 04:55:44,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-25 04:55:44,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-25 04:55:44,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-25 04:55:44,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-25 04:55:44,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-25 04:55:44,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-25 04:55:44,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-25 04:55:44,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-25 04:55:44,408 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.387757500312559E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0016412198797244363); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-25 04:55:44,409 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1645955048:83 , srv2111435571:83 , srv308077831:83 , srv337905041:83 , srv50919729:83 , srv995767815:83 , srv1010842467:84 , srv1081705302:84 , srv1086770598:84 , srv1096298398:84 , srv1117615496:84 , srv1117905234:84 , srv1133639173:84 , srv1144100525:84 , srv1154629288:84 , srv1171629530:84 , srv1193929542:84 , srv1218793562:84 , srv125085997:84 , srv1273757174:84 , srv1278291948:84 , srv1340905645:84 , srv1359496780:84 , srv13652617:84 , srv137422292:84 , srv1394540560:84 , srv1448221253:84 , srv1477606727:84 , srv1484627118:84 , srv150353936:84 , srv1552802014:84 , srv1557938736:84 , srv156238486:84 , srv1572593349:84 , srv157689894:84 , srv1625268011:84 , srv1666601491:84 , srv1682535063:84 , srv1692408823:84 , srv1704632879:84 , srv1715191367:84 , srv1721650258:84 , srv1745269825:84 , srv1749375261:84 , srv1776885671:84 , srv1796907393:84 , srv1835657592:84 , srv1843678222:84 , srv1869438308:84 , srv1915278873:84 , srv1926028155:84 , srv1940080111:84 , srv1946070906:84 , srv1999275780:84 , srv2018477881:84 , srv2037432872:84 , srv2079684663:84 , srv209062494:84 , srv253888036:84 , srv25492908:84 , srv278363974:84 , srv282562578:84 , srv299900963:84 , srv315610018:84 , srv489990581:84 , srv518152863:84 , srv531361259:84 , srv552343664:84 , srv578103808:84 , srv580590059:84 , srv615442393:84 , srv662766778:84 , srv687465260:84 , srv689990287:84 , srv697216213:84 , srv705455807:84 , srv722959235:84 , srv760334166:84 , srv76486026:84 , srv76658449:84 , srv787767882:84 , srv788145739:84 , srv795138146:84 , srv850108008:84 , srv865416462:84 , srv869507462:84 , srv874858812:84 , srv886482626:84 , srv896958127:84 , srv915792098:84 , srv950378070:84 , srv974753713:84 , srv989934415:84 , srv1248488765:85 , srv1775234645:85 , srv557296675:85 , srv579314715:85 , srv675939666:85 , srv966242468:85 , srv425194278:684 }
2023-04-25 04:55:44,474 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=438 (was 405) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 169) - ProcessCount LEAK? -, AvailableMemoryMB=4746 (was 5215)
2023-04-25 04:55:44,493 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=438, ProcessCount=170, AvailableMemoryMB=4745
2023-04-25 04:55:44,493 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-25 04:55:44,494 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-04-25 04:55:44,519 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1013214116:84 , srv1019330053:84 , srv1033957014:84 , srv1050817137:84 , srv1210017297:84 , srv1226295782:84 , srv1230622651:84 , srv124929224:84 , srv1342174421:84 , srv1368152423:84 , srv1539775228:84 , srv1554640830:84 , srv1563925611:84 , srv158088121:84 , srv1653145978:84 , srv1707821644:84 , srv1772301915:84 , srv1825562040:84 , srv1993406571:84 , srv2138839152:84 , srv244683617:84 , srv31846433:84 , srv41420492:84 , srv417055458:84 , srv636996673:84 , srv643539068:84 , srv699122666:84 , srv868101314:84 , srv883518659:84 , srv190266338:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-04-25 04:55:44,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-25 04:55:44,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv31846433=22, srv1050817137=3, srv1230622651=6, srv1013214116=0, srv1033957014=2, srv1554640830=11, srv1368152423=9, srv1653145978=14, srv883518659=29, srv2138839152=20, srv41420492=23, srv158088121=13, srv244683617=21, srv1226295782=5, srv190266338=18, srv1772301915=16, srv1563925611=12, srv636996673=25, srv124929224=7, srv417055458=24, srv1993406571=19, srv868101314=28, srv699122666=27, srv1539775228=10, srv1019330053=1, srv1825562040=17, srv1210017297=4, srv643539068=26, srv1342174421=8, srv1707821644=15} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-25 04:55:44,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-25 04:55:44,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-25 04:55:44,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-25 04:55:44,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-25 04:55:44,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-25 04:55:44,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-25 04:55:44,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-25 04:55:44,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-25 04:55:44,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-25 04:55:44,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-25 04:55:44,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-25 04:55:44,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-25 04:55:44,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-25 04:55:44,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-25 04:55:44,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-25 04:55:44,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-25 04:55:44,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-25 04:55:44,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-25 04:55:44,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-25 04:55:44,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-25 04:55:44,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-25 04:55:44,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-25 04:55:44,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-25 04:55:44,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-25 04:55:44,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-25 04:55:44,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-25 04:55:44,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-25 04:55:44,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-25 04:55:44,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-25 04:55:44,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-25 04:55:44,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-04-25 04:55:44,555 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1358939196653506, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-25 04:55:44,555 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.99126212405678, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1358939196653506, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-04-25 04:57:44,541 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6117705 different iterations.  Found a solution that moves 1857 regions; Going from a computed imbalance of 0.99126212405678 to a new imbalance of 4.334330639506329E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6877777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-25 04:57:44,547 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1013214116:90 , srv1019330053:90 , srv1033957014:90 , srv1050817137:90 , srv1210017297:90 , srv1226295782:90 , srv1230622651:90 , srv124929224:90 , srv1342174421:90 , srv1368152423:90 , srv1539775228:90 , srv1554640830:90 , srv1563925611:90 , srv158088121:90 , srv1653145978:90 , srv1707821644:90 , srv1772301915:90 , srv1825562040:90 , srv190266338:90 , srv1993406571:90 , srv2138839152:90 , srv244683617:90 , srv31846433:90 , srv41420492:90 , srv417055458:90 , srv636996673:90 , srv643539068:90 , srv699122666:90 , srv868101314:90 , srv883518659:90 }
2023-04-25 04:57:44,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-25 04:57:44,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv31846433=22, srv1050817137=3, srv1230622651=6, srv1013214116=0, srv1033957014=2, srv1554640830=11, srv1368152423=9, srv1653145978=14, srv883518659=29, srv2138839152=20, srv41420492=23, srv158088121=13, srv244683617=21, srv1226295782=5, srv190266338=18, srv1772301915=16, srv1563925611=12, srv636996673=25, srv124929224=7, srv417055458=24, srv1993406571=19, srv868101314=28, srv699122666=27, srv1539775228=10, srv1019330053=1, srv1825562040=17, srv1210017297=4, srv643539068=26, srv1342174421=8, srv1707821644=15} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-25 04:57:44,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-25 04:57:44,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-25 04:57:44,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-25 04:57:44,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-25 04:57:44,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-25 04:57:44,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-25 04:57:44,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-25 04:57:44,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-25 04:57:44,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-25 04:57:44,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-25 04:57:44,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-25 04:57:44,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-25 04:57:44,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-25 04:57:44,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-25 04:57:44,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-25 04:57:44,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-25 04:57:44,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-25 04:57:44,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-25 04:57:44,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-25 04:57:44,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-25 04:57:44,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-25 04:57:44,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-25 04:57:44,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-25 04:57:44,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-25 04:57:44,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-25 04:57:44,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-25 04:57:44,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-25 04:57:44,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-25 04:57:44,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-25 04:57:44,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-25 04:57:44,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-04-25 04:57:44,564 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-25 04:57:44,564 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1013214116:90 , srv1019330053:90 , srv1033957014:90 , srv1050817137:90 , srv1210017297:90 , srv1226295782:90 , srv1230622651:90 , srv124929224:90 , srv1342174421:90 , srv1368152423:90 , srv1539775228:90 , srv1554640830:90 , srv1563925611:90 , srv158088121:90 , srv1653145978:90 , srv1707821644:90 , srv1772301915:90 , srv1825562040:90 , srv190266338:90 , srv1993406571:90 , srv2138839152:90 , srv244683617:90 , srv31846433:90 , srv41420492:90 , srv417055458:90 , srv636996673:90 , srv643539068:90 , srv699122666:90 , srv868101314:90 , srv883518659:90 }
2023-04-25 04:57:44,576 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=9 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=301 (was 438), ProcessCount=170 (was 170), AvailableMemoryMB=4389 (was 4745)