2023-04-12 19:55:40,420 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-04-12 19:55:40,722 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-04-12 19:55:40,822 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-04-12 19:55:40,877 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-12 19:55:40,884 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-04-12 19:55:40,896 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=441, ProcessCount=169, AvailableMemoryMB=1236
2023-04-12 19:55:40,898 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-12 19:55:40,899 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-04-12 19:55:41,009 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1034957958:84 , srv1098331094:84 , srv1098535692:84 , srv1123249962:84 , srv113197306:84 , srv1157618448:84 , srv1180297800:84 , srv1191507056:84 , srv1265295625:84 , srv1276159051:84 , srv1293557334:84 , srv1320889125:84 , srv1321970167:84 , srv1322472909:84 , srv1350947098:84 , srv1356166708:84 , srv1372691652:84 , srv1394854234:84 , srv1422163406:84 , srv1424730187:84 , srv1434784873:84 , srv1438636349:84 , srv1441768684:84 , srv1452828958:84 , srv1472764867:84 , srv1518956:84 , srv1544183027:84 , srv1595325215:84 , srv1607684994:84 , srv1609410979:84 , srv1610204808:84 , srv1655945864:84 , srv1660764101:84 , srv1669905642:84 , srv1734023290:84 , srv1758182507:84 , srv1810542097:84 , srv1840404771:84 , srv1866922420:84 , srv1894748053:84 , srv1922004252:84 , srv1932513193:84 , srv1942363916:84 , srv1979626709:84 , srv1983904570:84 , srv2034419093:84 , srv204013933:84 , srv2041097040:84 , srv2047609221:84 , srv2058106086:84 , srv2088001455:84 , srv2113010826:84 , srv2126863248:84 , srv2137724807:84 , srv23898026:84 , srv242678753:84 , srv243034062:84 , srv280301510:84 , srv302782258:84 , srv306061672:84 , srv308935227:84 , srv317308566:84 , srv367131976:84 , srv38877120:84 , srv392776211:84 , srv409031884:84 , srv409202538:84 , srv420716695:84 , srv481338112:84 , srv48355933:84 , srv521827428:84 , srv526265845:84 , srv545484839:84 , srv55582816:84 , srv558578254:84 , srv633555154:84 , srv637589024:84 , srv652185406:84 , srv669582442:84 , srv675868181:84 , srv678453711:84 , srv683220155:84 , srv706107233:84 , srv735156743:84 , srv744416784:84 , srv750757357:84 , srv759124449:84 , srv833239134:84 , srv834520682:84 , srv892281492:84 , srv903475769:84 , srv919775655:84 , srv924379775:84 , srv945901288:84 , srv954624733:84 , srv966526773:84 , srv968984625:84 , srv96928337:84 , srv98049689:84 , srv1044087966:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-04-12 19:55:41,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-12 19:55:41,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv834520682=89, srv1472764867=25, srv308935227=61, srv1544183027=27, srv1983904570=45, srv392776211=65, srv1518956=26, srv558578254=75, srv750757357=86, srv1894748053=40, srv1350947098=15, srv1758182507=36, srv2137724807=54, srv744416784=85, srv1866922420=39, srv2126863248=53, srv1191507056=8, srv1810542097=37, srv892281492=90, srv2047609221=49, srv1180297800=7, srv1942363916=43, srv1734023290=35, srv2034419093=46, srv1034957958=0, srv1610204808=31, srv481338112=69, srv919775655=92, srv1840404771=38, srv280301510=58, srv968984625=97, srv96928337=98, srv1434784873=21, srv55582816=74, srv1660764101=33, srv633555154=76, srv2058106086=50, srv966526773=96, srv669582442=79, srv683220155=82, srv1098535692=3, srv2041097040=48, srv243034062=57, srv1979626709=44, srv38877120=64, srv1123249962=4, srv1655945864=32, srv903475769=91, srv409202538=67, srv924379775=93, srv204013933=47, srv317308566=62, srv1276159051=10, srv1424730187=20, srv1372691652=17, srv1321970167=13, srv945901288=94, srv735156743=84, srv954624733=95, srv1922004252=41, srv1320889125=12, srv306061672=60, srv1293557334=11, srv1422163406=19, srv526265845=72, srv23898026=55, srv706107233=83, srv1356166708=16, srv2113010826=52, srv1394854234=18, srv1595325215=28, srv420716695=68, srv1438636349=22, srv1157618448=6, srv1607684994=29, srv2088001455=51, srv113197306=5, srv1609410979=30, srv1932513193=42, srv678453711=81, srv545484839=73, srv675868181=80, srv302782258=59, srv1098331094=2, srv48355933=70, srv1452828958=24, srv1265295625=9, srv652185406=78, srv833239134=88, srv367131976=63, srv1044087966=1, srv637589024=77, srv759124449=87, srv1441768684=23, srv409031884=66, srv98049689=99, srv521827428=71, srv242678753=56, srv1669905642=34, srv1322472909=14} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-12 19:55:41,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-12 19:55:41,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-12 19:55:41,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-12 19:55:41,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-12 19:55:41,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-12 19:55:41,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-12 19:55:41,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-12 19:55:41,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-12 19:55:41,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-12 19:55:41,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-12 19:55:41,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-12 19:55:41,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-12 19:55:41,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-12 19:55:41,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-12 19:55:41,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-12 19:55:41,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-12 19:55:41,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-12 19:55:41,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-12 19:55:41,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-12 19:55:41,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-12 19:55:41,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-12 19:55:41,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-12 19:55:41,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-12 19:55:41,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-12 19:55:41,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-12 19:55:41,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-12 19:55:41,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-12 19:55:41,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-12 19:55:41,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-12 19:55:41,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-12 19:55:41,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-12 19:55:41,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-12 19:55:41,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-12 19:55:41,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-12 19:55:41,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-12 19:55:41,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-12 19:55:41,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-12 19:55:41,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-12 19:55:41,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-12 19:55:41,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-12 19:55:41,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-12 19:55:41,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-12 19:55:41,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-12 19:55:41,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-12 19:55:41,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-12 19:55:41,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-12 19:55:41,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-12 19:55:41,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-12 19:55:41,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-12 19:55:41,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-12 19:55:41,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-12 19:55:41,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-12 19:55:41,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-12 19:55:41,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-12 19:55:41,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-12 19:55:41,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-12 19:55:41,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-12 19:55:41,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-12 19:55:41,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-12 19:55:41,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-12 19:55:41,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-12 19:55:41,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-12 19:55:41,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-12 19:55:41,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-12 19:55:41,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-12 19:55:41,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-12 19:55:41,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-12 19:55:41,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-12 19:55:41,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-12 19:55:41,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-12 19:55:41,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-12 19:55:41,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-12 19:55:41,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-12 19:55:41,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-12 19:55:41,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-12 19:55:41,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-12 19:55:41,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-12 19:55:41,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-12 19:55:41,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-12 19:55:41,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-12 19:55:41,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-12 19:55:41,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-12 19:55:41,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-12 19:55:41,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-12 19:55:41,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-12 19:55:41,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-12 19:55:41,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-12 19:55:41,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-12 19:55:41,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-12 19:55:41,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-12 19:55:41,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-12 19:55:41,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-12 19:55:41,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-12 19:55:41,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-12 19:55:41,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-12 19:55:41,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-12 19:55:41,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-12 19:55:41,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-12 19:55:41,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-12 19:55:41,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-12 19:55:41,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-12 19:55:41,289 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-12 19:55:41,290 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-12 19:55:41,290 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-12 19:55:41,550 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 404 ms to try 5000 different iterations.  Found a solution that moves 4666 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18388529466235082. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03767729423751104, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05661415669685518, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5184444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03767729423751104, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17908333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.2465, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-12 19:55:41,560 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1276159051:81 , srv1610204808:82 , srv2113010826:82 , srv558578254:82 , srv706107233:82 , srv1758182507:83 , srv204013933:83 , srv1265295625:84 , srv1356166708:84 , srv1424730187:84 , srv2041097040:84 , srv2088001455:84 , srv367131976:84 , srv420716695:84 , srv945901288:84 , srv1372691652:85 , srv1422163406:85 , srv1669905642:85 , srv1734023290:85 , srv1810542097:85 , srv1922004252:85 , srv2047609221:85 , srv2137724807:85 , srv23898026:85 , srv481338112:85 , srv652185406:85 , srv675868181:85 , srv750757357:85 , srv759124449:85 , srv834520682:85 , srv966526773:85 , srv98049689:85 , srv1098331094:86 , srv1123249962:86 , srv1191507056:86 , srv1434784873:86 , srv1441768684:86 , srv1607684994:86 , srv1866922420:86 , srv1894748053:86 , srv280301510:86 , srv409031884:86 , srv633555154:86 , srv683220155:86 , srv903475769:86 , srv954624733:86 , srv1034957958:87 , srv1098535692:87 , srv1157618448:87 , srv1320889125:87 , srv1840404771:87 , srv1932513193:87 , srv2058106086:87 , srv242678753:87 , srv306061672:87 , srv38877120:87 , srv392776211:87 , srv409202538:87 , srv48355933:87 , srv521827428:87 , srv637589024:87 , srv735156743:87 , srv919775655:87 , srv1293557334:88 , srv1350947098:88 , srv1394854234:88 , srv1438636349:88 , srv1472764867:88 , srv1544183027:88 , srv1595325215:88 , srv1609410979:88 , srv1942363916:88 , srv1979626709:88 , srv1983904570:88 , srv2034419093:88 , srv2126863248:88 , srv308935227:88 , srv55582816:88 , srv669582442:88 , srv833239134:88 , srv96928337:88 , srv1322472909:89 , srv1452828958:89 , srv1655945864:89 , srv1660764101:89 , srv243034062:89 , srv317308566:89 , srv744416784:89 , srv924379775:89 , srv1180297800:90 , srv1321970167:90 , srv1518956:90 , srv302782258:90 , srv678453711:90 , srv892281492:90 , srv968984625:90 , srv113197306:91 , srv526265845:91 , srv545484839:92 , srv1044087966:425 }
2023-04-12 19:55:41,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-12 19:55:41,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv834520682=89, srv1472764867=25, srv308935227=61, srv1544183027=27, srv1983904570=45, srv392776211=65, srv1518956=26, srv558578254=75, srv750757357=86, srv1894748053=40, srv1350947098=15, srv1758182507=36, srv2137724807=54, srv744416784=85, srv1866922420=39, srv2126863248=53, srv1191507056=8, srv1810542097=37, srv892281492=90, srv2047609221=49, srv1180297800=7, srv1942363916=43, srv1734023290=35, srv2034419093=46, srv1034957958=0, srv1610204808=31, srv481338112=69, srv919775655=92, srv1840404771=38, srv280301510=58, srv968984625=97, srv96928337=98, srv1434784873=21, srv55582816=74, srv1660764101=33, srv633555154=76, srv2058106086=50, srv966526773=96, srv669582442=79, srv683220155=82, srv1098535692=3, srv2041097040=48, srv243034062=57, srv1979626709=44, srv38877120=64, srv1123249962=4, srv1655945864=32, srv903475769=91, srv409202538=67, srv924379775=93, srv204013933=47, srv317308566=62, srv1276159051=10, srv1424730187=20, srv1372691652=17, srv1321970167=13, srv945901288=94, srv735156743=84, srv954624733=95, srv1922004252=41, srv1320889125=12, srv306061672=60, srv1293557334=11, srv1422163406=19, srv526265845=72, srv23898026=55, srv706107233=83, srv1356166708=16, srv2113010826=52, srv1394854234=18, srv1595325215=28, srv420716695=68, srv1438636349=22, srv1157618448=6, srv1607684994=29, srv2088001455=51, srv113197306=5, srv1609410979=30, srv1932513193=42, srv678453711=81, srv545484839=73, srv675868181=80, srv302782258=59, srv1098331094=2, srv48355933=70, srv1452828958=24, srv1265295625=9, srv652185406=78, srv833239134=88, srv367131976=63, srv1044087966=1, srv637589024=77, srv759124449=87, srv1441768684=23, srv409031884=66, srv98049689=99, srv521827428=71, srv242678753=56, srv1669905642=34, srv1322472909=14} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-12 19:55:41,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-12 19:55:41,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-12 19:55:41,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-12 19:55:41,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-12 19:55:41,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-12 19:55:41,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-12 19:55:41,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-12 19:55:41,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-12 19:55:41,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-12 19:55:41,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-12 19:55:41,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-12 19:55:41,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-12 19:55:41,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-12 19:55:41,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-12 19:55:41,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-12 19:55:41,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-12 19:55:41,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-12 19:55:41,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-12 19:55:41,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-12 19:55:41,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-12 19:55:41,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-12 19:55:41,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-12 19:55:41,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-12 19:55:41,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-12 19:55:41,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-12 19:55:41,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-12 19:55:41,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-12 19:55:41,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-12 19:55:41,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-12 19:55:41,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-12 19:55:41,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-12 19:55:41,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-12 19:55:41,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-12 19:55:41,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-12 19:55:41,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-12 19:55:41,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-12 19:55:41,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-12 19:55:41,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-12 19:55:41,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-12 19:55:41,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-12 19:55:41,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-12 19:55:41,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-12 19:55:41,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-12 19:55:41,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-12 19:55:41,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-12 19:55:41,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-12 19:55:41,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-12 19:55:41,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-12 19:55:41,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-12 19:55:41,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-12 19:55:41,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-12 19:55:41,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-12 19:55:41,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-12 19:55:41,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-12 19:55:41,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-12 19:55:41,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-12 19:55:41,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-12 19:55:41,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-12 19:55:41,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-12 19:55:41,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-12 19:55:41,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-12 19:55:41,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-12 19:55:41,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-12 19:55:41,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-12 19:55:41,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-12 19:55:41,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-12 19:55:41,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-12 19:55:41,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-12 19:55:41,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-12 19:55:41,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-12 19:55:41,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-12 19:55:41,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-12 19:55:41,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-12 19:55:41,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-12 19:55:41,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-12 19:55:41,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-12 19:55:41,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-12 19:55:41,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-12 19:55:41,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-12 19:55:41,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-12 19:55:41,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-12 19:55:41,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-12 19:55:41,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-12 19:55:41,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-12 19:55:41,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-12 19:55:41,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-12 19:55:41,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-12 19:55:41,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-12 19:55:41,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-12 19:55:41,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-12 19:55:41,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-12 19:55:41,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-12 19:55:41,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-12 19:55:41,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-12 19:55:41,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-12 19:55:41,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-12 19:55:41,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-12 19:55:41,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-12 19:55:41,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-12 19:55:41,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-12 19:55:41,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-12 19:55:41,722 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03767729423751104, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05661415669685518, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03767729423751104, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17908333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.2465, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-12 19:55:41,722 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-12 19:55:41,722 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18385262263203753, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03767729423751104, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05661415669685518, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03767729423751104, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17908333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.2465, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-12 19:55:42,001 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 389 ms to try 5000 different iterations.  Found a solution that moves 2691 regions; Going from a computed imbalance of 0.18385262263203753 to a new imbalance of 0.016932344434636943. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.018703453677030055); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.030722683431246862, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.299, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.018703453677030055); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01375); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04783333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-12 19:55:42,012 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1518956:80 , srv526265845:80 , srv1180297800:81 , srv1321970167:81 , srv545484839:81 , srv113197306:82 , srv1655945864:82 , srv243034062:82 , srv744416784:82 , srv1322472909:83 , srv1472764867:83 , srv1979626709:83 , srv2034419093:83 , srv302782258:83 , srv308935227:83 , srv55582816:83 , srv924379775:83 , srv1350947098:84 , srv1394854234:84 , srv1438636349:84 , srv1544183027:84 , srv1595325215:84 , srv1607684994:84 , srv1660764101:84 , srv1983904570:84 , srv2058106086:84 , srv637589024:84 , srv669582442:84 , srv675868181:84 , srv678453711:84 , srv735156743:84 , srv833239134:84 , srv903475769:84 , srv954624733:84 , srv968984625:84 , srv96928337:84 , srv1098331094:85 , srv1123249962:85 , srv1157618448:85 , srv1191507056:85 , srv1293557334:85 , srv1320889125:85 , srv1434784873:85 , srv1932513193:85 , srv1942363916:85 , srv2126863248:85 , srv242678753:85 , srv317308566:85 , srv392776211:85 , srv652185406:85 , srv919775655:85 , srv1034957958:86 , srv1098535692:86 , srv1452828958:86 , srv1810542097:86 , srv1866922420:86 , srv2137724807:86 , srv23898026:86 , srv280301510:86 , srv409031884:86 , srv481338112:86 , srv521827428:86 , srv750757357:86 , srv834520682:86 , srv892281492:86 , srv98049689:86 , srv1372691652:87 , srv1441768684:87 , srv1609410979:87 , srv1922004252:87 , srv2047609221:87 , srv38877120:87 , srv409202538:87 , srv759124449:87 , srv966526773:87 , srv1356166708:88 , srv1424730187:88 , srv1840404771:88 , srv1894748053:88 , srv2041097040:88 , srv306061672:88 , srv420716695:88 , srv48355933:88 , srv633555154:88 , srv683220155:88 , srv1265295625:89 , srv1422163406:89 , srv1669905642:89 , srv1734023290:89 , srv2088001455:89 , srv1610204808:90 , srv1758182507:90 , srv204013933:90 , srv706107233:90 , srv367131976:91 , srv1276159051:92 , srv2113010826:92 , srv558578254:92 , srv945901288:94 , srv1044087966:515 }
2023-04-12 19:55:42,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-12 19:55:42,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv834520682=89, srv1472764867=25, srv308935227=61, srv1544183027=27, srv1983904570=45, srv392776211=65, srv1518956=26, srv558578254=75, srv750757357=86, srv1894748053=40, srv1350947098=15, srv1758182507=36, srv2137724807=54, srv744416784=85, srv1866922420=39, srv2126863248=53, srv1191507056=8, srv1810542097=37, srv892281492=90, srv2047609221=49, srv1180297800=7, srv1942363916=43, srv1734023290=35, srv2034419093=46, srv1034957958=0, srv1610204808=31, srv481338112=69, srv919775655=92, srv1840404771=38, srv280301510=58, srv968984625=97, srv96928337=98, srv1434784873=21, srv55582816=74, srv1660764101=33, srv633555154=76, srv2058106086=50, srv966526773=96, srv669582442=79, srv683220155=82, srv1098535692=3, srv2041097040=48, srv243034062=57, srv1979626709=44, srv38877120=64, srv1123249962=4, srv1655945864=32, srv903475769=91, srv409202538=67, srv924379775=93, srv204013933=47, srv317308566=62, srv1276159051=10, srv1424730187=20, srv1372691652=17, srv1321970167=13, srv945901288=94, srv735156743=84, srv954624733=95, srv1922004252=41, srv1320889125=12, srv306061672=60, srv1293557334=11, srv1422163406=19, srv526265845=72, srv23898026=55, srv706107233=83, srv1356166708=16, srv2113010826=52, srv1394854234=18, srv1595325215=28, srv420716695=68, srv1438636349=22, srv1157618448=6, srv1607684994=29, srv2088001455=51, srv113197306=5, srv1609410979=30, srv1932513193=42, srv678453711=81, srv545484839=73, srv675868181=80, srv302782258=59, srv1098331094=2, srv48355933=70, srv1452828958=24, srv1265295625=9, srv652185406=78, srv833239134=88, srv367131976=63, srv1044087966=1, srv637589024=77, srv759124449=87, srv1441768684=23, srv409031884=66, srv98049689=99, srv521827428=71, srv242678753=56, srv1669905642=34, srv1322472909=14} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-12 19:55:42,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-12 19:55:42,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-12 19:55:42,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-12 19:55:42,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-12 19:55:42,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-12 19:55:42,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-12 19:55:42,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-12 19:55:42,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-12 19:55:42,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-12 19:55:42,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-12 19:55:42,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-12 19:55:42,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-12 19:55:42,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-12 19:55:42,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-12 19:55:42,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-12 19:55:42,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-12 19:55:42,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-12 19:55:42,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-12 19:55:42,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-12 19:55:42,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-12 19:55:42,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-12 19:55:42,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-12 19:55:42,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-12 19:55:42,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-12 19:55:42,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-12 19:55:42,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-12 19:55:42,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-12 19:55:42,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-12 19:55:42,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-12 19:55:42,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-12 19:55:42,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-12 19:55:42,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-12 19:55:42,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-12 19:55:42,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-12 19:55:42,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-12 19:55:42,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-12 19:55:42,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-12 19:55:42,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-12 19:55:42,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-12 19:55:42,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-12 19:55:42,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-12 19:55:42,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-12 19:55:42,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-12 19:55:42,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-12 19:55:42,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-12 19:55:42,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-12 19:55:42,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-12 19:55:42,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-12 19:55:42,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-12 19:55:42,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-12 19:55:42,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-12 19:55:42,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-12 19:55:42,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-12 19:55:42,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-12 19:55:42,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-12 19:55:42,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-12 19:55:42,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-12 19:55:42,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-12 19:55:42,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-12 19:55:42,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-12 19:55:42,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-12 19:55:42,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-12 19:55:42,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-12 19:55:42,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-12 19:55:42,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-12 19:55:42,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-12 19:55:42,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-12 19:55:42,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-12 19:55:42,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-12 19:55:42,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-12 19:55:42,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-12 19:55:42,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-12 19:55:42,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-12 19:55:42,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-12 19:55:42,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-12 19:55:42,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-12 19:55:42,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-12 19:55:42,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-12 19:55:42,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-12 19:55:42,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-12 19:55:42,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-12 19:55:42,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-12 19:55:42,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-12 19:55:42,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-12 19:55:42,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-12 19:55:42,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-12 19:55:42,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-12 19:55:42,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-12 19:55:42,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-12 19:55:42,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-12 19:55:42,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-12 19:55:42,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-12 19:55:42,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-12 19:55:42,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-12 19:55:42,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-12 19:55:42,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-12 19:55:42,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-12 19:55:42,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-12 19:55:42,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-12 19:55:42,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-12 19:55:42,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-12 19:55:42,141 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.018703453677030055); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.030722683431246862, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.018703453677030055); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01375); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04783333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-12 19:55:42,142 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-12 19:55:42,142 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.01691350164990203, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.018703453677030055); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.030722683431246862, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.018703453677030055); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01375); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04783333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-12 19:55:42,431 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 384 ms to try 5000 different iterations.  Found a solution that moves 991 regions; Going from a computed imbalance of 0.01691350164990203 to a new imbalance of 7.408929795832082E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004756182762796897); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009628334541246444); MoveCostFunction : (multiplier=7.0, imbalance=0.11011111111111112, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.004756182762796897); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00325); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-12 19:55:42,435 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv945901288:80 , srv1609410979:81 , srv1452828958:82 , srv367131976:82 , srv48355933:82 , srv892281492:82 , srv1422163406:83 , srv1669905642:83 , srv1734023290:83 , srv306061672:83 , srv38877120:83 , srv409202538:83 , srv633555154:83 , srv683220155:83 , srv1293557334:84 , srv1441768684:84 , srv1758182507:84 , srv1840404771:84 , srv1894748053:84 , srv2113010826:84 , srv2126863248:84 , srv302782258:84 , srv317308566:84 , srv545484839:84 , srv558578254:84 , srv678453711:84 , srv968984625:84 , srv1034957958:85 , srv1098535692:85 , srv113197306:85 , srv1157618448:85 , srv1265295625:85 , srv1276159051:85 , srv1320889125:85 , srv1438636349:85 , srv1595325215:85 , srv1610204808:85 , srv1660764101:85 , srv1866922420:85 , srv1922004252:85 , srv1932513193:85 , srv1942363916:85 , srv204013933:85 , srv2088001455:85 , srv280301510:85 , srv392776211:85 , srv521827428:85 , srv669582442:85 , srv706107233:85 , srv759124449:85 , srv919775655:85 , srv1098331094:86 , srv1123249962:86 , srv1322472909:86 , srv1350947098:86 , srv1356166708:86 , srv1372691652:86 , srv1394854234:86 , srv1424730187:86 , srv1434784873:86 , srv1544183027:86 , srv1983904570:86 , srv2041097040:86 , srv2047609221:86 , srv242678753:86 , srv409031884:86 , srv420716695:86 , srv481338112:86 , srv526265845:86 , srv637589024:86 , srv735156743:86 , srv744416784:86 , srv750757357:86 , srv833239134:86 , srv834520682:86 , srv924379775:86 , srv966526773:86 , srv96928337:86 , srv1180297800:87 , srv1191507056:87 , srv1321970167:87 , srv1472764867:87 , srv1607684994:87 , srv1655945864:87 , srv1979626709:87 , srv2058106086:87 , srv2137724807:87 , srv23898026:87 , srv243034062:87 , srv308935227:87 , srv55582816:87 , srv954624733:87 , srv98049689:87 , srv1518956:88 , srv1810542097:88 , srv2034419093:88 , srv652185406:88 , srv675868181:88 , srv903475769:88 , srv1044087966:560 }
2023-04-12 19:55:42,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-12 19:55:42,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv834520682=89, srv1472764867=25, srv308935227=61, srv1544183027=27, srv1983904570=45, srv392776211=65, srv1518956=26, srv558578254=75, srv750757357=86, srv1894748053=40, srv1350947098=15, srv1758182507=36, srv2137724807=54, srv744416784=85, srv1866922420=39, srv2126863248=53, srv1191507056=8, srv1810542097=37, srv892281492=90, srv2047609221=49, srv1180297800=7, srv1942363916=43, srv1734023290=35, srv2034419093=46, srv1034957958=0, srv1610204808=31, srv481338112=69, srv919775655=92, srv1840404771=38, srv280301510=58, srv968984625=97, srv96928337=98, srv1434784873=21, srv55582816=74, srv1660764101=33, srv633555154=76, srv2058106086=50, srv966526773=96, srv669582442=79, srv683220155=82, srv1098535692=3, srv2041097040=48, srv243034062=57, srv1979626709=44, srv38877120=64, srv1123249962=4, srv1655945864=32, srv903475769=91, srv409202538=67, srv924379775=93, srv204013933=47, srv317308566=62, srv1276159051=10, srv1424730187=20, srv1372691652=17, srv1321970167=13, srv945901288=94, srv735156743=84, srv954624733=95, srv1922004252=41, srv1320889125=12, srv306061672=60, srv1293557334=11, srv1422163406=19, srv526265845=72, srv23898026=55, srv706107233=83, srv1356166708=16, srv2113010826=52, srv1394854234=18, srv1595325215=28, srv420716695=68, srv1438636349=22, srv1157618448=6, srv1607684994=29, srv2088001455=51, srv113197306=5, srv1609410979=30, srv1932513193=42, srv678453711=81, srv545484839=73, srv675868181=80, srv302782258=59, srv1098331094=2, srv48355933=70, srv1452828958=24, srv1265295625=9, srv652185406=78, srv833239134=88, srv367131976=63, srv1044087966=1, srv637589024=77, srv759124449=87, srv1441768684=23, srv409031884=66, srv98049689=99, srv521827428=71, srv242678753=56, srv1669905642=34, srv1322472909=14} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-12 19:55:42,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-12 19:55:42,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-12 19:55:42,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-12 19:55:42,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-12 19:55:42,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-12 19:55:42,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-12 19:55:42,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-12 19:55:42,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-12 19:55:42,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-12 19:55:42,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-12 19:55:42,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-12 19:55:42,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-12 19:55:42,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-12 19:55:42,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-12 19:55:42,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-12 19:55:42,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-12 19:55:42,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-12 19:55:42,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-12 19:55:42,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-12 19:55:42,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-12 19:55:42,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-12 19:55:42,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-12 19:55:42,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-12 19:55:42,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-12 19:55:42,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-12 19:55:42,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-12 19:55:42,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-12 19:55:42,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-12 19:55:42,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-12 19:55:42,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-12 19:55:42,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-12 19:55:42,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-12 19:55:42,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-12 19:55:42,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-12 19:55:42,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-12 19:55:42,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-12 19:55:42,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-12 19:55:42,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-12 19:55:42,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-12 19:55:42,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-12 19:55:42,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-12 19:55:42,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-12 19:55:42,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-12 19:55:42,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-12 19:55:42,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-12 19:55:42,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-12 19:55:42,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-12 19:55:42,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-12 19:55:42,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-12 19:55:42,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-12 19:55:42,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-12 19:55:42,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-12 19:55:42,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-12 19:55:42,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-12 19:55:42,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-12 19:55:42,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-12 19:55:42,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-12 19:55:42,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-12 19:55:42,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-12 19:55:42,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-12 19:55:42,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-12 19:55:42,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-12 19:55:42,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-12 19:55:42,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-12 19:55:42,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-12 19:55:42,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-12 19:55:42,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-12 19:55:42,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-12 19:55:42,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-12 19:55:42,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-12 19:55:42,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-12 19:55:42,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-12 19:55:42,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-12 19:55:42,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-12 19:55:42,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-12 19:55:42,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-12 19:55:42,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-12 19:55:42,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-12 19:55:42,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-12 19:55:42,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-12 19:55:42,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-12 19:55:42,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-12 19:55:42,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-12 19:55:42,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-12 19:55:42,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-12 19:55:42,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-12 19:55:42,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-12 19:55:42,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-12 19:55:42,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-12 19:55:42,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-12 19:55:42,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-12 19:55:42,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-12 19:55:42,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-12 19:55:42,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-12 19:55:42,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-12 19:55:42,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-12 19:55:42,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-12 19:55:42,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-12 19:55:42,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-12 19:55:42,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-12 19:55:42,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-12 19:55:42,632 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004756182762796897); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009628334541246444); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.004756182762796897); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00325); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-12 19:55:42,633 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-12 19:55:42,633 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=7.339538492702021E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004756182762796897); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009628334541246444); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.004756182762796897); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00325); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-12 19:55:43,002 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 499 ms to try 5000 different iterations.  Found a solution that moves 264 regions; Going from a computed imbalance of 7.339538492702021E-4 to a new imbalance of 2.054944558582907E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0019534423844256277); MoveCostFunction : (multiplier=7.0, imbalance=0.029333333333333333, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-12 19:55:43,004 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv113197306:83 , srv1810542097:83 , srv1840404771:83 , srv1983904570:83 , srv2034419093:83 , srv243034062:83 , srv678453711:83 , srv1034957958:84 , srv1098535692:84 , srv1180297800:84 , srv1191507056:84 , srv1265295625:84 , srv1276159051:84 , srv1321970167:84 , srv1322472909:84 , srv1356166708:84 , srv1372691652:84 , srv1424730187:84 , srv1434784873:84 , srv1472764867:84 , srv1518956:84 , srv1544183027:84 , srv1595325215:84 , srv1655945864:84 , srv1894748053:84 , srv1932513193:84 , srv1942363916:84 , srv1979626709:84 , srv204013933:84 , srv2041097040:84 , srv2047609221:84 , srv2058106086:84 , srv2088001455:84 , srv2113010826:84 , srv2137724807:84 , srv23898026:84 , srv242678753:84 , srv306061672:84 , srv308935227:84 , srv317308566:84 , srv409202538:84 , srv420716695:84 , srv521827428:84 , srv55582816:84 , srv633555154:84 , srv652185406:84 , srv750757357:84 , srv833239134:84 , srv892281492:84 , srv924379775:84 , srv945901288:84 , srv966526773:84 , srv968984625:84 , srv96928337:84 , srv98049689:84 , srv1098331094:85 , srv1157618448:85 , srv1320889125:85 , srv1350947098:85 , srv1394854234:85 , srv1438636349:85 , srv1441768684:85 , srv1452828958:85 , srv1607684994:85 , srv1610204808:85 , srv1660764101:85 , srv1669905642:85 , srv1734023290:85 , srv1758182507:85 , srv1866922420:85 , srv1922004252:85 , srv2126863248:85 , srv280301510:85 , srv302782258:85 , srv367131976:85 , srv38877120:85 , srv392776211:85 , srv409031884:85 , srv481338112:85 , srv48355933:85 , srv526265845:85 , srv545484839:85 , srv558578254:85 , srv637589024:85 , srv669582442:85 , srv675868181:85 , srv683220155:85 , srv706107233:85 , srv735156743:85 , srv744416784:85 , srv759124449:85 , srv834520682:85 , srv903475769:85 , srv919775655:85 , srv1123249962:86 , srv1293557334:86 , srv1422163406:86 , srv1609410979:86 , srv954624733:86 , srv1044087966:642 }
2023-04-12 19:55:43,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-12 19:55:43,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv834520682=89, srv1472764867=25, srv308935227=61, srv1544183027=27, srv1983904570=45, srv392776211=65, srv1518956=26, srv558578254=75, srv750757357=86, srv1894748053=40, srv1350947098=15, srv1758182507=36, srv2137724807=54, srv744416784=85, srv1866922420=39, srv2126863248=53, srv1191507056=8, srv1810542097=37, srv892281492=90, srv2047609221=49, srv1180297800=7, srv1942363916=43, srv1734023290=35, srv2034419093=46, srv1034957958=0, srv1610204808=31, srv481338112=69, srv919775655=92, srv1840404771=38, srv280301510=58, srv968984625=97, srv96928337=98, srv1434784873=21, srv55582816=74, srv1660764101=33, srv633555154=76, srv2058106086=50, srv966526773=96, srv669582442=79, srv683220155=82, srv1098535692=3, srv2041097040=48, srv243034062=57, srv1979626709=44, srv38877120=64, srv1123249962=4, srv1655945864=32, srv903475769=91, srv409202538=67, srv924379775=93, srv204013933=47, srv317308566=62, srv1276159051=10, srv1424730187=20, srv1372691652=17, srv1321970167=13, srv945901288=94, srv735156743=84, srv954624733=95, srv1922004252=41, srv1320889125=12, srv306061672=60, srv1293557334=11, srv1422163406=19, srv526265845=72, srv23898026=55, srv706107233=83, srv1356166708=16, srv2113010826=52, srv1394854234=18, srv1595325215=28, srv420716695=68, srv1438636349=22, srv1157618448=6, srv1607684994=29, srv2088001455=51, srv113197306=5, srv1609410979=30, srv1932513193=42, srv678453711=81, srv545484839=73, srv675868181=80, srv302782258=59, srv1098331094=2, srv48355933=70, srv1452828958=24, srv1265295625=9, srv652185406=78, srv833239134=88, srv367131976=63, srv1044087966=1, srv637589024=77, srv759124449=87, srv1441768684=23, srv409031884=66, srv98049689=99, srv521827428=71, srv242678753=56, srv1669905642=34, srv1322472909=14} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-12 19:55:43,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-12 19:55:43,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-12 19:55:43,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-12 19:55:43,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-12 19:55:43,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-12 19:55:43,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-12 19:55:43,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-12 19:55:43,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-12 19:55:43,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-12 19:55:43,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-12 19:55:43,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-12 19:55:43,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-12 19:55:43,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-12 19:55:43,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-12 19:55:43,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-12 19:55:43,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-12 19:55:43,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-12 19:55:43,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-12 19:55:43,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-12 19:55:43,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-12 19:55:43,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-12 19:55:43,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-12 19:55:43,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-12 19:55:43,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-12 19:55:43,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-12 19:55:43,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-12 19:55:43,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-12 19:55:43,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-12 19:55:43,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-12 19:55:43,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-12 19:55:43,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-12 19:55:43,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-12 19:55:43,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-12 19:55:43,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-12 19:55:43,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-12 19:55:43,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-12 19:55:43,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-12 19:55:43,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-12 19:55:43,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-12 19:55:43,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-12 19:55:43,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-12 19:55:43,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-12 19:55:43,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-12 19:55:43,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-12 19:55:43,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-12 19:55:43,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-12 19:55:43,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-12 19:55:43,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-12 19:55:43,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-12 19:55:43,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-12 19:55:43,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-12 19:55:43,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-12 19:55:43,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-12 19:55:43,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-12 19:55:43,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-12 19:55:43,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-12 19:55:43,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-12 19:55:43,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-12 19:55:43,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-12 19:55:43,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-12 19:55:43,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-12 19:55:43,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-12 19:55:43,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-12 19:55:43,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-12 19:55:43,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-12 19:55:43,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-12 19:55:43,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-12 19:55:43,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-12 19:55:43,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-12 19:55:43,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-12 19:55:43,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-12 19:55:43,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-12 19:55:43,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-12 19:55:43,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-12 19:55:43,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-12 19:55:43,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-12 19:55:43,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-12 19:55:43,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-12 19:55:43,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-12 19:55:43,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-12 19:55:43,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-12 19:55:43,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-12 19:55:43,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-12 19:55:43,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-12 19:55:43,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-12 19:55:43,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-12 19:55:43,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-12 19:55:43,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-12 19:55:43,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-12 19:55:43,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-12 19:55:43,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-12 19:55:43,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-12 19:55:43,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-12 19:55:43,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-12 19:55:43,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-12 19:55:43,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-12 19:55:43,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-12 19:55:43,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-12 19:55:43,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-12 19:55:43,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-12 19:55:43,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-12 19:55:43,186 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=1.870087807560343E-5 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0019534423844256277); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-12 19:55:43,187 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv113197306:83 , srv1810542097:83 , srv1840404771:83 , srv1983904570:83 , srv2034419093:83 , srv243034062:83 , srv678453711:83 , srv1034957958:84 , srv1098535692:84 , srv1180297800:84 , srv1191507056:84 , srv1265295625:84 , srv1276159051:84 , srv1321970167:84 , srv1322472909:84 , srv1356166708:84 , srv1372691652:84 , srv1424730187:84 , srv1434784873:84 , srv1472764867:84 , srv1518956:84 , srv1544183027:84 , srv1595325215:84 , srv1655945864:84 , srv1894748053:84 , srv1932513193:84 , srv1942363916:84 , srv1979626709:84 , srv204013933:84 , srv2041097040:84 , srv2047609221:84 , srv2058106086:84 , srv2088001455:84 , srv2113010826:84 , srv2137724807:84 , srv23898026:84 , srv242678753:84 , srv306061672:84 , srv308935227:84 , srv317308566:84 , srv409202538:84 , srv420716695:84 , srv521827428:84 , srv55582816:84 , srv633555154:84 , srv652185406:84 , srv750757357:84 , srv833239134:84 , srv892281492:84 , srv924379775:84 , srv945901288:84 , srv966526773:84 , srv968984625:84 , srv96928337:84 , srv98049689:84 , srv1098331094:85 , srv1157618448:85 , srv1320889125:85 , srv1350947098:85 , srv1394854234:85 , srv1438636349:85 , srv1441768684:85 , srv1452828958:85 , srv1607684994:85 , srv1610204808:85 , srv1660764101:85 , srv1669905642:85 , srv1734023290:85 , srv1758182507:85 , srv1866922420:85 , srv1922004252:85 , srv2126863248:85 , srv280301510:85 , srv302782258:85 , srv367131976:85 , srv38877120:85 , srv392776211:85 , srv409031884:85 , srv481338112:85 , srv48355933:85 , srv526265845:85 , srv545484839:85 , srv558578254:85 , srv637589024:85 , srv669582442:85 , srv675868181:85 , srv683220155:85 , srv706107233:85 , srv735156743:85 , srv744416784:85 , srv759124449:85 , srv834520682:85 , srv903475769:85 , srv919775655:85 , srv1123249962:86 , srv1293557334:86 , srv1422163406:86 , srv1609410979:86 , srv954624733:86 , srv1044087966:642 }
2023-04-12 19:55:43,222 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=438 (was 441), ProcessCount=169 (was 169), AvailableMemoryMB=748 (was 1236)
2023-04-12 19:55:43,237 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=10, OpenFileDescriptor=262, MaxFileDescriptor=60000, SystemLoadAverage=438, ProcessCount=169, AvailableMemoryMB=748
2023-04-12 19:55:43,238 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-12 19:55:43,238 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-04-12 19:55:43,255 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1004828862:84 , srv1009136203:84 , srv106431984:84 , srv1079838477:84 , srv1121103998:84 , srv1135442030:84 , srv1247466670:84 , srv1278482199:84 , srv1467417020:84 , srv1577100610:84 , srv1588117216:84 , srv164875935:84 , srv1703562337:84 , srv1705292259:84 , srv175891180:84 , srv1930572178:84 , srv1984456119:84 , srv2030052225:84 , srv23595481:84 , srv398163026:84 , srv406330489:84 , srv407026664:84 , srv421943882:84 , srv472202301:84 , srv58683309:84 , srv675079473:84 , srv751185992:84 , srv793552139:84 , srv821540275:84 , srv415519318:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-04-12 19:55:43,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-12 19:55:43,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv106431984=2, srv1009136203=1, srv1984456119=16, srv58683309=25, srv398163026=19, srv751185992=27, srv406330489=20, srv1135442030=5, srv1121103998=4, srv164875935=11, srv1705292259=13, srv793552139=28, srv2030052225=17, srv1703562337=12, srv1588117216=10, srv1247466670=6, srv1278482199=7, srv1079838477=3, srv407026664=21, srv1577100610=9, srv472202301=24, srv23595481=18, srv675079473=26, srv821540275=29, srv415519318=22, srv1467417020=8, srv1004828862=0, srv421943882=23, srv175891180=14, srv1930572178=15} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-12 19:55:43,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-12 19:55:43,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-12 19:55:43,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-12 19:55:43,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-12 19:55:43,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-12 19:55:43,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-12 19:55:43,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-12 19:55:43,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-12 19:55:43,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-12 19:55:43,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-12 19:55:43,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-12 19:55:43,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-12 19:55:43,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-12 19:55:43,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-12 19:55:43,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-12 19:55:43,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-12 19:55:43,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-12 19:55:43,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-12 19:55:43,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-12 19:55:43,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-12 19:55:43,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-12 19:55:43,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-12 19:55:43,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-12 19:55:43,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-12 19:55:43,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-12 19:55:43,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-12 19:55:43,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-12 19:55:43,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-12 19:55:43,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-12 19:55:43,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-12 19:55:43,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-04-12 19:55:43,302 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0912166403578643, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-12 19:55:43,303 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912480463919551, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0912166403578643, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-04-12 19:57:43,282 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5993283 different iterations.  Found a solution that moves 1850 regions; Going from a computed imbalance of 0.9912480463919551 to a new imbalance of 4.317992290299789E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6851851851851852, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-12 19:57:43,288 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1004828862:90 , srv1009136203:90 , srv106431984:90 , srv1079838477:90 , srv1121103998:90 , srv1135442030:90 , srv1247466670:90 , srv1278482199:90 , srv1467417020:90 , srv1577100610:90 , srv1588117216:90 , srv164875935:90 , srv1703562337:90 , srv1705292259:90 , srv175891180:90 , srv1930572178:90 , srv1984456119:90 , srv2030052225:90 , srv23595481:90 , srv398163026:90 , srv406330489:90 , srv407026664:90 , srv415519318:90 , srv421943882:90 , srv472202301:90 , srv58683309:90 , srv675079473:90 , srv751185992:90 , srv793552139:90 , srv821540275:90 }
2023-04-12 19:57:43,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-12 19:57:43,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv106431984=2, srv1009136203=1, srv1984456119=16, srv58683309=25, srv398163026=19, srv751185992=27, srv406330489=20, srv1135442030=5, srv1121103998=4, srv164875935=11, srv1705292259=13, srv793552139=28, srv2030052225=17, srv1703562337=12, srv1588117216=10, srv1247466670=6, srv1278482199=7, srv1079838477=3, srv407026664=21, srv1577100610=9, srv472202301=24, srv23595481=18, srv675079473=26, srv821540275=29, srv415519318=22, srv1467417020=8, srv1004828862=0, srv421943882=23, srv175891180=14, srv1930572178=15} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-12 19:57:43,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-12 19:57:43,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-12 19:57:43,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-12 19:57:43,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-12 19:57:43,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-12 19:57:43,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-12 19:57:43,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-12 19:57:43,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-12 19:57:43,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-12 19:57:43,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-12 19:57:43,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-12 19:57:43,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-12 19:57:43,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-12 19:57:43,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-12 19:57:43,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-12 19:57:43,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-12 19:57:43,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-12 19:57:43,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-12 19:57:43,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-12 19:57:43,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-12 19:57:43,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-12 19:57:43,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-12 19:57:43,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-12 19:57:43,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-12 19:57:43,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-12 19:57:43,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-12 19:57:43,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-12 19:57:43,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-12 19:57:43,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-12 19:57:43,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-12 19:57:43,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-04-12 19:57:43,305 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-12 19:57:43,305 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1004828862:90 , srv1009136203:90 , srv106431984:90 , srv1079838477:90 , srv1121103998:90 , srv1135442030:90 , srv1247466670:90 , srv1278482199:90 , srv1467417020:90 , srv1577100610:90 , srv1588117216:90 , srv164875935:90 , srv1703562337:90 , srv1705292259:90 , srv175891180:90 , srv1930572178:90 , srv1984456119:90 , srv2030052225:90 , srv23595481:90 , srv398163026:90 , srv406330489:90 , srv407026664:90 , srv415519318:90 , srv421943882:90 , srv472202301:90 , srv58683309:90 , srv675079473:90 , srv751185992:90 , srv793552139:90 , srv821540275:90 }
2023-04-12 19:57:43,317 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=9 (was 10), OpenFileDescriptor=260 (was 262), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=412 (was 438), ProcessCount=170 (was 169) - ProcessCount LEAK? -, AvailableMemoryMB=789 (was 748) - AvailableMemoryMB LEAK? -